Open-vocabulary and foundation models

Level 6: Transformers and multimodal vision

Coming soon

This page is being written. See the full roadmap for the whole syllabus.

What this chapter will cover

• Open-vocabulary detection (OWL-ViT, Grounding DINO)
• grounding and referring expressions
• combining detectors with SAM
• foundation models as building blocks
• evaluation and failure modes