Unit 13 - Trends and New Architectures

[mmhamdy]

This is the outline of Unit 13 which will discuss new experimental trends in computer vision. Each section represents a chapter in this unit (similar to other HF courses).

The issue for the draft outline has some more details, check it out here #37

• Introduction (assigned to @mmhamdy)
  • On Innovation
  • Case Study: ViT vs. Image Transformer
  • Why Alternative Architectures?
• Hiera (assigned to @dariowsz @gonzachiar )
  • Overview
  • Why it matters
• Hyena (assigned to @lulmer)
  • Overview
  • Why it matters
• I-JEPA (assigned to @mmhamdy)
  • Overview
  • Why it matters
• RMT (assigned to @youssefadr, @farrosalferro)
  • Overview
  • Why it matters
• Trends And Research Directions
  • Open Vocabulary Learning
  • General foundation models for computer vision
  • Domain-specific models