Foundation models

Foundation models break free from predefined and restricted ontologies, enabling them to perceive a wider range of elements in their surroundings. By pretraining these foundation models in an unsupervised way, we can adapt them to a diverse set of tasks.

Selected publications

  1. JAFAR: Jack up Any Feature at Any Resolution
    Paul Couairon*, Loick Chambon*, Louis Serrano, Jean-Emmanuel Haugeard, Matthieu Cord, Nicolas Thome
    NeurIPS, 2025
    pdf Code
  2. Learning to Steer: Input-dependent Steering for Multimodal LLMs
    Jayneel Parekh, Pegah Khayatan, Mustafa Shukor, Arnaud Dapogny, Alasdair Newson, Matthieu Cord
    NeurIPS, 2025
    Project page pdf Code
  3. FLOSS: Free Lunch in Open-vocabulary Semantic Segmentation
    Yasser Benigmim, Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Raoul de Charette
    ICCV, 2025
    pdf Code
  4. MoSiC: Optimal-Transport Motion Trajectories for Dense Self-Supervised Learning
    Mohammadreza Salehi*, Shashanka Venkataramanan*, Ioana Simion, Efstratios Gavves, Cees G. M. Snoek, Yuki M Asano (* equal contribution)
    ICCV, 2025
    pdf Code
  5. VaViM and VaVAM: Autonomous Driving through Video Generative Modeling
    Florent Bartoccioni, Elias Ramzi, Victor Besnier, Shashanka Venkataramanan, Tuan-Hung Vu, Yihong Xu, Loick Chambon, Spyros Gidaris, Serkan Odabas, David Hurych, Renaud Marlet, Alexandre Boulch, Mickael Chen, Éloi Zablocki, Andrei Bursuc, Eduardo Valle, Matthieu Cord
    CoRL Workshop, 2025
    Project page pdf Code
  6. Advancing Semantic Future Prediction through Multimodal Visual Sequence Transformers
    Efstathios Karypidis, Ioannis Kakogeorgiou, Spyros Gidaris, and Nikos Komodakis
    CVPR, 2025
    pdf Code
  8. Test-Time Contrastive Concepts for Open-World Semantic Segmentation
    Monika Wysoczańska, Antonin Vobecky, Amaia Cardiel, Tomasz Trzciński, Renaud Marlet, Andrei Bursuc, Oriane Siméoni
    TMLR, 2025
    pdf
  9. LLM-wrapper: Black-Box Semantic-Aware Adaptation of Vision-Language Models for Referring Expression Comprehension
    Amaia Cardiel, Éloi Zablocki, Elias Ramzi, Oriane Siméoni, Matthieu Cord
    ICLR, 2025
    pdf Code
  10. Fine-Tuning CLIP's Last Visual Projector: A Few-Shot Cornucopia
    Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
    under review, 2025
    pdf Code
  11. MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignments
    Spyros Gidaris, Andrei Bursuc, Oriane Siméoni, Nikos Komodakis, Matthieu Cord, Patrick Pérez
    TMLR 2024 and ICLR, 2025
    pdf Code
  12. GIFT: A Framework for Global Interpretable Faithful Textual Explanations of Vision Classifiers
    Éloi Zablocki*, Valentin Gerard*, Amaia Cardiel, Eric Gaussier, Matthieu Cord, Eduardo Valle
    under review, 2025
    pdf Code
  13. A Concept-Based Explainability Framework for Large Multimodal Models
    Jayneel Parekh, Pegah Khayatan, Mustafa Shukor, Alasdair Newson, Matthieu Cord
    NeurIPS, 2024
    Project page pdf Code
  14. DiffCut: Catalyzing Zero-Shot Semantic Segmentation with Diffusion Features and Recursive Normalized Cut
    Paul Couairon, Mustafa Shukor, Jean-Emmanuel Haugeard, Matthieu Cord, Nicolas Thome
    NeurIPS, 2024
    Project page pdf Code
  15. No Train, all Gain: Self-Supervised Gradients Improve Deep Frozen Representations
    Walter Simoncini, Spyros Gidaris, Andrei Bursuc, Yuki M. Asano
    NeurIPS, 2024
    pdf Code
  17. The BRAVO Semantic Segmentation Challenge Results in UNCV2024
    Tuan-Hung Vu, Eduardo Valle, Andrei Bursuc, Tommie Kerssies, Daan de Geus, Gijs Dubbelman, Long Qian, Bingke Zhu, Yingying Chen, Ming Tang, Jinqiao Wang, Tomáš Vojíř, Jan Šochman, Jiří Matas, Michael Smith, Frank Ferrie, Shamik Basu, Christos Sakaridis, Luc Van Gool
    ECCV, 2024
    pdf Code
  18. Reliability in Semantic Segmentation: Can We Use Synthetic Data?
    Thibaut Loiseau, Tuan-Hung Vu, Mickael Chen, Patrick Pérez, Matthieu Cord
    ECCV, 2024
    pdf Code
  19. UniTraj: A Unified Framework for Scalable Vehicle Trajectory Prediction
    Lan Feng, Mohammadhossein Bahari, Kaouther Messaoud Ben Amor, Éloi Zablocki, Matthieu Cord, Alexandre Alahi
    ECCV, 2024
    pdf Code
  20. A Simple Recipe for Language-guided Domain Generalized Segmentation
    Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
    CVPR, 2024
    pdf Code
  21. OccFeat: Self-supervised Occupancy Feature Prediction for Pretraining BEV Segmentation Networks
    Sophia Sirko-Galouchenko, Alexandre Boulch, Spyros Gidaris, Andrei Bursuc, Antonin Vobecky, Patrick Pérez, Renaud Marlet
    CVPR Workshop WAD, 2024
    pdf Code
  22. Three Pillars improving Vision Foundation Model Distillation for Lidar
    Gilles Puy, Spyros Gidaris, Alexandre Boulch, Oriane Siméoni, Corentin Sautier, Patrick Pérez, Andrei Bursuc, Renaud Marlet
    CVPR, 2024
    pdf Code
  23. BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Clouds
    Corentin Sautier, Gilles Puy, Alexandre Boulch, Renaud Marlet, Vincent Lepetit
    3DV, 2024
    pdf Code
  24. POP-3D: Open-Vocabulary 3D Occupancy Prediction from Images
    Antonin Vobecky, Oriane Siméoni, David Hurych, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic
    NeurIPS, 2023
    pdf Code
  25. PØDA: Prompt-driven Zero-shot Domain Adaptation
    Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
    ICCV, 2023
    pdf Code
  26. ALSO: Automotive Lidar Self-supervision by Occupancy estimation
    Alexandre Boulch, Corentin Sautier, Björn Michele, Gilles Puy, Renaud Marlet
    CVPR, 2023
    pdf Code
  27. What to Hide from Your Students: Attention-Guided Masked Image Modeling
    Ioannis Kakogeorgiou, Spyros Gidaris, Bill Psomas, Yannis Avrithis, Andrei Bursuc, Konstantinos Karantzalos, and Nikos Komodakis
    ECCV, 2022
    pdf Code
  28. Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning
    Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Patrick Pérez, and Matthieu Cord
    CVPR, 2021
    pdf Code
  29. Learning Representations by Predicting Bags of Visual Words
    Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, and Matthieu Cord
    CVPR, 2020
    pdf Code