Frugal learning
Collecting diverse enough data, and annotating it precisely, is complex, costly and time-consuming. To reduce dramatically these needs, we explore various alternatives to fully-supervised learning, e.g, training that is unsupervised (as rOSD at ECCCV’20), self-supervised (as BoWNet at CVPR’20), semi-supervised, active, zero-shot (as ZS3 at NeurIPS’19) or few-shot. We also investigate training with fully-synthetic data (in combination with unsupervised domain adaptation) and with GAN-augmented data (as Semantic Palette at CVPR’21).
Publications
Three Pillars improving Vision Foundation Model Distillation for Lidar
Gilles Puy, Spyros Gidaris, Alexandre Boulch, Oriane Siméoni, Corentin Sautier, Patrick Pérez, Andrei Bursuc, Renaud Marlet
Computer Vision and Pattern Recognition (CVPR), 2024
SPOT: Self-Training with Patch-Order Permutation for Object-Centric Learning with Autoregressive Transformers
Ioannis Kakogeorgiou, Spyros Gidaris, Konstantinos Karantzalos, and Nikos Komodakis
Computer Vision and Pattern Recognition (CVPR), 2024
A Simple Recipe for Language-guided Domain Generalized Segmentation
Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
Computer Vision and Pattern Recognition (CVPR), 2024
Unsupervised Object Localization in the Era of Self-Supervised ViTs: A Survey
Oriane Siméoni, Éloi Zablocki, Spyros Gidaris, Gilles Puy, Patrick Pérez
under review, 2024
SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptation
Bjoern Michele, Alexandre Boulch, Gilles Puy, Tuan-Hung Vu, Renaud Marlet and Nicolas Courty
International Conference on 3D Vision (3DV), 2024
MOCA: Self-supervised Representation Learning by Predicting Masked Online Codebook Assignments
Spyros Gidaris, Andrei Bursuc, Oriane Siméoni, Nikos Komodakis, Matthieu Cord, Patrick Pérez
Transactions on Machine Learning Research (TMLR), 2024
BEVContrast: Self-Supervision in BEV Space for Automotive Lidar Point Clouds
Corentin Sautier, Gilles Puy, Alexandre Boulch, Renaud Marlet, Vincent Lepetit
International Conference on 3D Vision (3DV), 2024
CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Free
Monika Wysoczańska, Michaël Ramamonjisoa, Tomasz Trzciński, Oriane Siméoni
Winter Conference on Applications of Computer Vision (WACV), 2024
POP-3D: Open-Vocabulary 3D Occupancy Prediction from Images
Antonin Vobecky, Oriane Siméoni, David Hurych, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic
Advances in Neural Information Processing Systems (NeurIPS), 2023
You Never Get a Second Chance To Make a Good First Impression: Seeding Active Learning for 3D Semantic Segmentation
Nermin Samet, Oriane Siméoni, Gilles Puy, Georgy Ponimatkin, Renaud Marlet, and Vincent Lepetit
International Conference on Computer Vision (ICCV), 2023
PØDA: Prompt-driven Zero-shot Domain Adaptation
Mohammad Fahes, Tuan-Hung Vu, Andrei Bursuc, Patrick Pérez, Raoul de Charette
International Conference on Computer Vision (ICCV), 2023
Unsupervised Object Localization: Observing the Background to Discover Objects
Oriane Siméoni, Chloé Sekkat, Gilles Puy, Antonin Vobecky, Éloi Zablocki, Patrick Pérez
Computer Vision and Pattern Recognition (CVPR), 2023
RangeViT: Towards Vision Transformers for 3D Semantic Segmentation in Autonomous Driving
Angelika Ando, Spyros Gidaris, Andrei Bursuc, Gilles Puy, Alexandre Boulch, and Renaud Marlet
Computer Vision and Pattern Recognition (CVPR), 2023
ALSO: Automotive Lidar Self-supervision by Occupancy estimation
Alexandre Boulch, Corentin Sautier, Björn Michele, Gilles Puy, Renaud Marlet
Computer Vision and Pattern Recognition (CVPR), 2023
What to Hide from Your Students: Attention-Guided Masked Image Modeling
Ioannis Kakogeorgiou, Spyros Gidaris, Bill Psomas, Yannis Avrithis, Andrei Bursuc, Konstantinos Karantzalos, and Nikos Komodakis
European Conference on Computer Vision (ECCV), 2022
Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillation
Antonin Vobecky, Oriane Siméoni, David Hurych, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Josef Sivic
European Conference on Computer Vision (ECCV), 2022
Active Learning Strategies for Weakly-Supervised Object Detection
Huy V. Vo, Oriane Siméoni, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, and Jean Ponce
European Conference on Computer Vision (ECCV), 2022
CSG0: Continual Urban Scene Generation with Zero Forgetting
Himalaya Jain (*), Tuan-Hung Vu (*), Patrick Pérez and Matthieu Cord (* equal contrib.)
Computer Vision and Pattern Recognition (CVPR) Workshop, 2022
Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data
Corentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch, Andrei Bursuc, and Renaud Marlet
Computer Vision and Pattern Recognition (CVPR), 2022
Localizing Objects with Self-Supervised Transformers and no Labels
Oriane Siméoni, Gilles Puy, Huy V. Vo, Simon Roburin, Spyros Gidaris, Andrei Bursuc, Patrick Pérez, Renaud Marlet, Jean Ponce
British Machine Vision Conference (BMVC), 2021
Large-Scale Unsupervised Object Discovery
Huy V. Vo, Elena Sizikova, Cordelia Schmid, Patrick Pérez and Jean Ponce
Advances in Neural Information Processing Systems (NeurIPS), 2021
Handling new target classes in semantic segmentation with domain adaptation
Maxime Bucher, Tuan-Hung Vu, Matthieu Cord, and Patrick Pérez
Computer Vision and Image Understanding (CVIU), 2021
Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Clouds
Bjoern Michele, Alexandre Boulch, Gilles Puy, Maxime Bucher, and Renaud Marlet
International Conference on 3D Vision (3DV), 2021
Online Bag-of-Visual-Words Generation for Unsupervised Representation Learning
Spyros Gidaris, Andrei Bursuc, Gilles Puy, Nikos Komodakis, Patrick Pérez, and Matthieu Cord
Computer Vision and Pattern Recognition (CVPR), 2021
Semantic Palette: Guiding Scene Generation with Class Proportions
Guillaume Le Moing, Tuan-Hung Vu, Himalaya Jain, Patrick Pérez and Matthieu Cord
Computer Vision and Pattern Recognition (CVPR), 2021
Artificial Dummies for Urban Dataset Augmentation
Antonín Vobecký, David Hurych, Michal Uřičář, Patrick Pérez, and Josef Šivic
AAAI Conference on Artificial Intelligence (AAAI), 2021
Toward Unsupervised, Multi-Object Discovery in Large-Scale Image Collections
Huy V. Vo, Patrick Pérez and Jean Ponce
European Conference on Computer Vision (ECCV), 2020
Learning Representations by Predicting Bags of Visual Words
Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, and Matthieu Cord
Computer Vision and Pattern Recognition (CVPR), 2020
This dataset does not exist: training models from generated images
Victor Besnier, Himalaya Jain, Andrei Bursuc, Matthieu Cord, and Patrick Pérez
International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020
Zero-Shot Semantic Segmentation
Maxime Bucher, Tuan-Hung Vu, Matthieu Cord, and Patrick Pérez
Neural Information Processing Systems (NeurIPS), 2019
Boosting Few-Shot Visual Learning With Self-Supervision
Spyros Gidaris, Andrei Bursuc, Nikos Komodakis, Patrick Pérez, and Matthieu Cord
International Conference on Computer Vision (ICCV), 2019
Unsupervised Image Matching and Object Discovery as Optimization
Huy V. Vo, Francis Bach, Minsu Cho, Kai Han, Yann Lecun, Patrick Pérez and Jean Ponce
Computer Vision and Pattern Recognition (CVPR), 2019