This repository contains the official PyTorch implementation of the following paper:
Correlational Image Modeling for Self-Supervised Visual Pre-Training,
Wei Li, Jiahao Xie, Chen Change Loy
In: The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[arXiv][[Bibtex]
- [07/2023] Code and models are released.
Please refer to INSTALL.md for installation and dataset preparation.
Please refer to PRETRAIN.md for the pre-training instruction.
Please refer to FINETUNE.md for the fine-tuning instruction.
ImageNet-1K Pre-trained and Fine-tuned Models
| Method | Backbone | Pre-train epochs | Fine-tune epochs | Top-1 acc (%) | Pre-trained model | Fine-tuned model |
|---|---|---|---|---|---|---|
| CIM | ViT-B/16 | 300 | 100 | 83.1 | model | model |
If you find our work useful for your research, please consider giving a star ⭐ and citation 🍺:
@inproceedings{li2023correlational,
title={Correlational Image Modeling for Self-Supervised Visual Pre-Training},
author={Li, Wei and Xie, Jiahao and Loy, Chen Change},
booktitle={CVPR},
year={2023}
}This code is built using the mae library.