Skip to content

[Feature] Support ImageNet21k dataset.#461

Merged
mzr1996 merged 15 commits intoopen-mmlab:masterfrom
Ezra-Yu:imagenet21k
Oct 28, 2021
Merged

[Feature] Support ImageNet21k dataset.#461
mzr1996 merged 15 commits intoopen-mmlab:masterfrom
Ezra-Yu:imagenet21k

Conversation

@Ezra-Yu
Copy link
Copy Markdown
Collaborator

@Ezra-Yu Ezra-Yu commented Sep 23, 2021

Thanks for your contribution and we appreciate it a lot. The following instructions would make your pull request more healthy and more easily get feedback. If you do not understand some items, don't worry, just make the pull request and seek help from maintainers.

Motivation

add imagnet21k dataset

Modification

add imagnet21k dataset

BC-breaking (Optional)

No

Use cases (Optional)

If this PR introduces a new feature, it is better to list some use cases here and update the documentation.

Checklist

Before PR:

  • Pre-commit or other linting tools are used to fix the potential lint issues.
  • Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests.
  • The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
  • The documentation has been modified accordingly, like docstring or example tutorials.

After PR:

  • If the modification has potential influence on downstream or other related projects, this PR should be tested with those projects, like MMDet or MMSeg.
  • CLA has been signed and all committers have signed the CLA in this PR.

@codecov
Copy link
Copy Markdown

codecov bot commented Sep 23, 2021

Codecov Report

Merging #461 (10963cf) into master (1177feb) will increase coverage by 0.12%.
The diff coverage is 81.94%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #461      +/-   ##
==========================================
+ Coverage   78.94%   79.06%   +0.12%     
==========================================
  Files         104      105       +1     
  Lines        5760     5832      +72     
  Branches      933      944      +11     
==========================================
+ Hits         4547     4611      +64     
- Misses       1089     1093       +4     
- Partials      124      128       +4     
Flag Coverage Δ
unittests 79.06% <81.94%> (+0.12%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
mmcls/datasets/base_dataset.py 91.95% <ø> (+1.14%) ⬆️
mmcls/datasets/imagenet21k.py 81.69% <81.69%> (ø)
mmcls/datasets/__init__.py 100.00% <100.00%> (ø)
mmcls/datasets/imagenet.py 34.04% <0.00%> (+8.51%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 1177feb...10963cf. Read the comment docs.

@mzr1996 mzr1996 changed the title add imagnet21k [Feature] Support ImageNet21k dataset. Sep 29, 2021
@Ezra-Yu Ezra-Yu requested a review from mzr1996 October 27, 2021 10:35
Copy link
Copy Markdown
Member

@mzr1996 mzr1996 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM


def __init__(self,
data_prefix,
pipeline=[],
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In BaseDataset, the pipeline doesn't have a default value, why do we need a default value here?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After thinking about, it is better not to set a default value here.

Copy link
Copy Markdown
Member

@mzr1996 mzr1996 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mzr1996 mzr1996 merged commit 2ce5825 into open-mmlab:master Oct 28, 2021
@Ezra-Yu Ezra-Yu deleted the imagenet21k branch July 18, 2022 08:45
mzr1996 pushed a commit to mzr1996/mmpretrain that referenced this pull request Nov 24, 2022
* add imagnet21k

* Update unit test

* update imaenet21k

* use slots

* use slots

* rename Data_item to ImageInfo

* add unit tests

* Update unit tests

* rm some print

* update unit tests

* fix lint

* remove default value of pipeline
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants