Skip to content

yolo and coco streaming exporters#81

Merged
Eldies merged 97 commits intodevelopfrom
dl/stream-export-yolo
Mar 5, 2025
Merged

yolo and coco streaming exporters#81
Eldies merged 97 commits intodevelopfrom
dl/stream-export-yolo

Conversation

@Eldies
Copy link
Copy Markdown

@Eldies Eldies commented Feb 10, 2025

Summary

enabling streaming export for yolo formats
syncing coco formats

depends on #85

How to test

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have added the description of my changes into CHANGELOG.​
  • I have updated the documentation accordingly

License

  • I submit my code changes under the same MIT License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2025 CVAT.ai Corporation
#
# SPDX-License-Identifier: MIT

@Eldies Eldies force-pushed the dl/stream-export-yolo branch from f056959 to d125636 Compare February 10, 2025 14:44
@Eldies Eldies force-pushed the dl/stream-export-yolo branch from d125636 to 2a563fc Compare February 10, 2025 16:20
Eldies and others added 2 commits February 10, 2025 20:35
# Conflicts:
#	src/datumaro/plugins/data_formats/yolo/base.py
#	src/datumaro/util/image.py
#	tests/unit/test_image.py
Co-authored-by: Maxim Zhiltsov <zhiltsov.max35@gmail.com>
Base automatically changed from dl/sync-with-upstream-formats to develop February 25, 2025 12:55
@zhiltsov-max
Copy link
Copy Markdown
Collaborator

zhiltsov-max commented Mar 5, 2025

Ok, so from what I can see, streaming really works only for single subset extractors (because of this implementation). For multiple subsets it will traverse the source several times in many exporters. I think we can start with this PR, because it works fine for tasks and jobs, but for projects this will not be enough. Please make a separate PR with StreamDataset tests, incorporating upstream tests and adding some new ones.

@Eldies Eldies force-pushed the dl/stream-export-yolo branch from d5237de to c707f3c Compare March 5, 2025 11:50
@sonarqubecloud
Copy link
Copy Markdown

sonarqubecloud bot commented Mar 5, 2025

@Eldies Eldies merged commit e5dc37d into develop Mar 5, 2025
6 checks passed
@Eldies Eldies deleted the dl/stream-export-yolo branch March 5, 2025 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants