Skip to content

[ADD] Motion (BEP029): example data set "dualtask"#329

Merged
sappelhoff merged 14 commits intobids-standard:bep029_motionfrom
sgrothk:bep029-motion_dualtask
Feb 3, 2023
Merged

[ADD] Motion (BEP029): example data set "dualtask"#329
sappelhoff merged 14 commits intobids-standard:bep029_motionfrom
sgrothk:bep029-motion_dualtask

Conversation

@sjeung
Copy link
Copy Markdown
Contributor

@sjeung sjeung commented Aug 5, 2022

Adding another example data set from a dual task (EEG + motion)

@sappelhoff sappelhoff changed the base branch from bep029_motion to master August 5, 2022 11:45
@sappelhoff sappelhoff changed the base branch from master to bep029_motion August 5, 2022 11:45
@@ -0,0 +1,19 @@
{
"Acknowledgements":"n\/a",
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are the slashes escaped?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It has to do with JSONLab, which I used for creating this dataset. Apparently the official JSON syntax allows it, too, but I had suggested an update to skip escape. Please see this thread .

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The thread tells me that you found a solution, are you still planning to propagate the solution here?

sjeung added 2 commits August 20, 2022 21:44
motion.json has author names in correct format
channels.tsv type column has "confidence" renamed to "misc"
events are trimmed
Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays.
Removed wrongly added Authors field in motion.json and eeg.json files.
@sjeung sjeung changed the title Motion data: dual task example (BEP029) [ADD] Motion (BEP029): example data set "dualtask" Sep 2, 2022
Copy link
Copy Markdown
Member

@sappelhoff sappelhoff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a HUGE example dataset (3009 files), does it need to be that big, or could you also imagine pruning it down a little? For example by supplying fewer subjectes than originally present in the full dataset?

@rwblair
Copy link
Copy Markdown
Member

rwblair commented Jan 12, 2023

this is a HUGE example dataset (3009 files), does it need to be that big, or could you also imagine pruning it down a little? For example by supplying fewer subjectes than originally present in the full dataset?

All the subjects are about the same size, around 1mb or so and have similar number of files (between 75 and 141). So there's no obvious low hanging fruit.

@sappelhoff sappelhoff changed the base branch from bep029_motion to master February 2, 2023 14:21
@sappelhoff sappelhoff changed the base branch from master to bep029_motion February 2, 2023 14:21
Copy link
Copy Markdown
Member

@sappelhoff sappelhoff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sjeung could you please remove the ._.DS_Store file from the PR and potentially add it to .gitignore?

Other than that, should we merge this into the BEP029 branch now?

@sappelhoff sappelhoff mentioned this pull request Feb 2, 2023
2 tasks
@sjeung
Copy link
Copy Markdown
Contributor Author

sjeung commented Feb 2, 2023

@sjeung could you please remove the ._.DS_Store file from the PR and potentially add it to .gitignore?

Other than that, should we merge this into the BEP029 branch now?

Yes, it is more or less final as it is now. Thanks!

@sappelhoff sappelhoff merged commit 3022dcf into bids-standard:bep029_motion Feb 3, 2023
sappelhoff added a commit that referenced this pull request Mar 15, 2023
* Bep029 motion - Example systemvalidation (#347)

* .json nesting style change, latency channel added

* Updated to adhere to spec change, minor corrections.

Motion.json contains fields from deprecated coordsys. Other minor differences result from updated version of FT data2bids.

* Each tracksys has own json and channels

* .json and channels.tsv bug fix, trim events

Removed undefined field ExternalSoftwareVersions from motion.json
Replaced undfined type values in motion channels.tsv
Trimmed events.tsv filed that were too large

* motion.json has now doi and funding info

Added values for doi and funding fields in motion.json

* Undoing mistaken changes to motion.json

By mistake I had changed motion.json not dataset_description.json. Now correcting that.

* eeg.json wrong fields also removed from body session

* [ADD] dataset for dual motion capture systems, no brain imaging

* [FIX] remove example dataset from this branch

* [ADD] motion systemvalidation dataset

* [FIX] smaller comments by @sappelhoff

---------

Co-authored-by: sjeung <seinjeung@gmail.com>

* tmp: use motion branch for master validation

to be reverted before merging!

* [ADD] Motion (BEP029): example data set "dualtask" (#329)

* Add dual task data set

* Update motion.json and channels.tsv

motion.json has author names in correct format
channels.tsv type column has "confidence" renamed to "misc"
events are trimmed

* Undoing change by mistake and doing the actual fix

Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays.
Removed wrongly added Authors field in motion.json and eeg.json files.

* Update names in channel count fields

* Remove headers from motion.tsv

* Cut down number of participants

 For brevity only include 5 participants in the example.

* Rename channel count json fields

Multi run files were missing in the previous fix

* Do not escape slashes

* Delete ._.DS_Store

* Update .gitignore

* Remove invalid component entry

* Added dualwalking data set to the main README

---------

Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org>

* Remove old version of SR data set (#349)

* [ENH] Re-add spot rotation data set (#350)

* added two motion datasets

spotrotation: physical and virtual motion tracking and simultaneous eeg recording

dualtask: multiple marker from optical system and simultaneous eeg recording

* adjusted names

* add stand session

* Update participants.tsv

* corrected file hierarchy

* add example dataset motion_dualsystem_validation

Example dataset for the BEP029 was added which includes 2 synchronised data recordings of optical motion capture and inertial measurement units

* updated motion dualsystem example dataset

* New files added to motion_dualsystem dataset

* updated spotrotation and dualtask

* updated dataset desc and participant json

* empty motion.tsv files and added scans.json

* .json nesting style change and latency channels added

* Overall update.

Deprecated coordsys, single tracksys is presented as array.

* [FIX] Updated motion_dualsystem_validation dataset according to new BEP029 dev

* Separate json and channel files for different tracksys

* Remove other motion data sets than spot-rotation

* Channel type fix and json extra field removal

* Remove headers, use quaternions

* Channel types in .json count fields updated

* Cut down number of participants

For brevity only include 5 participants in the example.

* Remove escaped slashes

* Add quat_prefix to quat components

And modify wrong entries for components (latency, yaw)

* Create README.md

* Update README.md

* Add motion_spotrotation to main README

---------

Co-authored-by: Soeren <65068522+sgrothk@users.noreply.github.com>
Co-authored-by: Julius Welzel <julius.welzel@gmail.com>
Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org>

* fix README

* motion_systemvalidation - update bidsignore

* remove bidsignore entirely from systemvalidation

* Bep029 motion dualtask (#354)

* Add dual task data set

* Update motion.json and channels.tsv

motion.json has author names in correct format
channels.tsv type column has "confidence" renamed to "misc"
events are trimmed

* Undoing change by mistake and doing the actual fix

Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays.
Removed wrongly added Authors field in motion.json and eeg.json files.

* Update names in channel count fields

* Remove headers from motion.tsv

* Cut down number of participants

 For brevity only include 5 participants in the example.

* Rename channel count json fields

Multi run files were missing in the previous fix

* Do not escape slashes

* Delete ._.DS_Store

* Update .gitignore

* Remove invalid component entry

* Added dualwalking data set to the main README

* Bidsignore (#351)

* Removed patterns in bidsignore which do not correspond to actual files

* Added ingored invalid file

* Update readme and license

* Fix typo in readme

* Remove headers from motion.tsv

* Update json field name

One subject was missing from the last update

* Replace invalid compnent entry with n/a

Again a subject was missing from last touchup

* Compnent column entry for latency channel is n/a

* Compnent column entry for latency channel is n/a

* Remove undefined fields from json of sub20

---------

Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org>
Co-authored-by: Horea Christian <chr@chymera.eu>

* [FIX] Fix column order in channels.tsv files (#358)

* [FIX] reorder columns to match schema

* add latest changes

* fix dataset name in readme

* Remove repeating entries in scans.tsv

---------

Co-authored-by: Julius Welzel <julius.welzel@gmail.com>

* table fences

* [FIX] remove StartTime field from motion.json as in spec change (#359)

* [FIX] reorder columns to match schema

* add latest changes

* fix dataset name in readme

* Remove repeating entries in scans.tsv

* StartTime is removed from spec

---------

Co-authored-by: Julius Welzel <julius.welzel@gmail.com>

* Update motion_dualtask/participants.json

Include age range in "young"

* Update motion_dualtask/participants.json

Include age range in "old"

* Switch back to master for ci now that validator merged.

---------

Co-authored-by: jwelzel <52565341+JuliusWelzel@users.noreply.github.com>
Co-authored-by: sjeung <seinjeung@gmail.com>
Co-authored-by: Soeren <65068522+sgrothk@users.noreply.github.com>
Co-authored-by: Julius Welzel <julius.welzel@gmail.com>
Co-authored-by: Ross Blair <rosswilsonblair@gmail.com>
Co-authored-by: Horea Christian <chr@chymera.eu>
Co-authored-by: Julia Guiomar Niso Galán <guiomar.niso@ctb.upm.es>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants