[ADD] Motion (BEP029): example data set "dualtask"#329
[ADD] Motion (BEP029): example data set "dualtask"#329sappelhoff merged 14 commits intobids-standard:bep029_motionfrom
Conversation
| @@ -0,0 +1,19 @@ | |||
| { | |||
| "Acknowledgements":"n\/a", | |||
There was a problem hiding this comment.
It has to do with JSONLab, which I used for creating this dataset. Apparently the official JSON syntax allows it, too, but I had suggested an update to skip escape. Please see this thread .
There was a problem hiding this comment.
The thread tells me that you found a solution, are you still planning to propagate the solution here?
motion.json has author names in correct format channels.tsv type column has "confidence" renamed to "misc" events are trimmed
Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays. Removed wrongly added Authors field in motion.json and eeg.json files.
sappelhoff
left a comment
There was a problem hiding this comment.
this is a HUGE example dataset (3009 files), does it need to be that big, or could you also imagine pruning it down a little? For example by supplying fewer subjectes than originally present in the full dataset?
All the subjects are about the same size, around 1mb or so and have similar number of files (between 75 and 141). So there's no obvious low hanging fruit. |
For brevity only include 5 participants in the example.
Multi run files were missing in the previous fix
sappelhoff
left a comment
There was a problem hiding this comment.
@sjeung could you please remove the ._.DS_Store file from the PR and potentially add it to .gitignore?
Other than that, should we merge this into the BEP029 branch now?
Yes, it is more or less final as it is now. Thanks! |
* Bep029 motion - Example systemvalidation (#347) * .json nesting style change, latency channel added * Updated to adhere to spec change, minor corrections. Motion.json contains fields from deprecated coordsys. Other minor differences result from updated version of FT data2bids. * Each tracksys has own json and channels * .json and channels.tsv bug fix, trim events Removed undefined field ExternalSoftwareVersions from motion.json Replaced undfined type values in motion channels.tsv Trimmed events.tsv filed that were too large * motion.json has now doi and funding info Added values for doi and funding fields in motion.json * Undoing mistaken changes to motion.json By mistake I had changed motion.json not dataset_description.json. Now correcting that. * eeg.json wrong fields also removed from body session * [ADD] dataset for dual motion capture systems, no brain imaging * [FIX] remove example dataset from this branch * [ADD] motion systemvalidation dataset * [FIX] smaller comments by @sappelhoff --------- Co-authored-by: sjeung <seinjeung@gmail.com> * tmp: use motion branch for master validation to be reverted before merging! * [ADD] Motion (BEP029): example data set "dualtask" (#329) * Add dual task data set * Update motion.json and channels.tsv motion.json has author names in correct format channels.tsv type column has "confidence" renamed to "misc" events are trimmed * Undoing change by mistake and doing the actual fix Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays. Removed wrongly added Authors field in motion.json and eeg.json files. * Update names in channel count fields * Remove headers from motion.tsv * Cut down number of participants For brevity only include 5 participants in the example. * Rename channel count json fields Multi run files were missing in the previous fix * Do not escape slashes * Delete ._.DS_Store * Update .gitignore * Remove invalid component entry * Added dualwalking data set to the main README --------- Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org> * Remove old version of SR data set (#349) * [ENH] Re-add spot rotation data set (#350) * added two motion datasets spotrotation: physical and virtual motion tracking and simultaneous eeg recording dualtask: multiple marker from optical system and simultaneous eeg recording * adjusted names * add stand session * Update participants.tsv * corrected file hierarchy * add example dataset motion_dualsystem_validation Example dataset for the BEP029 was added which includes 2 synchronised data recordings of optical motion capture and inertial measurement units * updated motion dualsystem example dataset * New files added to motion_dualsystem dataset * updated spotrotation and dualtask * updated dataset desc and participant json * empty motion.tsv files and added scans.json * .json nesting style change and latency channels added * Overall update. Deprecated coordsys, single tracksys is presented as array. * [FIX] Updated motion_dualsystem_validation dataset according to new BEP029 dev * Separate json and channel files for different tracksys * Remove other motion data sets than spot-rotation * Channel type fix and json extra field removal * Remove headers, use quaternions * Channel types in .json count fields updated * Cut down number of participants For brevity only include 5 participants in the example. * Remove escaped slashes * Add quat_prefix to quat components And modify wrong entries for components (latency, yaw) * Create README.md * Update README.md * Add motion_spotrotation to main README --------- Co-authored-by: Soeren <65068522+sgrothk@users.noreply.github.com> Co-authored-by: Julius Welzel <julius.welzel@gmail.com> Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org> * fix README * motion_systemvalidation - update bidsignore * remove bidsignore entirely from systemvalidation * Bep029 motion dualtask (#354) * Add dual task data set * Update motion.json and channels.tsv motion.json has author names in correct format channels.tsv type column has "confidence" renamed to "misc" events are trimmed * Undoing change by mistake and doing the actual fix Authors, Funding, ReferenceAndLinks fields in dataset_description.json are now arrays. Removed wrongly added Authors field in motion.json and eeg.json files. * Update names in channel count fields * Remove headers from motion.tsv * Cut down number of participants For brevity only include 5 participants in the example. * Rename channel count json fields Multi run files were missing in the previous fix * Do not escape slashes * Delete ._.DS_Store * Update .gitignore * Remove invalid component entry * Added dualwalking data set to the main README * Bidsignore (#351) * Removed patterns in bidsignore which do not correspond to actual files * Added ingored invalid file * Update readme and license * Fix typo in readme * Remove headers from motion.tsv * Update json field name One subject was missing from the last update * Replace invalid compnent entry with n/a Again a subject was missing from last touchup * Compnent column entry for latency channel is n/a * Compnent column entry for latency channel is n/a * Remove undefined fields from json of sub20 --------- Co-authored-by: Stefan Appelhoff <stefan.appelhoff@mailbox.org> Co-authored-by: Horea Christian <chr@chymera.eu> * [FIX] Fix column order in channels.tsv files (#358) * [FIX] reorder columns to match schema * add latest changes * fix dataset name in readme * Remove repeating entries in scans.tsv --------- Co-authored-by: Julius Welzel <julius.welzel@gmail.com> * table fences * [FIX] remove StartTime field from motion.json as in spec change (#359) * [FIX] reorder columns to match schema * add latest changes * fix dataset name in readme * Remove repeating entries in scans.tsv * StartTime is removed from spec --------- Co-authored-by: Julius Welzel <julius.welzel@gmail.com> * Update motion_dualtask/participants.json Include age range in "young" * Update motion_dualtask/participants.json Include age range in "old" * Switch back to master for ci now that validator merged. --------- Co-authored-by: jwelzel <52565341+JuliusWelzel@users.noreply.github.com> Co-authored-by: sjeung <seinjeung@gmail.com> Co-authored-by: Soeren <65068522+sgrothk@users.noreply.github.com> Co-authored-by: Julius Welzel <julius.welzel@gmail.com> Co-authored-by: Ross Blair <rosswilsonblair@gmail.com> Co-authored-by: Horea Christian <chr@chymera.eu> Co-authored-by: Julia Guiomar Niso Galán <guiomar.niso@ctb.upm.es>
Adding another example data set from a dual task (EEG + motion)