However, when I check the dataset splits (my code snippet below executed in root dir ReaSCAN-v1.0 after extracting ReaSCAN-v1.0.zip), I find that that p1-test+p2-test+p3-test NOT EQ test. Maybe I am doing something wrong here and I needed help in figuring out:
>p123_command_sorted[:10]
['pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle,cautiously',
'pull,the,big,blue,circle,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,big,blue,square,and,inside,of,a,red,box,while,spinning',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,big,yellow,cylinder,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,big,yellow,cylinder,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,small,blue,square']
>ptest_command_sorted[:10]
['pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle',
'pull,the,big,blue,circle,cautiously',
'pull,the,big,blue,circle,cautiously',
'pull,the,big,blue,circle,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,big,yellow,cylinder,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,small,blue,square,hesitantly',
'pull,the,big,blue,circle,that,is,in,the,same,column,as,a,small,blue,square,hesitantly']
Hi,
I went through the code and found that p1-test, p2-test, p3-test splits are created from the test split of ReaSCAN-v1.0/ReaSCAN-compositional and they when added up should give test split (the numbers also hint that 921+2120+2712 = 5753).
However, when I check the dataset splits (my code snippet below executed in root dir ReaSCAN-v1.0 after extracting ReaSCAN-v1.0.zip), I find that that p1-test+p2-test+p3-test NOT EQ test. Maybe I am doing something wrong here and I needed help in figuring out:
I get the output: The lists are not identical
Further checking produces:
Thanks in advance for your help! :)