Hi, nice tutorials!
Thank you for adding TAPAS to huggingface/transformers. It is really helpful.
However, according to your Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb, the performance of tapas-base-finetuned-tabfact on test set is 77.1 while it is reported as 78.5 in the paper. What attributes to the performance drop?
Thank you!
Hi, nice tutorials!
Thank you for adding
TAPAStohuggingface/transformers. It is really helpful.However, according to your
Evaluating_TAPAS_on_the_Tabfact_test_set.ipynb, the performance oftapas-base-finetuned-tabfacton test set is 77.1 while it is reported as 78.5 in the paper. What attributes to the performance drop?Thank you!