Conversation
|
Thank you very much! I ran several tests (the running example, SUMMEval.py and NewsRoomEval.py) with your code. It works perfectly except for the issue of pip installation. Your installation command seems to install the latest version transformers. But DiscoScore cannot run properly on higher versions.. Perhaps after merging the PR I will have to downgrade the required version in the setup.py from "transformers>=4.6.1" to "transformers==3.1.0". Is that OK for you :)) |
|
Hi @andyweizhao thanks for the response! If it really only works with that specific version of transformers then yes of course we can pin it in the However, do you know what it is about newer versions of |
|
Hi @JohnGiorgi, I am not very knowledgeable about the PR management, so I extended your changes on my computer to support the latest version of transformers. I wrote you an acknowledgment in README.md :)) Many thanks for the PR! |
|
I am just curious: Is this pull request done and can be closed, or is here still something open? |
|
I made an update in 13d7ff7. It resolved the PR issues and supported the newer version of the transformer lib. |
This PR packages DiscoScore as a proper python package so that it is
pipinstallable. The following changes were madesetup.pywith all major dependencies listeddisco_scoreand name the main modulescorer.py, similar to the popular BERTScore repo.gitignoreimport metricsbecomesfrom disco_score import metricsWith these changes, you can pip install the package right from GitHub:
pip install "git+https://github.com/AIPHES/DiscoScore.git"And then import it anywhere
@andyweizhao please take a look if you have time! I tested it using the example in the
READMEbut more testing might be a good idea. This would make it much easier for others to use your metric :)