Conversation
|
This is quite strange, it seems that while the tests I added works on my local machine, it does not work on the CI server. I am investigating if the transformer versions are the same or not. |
|
Have added a CI step to print out the version of installed python packages at #334 . |
|
Right, it seems that the transformer version is 4.29.2, when the latest one is 4.31.0. |
|
I see. The github ci will cache the python package (so that we do not need to reinstall the large packages like pytorch for every run), and this also makes some packages not up to date. Just cleared the python cache manually on the ci server. |
|
It appears that updating transformers broke torch dynamo for bert, specifically for dynamic=True. This has nothing to do with our backend, though. |
|
I see, could you skip the corresponding tests in this PR? Let's wait for the fix from pytorch people. |
Fix llama2 and add test for num_heads != num_key_value_heads. --------- Co-authored-by: Allan Lin <allan.lin@centml.ai>
author su <soodoshll@gmail.com> 1690484279 -0400 committer Qidong Su <soodoshll@gmail.com> 1691188805 +0000 parent a73fc3e author su <soodoshll@gmail.com> 1690484279 -0400 committer Qidong Su <soodoshll@gmail.com> 1691184810 +0000 shard spec data structure [CI] List package versions in ci (hidet-org#334) update update update update update update update [Models] Llama2 fix (hidet-org#333) Fix llama2 and add test for num_heads != num_key_value_heads. --------- Co-authored-by: Allan Lin <allan.lin@centml.ai> update update update update upate update update update update fix update update update update' remove llama update dependency update update update update update update add llama update update format refactor update update shard spec data structure update update update update update update update format refactor fix update fix fix
author su <soodoshll@gmail.com> 1690484279 -0400 committer Qidong Su <soodoshll@gmail.com> 1691188805 +0000 parent a73fc3e author su <soodoshll@gmail.com> 1690484279 -0400 committer Qidong Su <soodoshll@gmail.com> 1691184810 +0000 shard spec data structure [CI] List package versions in ci (hidet-org#334) update update update update update update update [Models] Llama2 fix (hidet-org#333) Fix llama2 and add test for num_heads != num_key_value_heads. --------- Co-authored-by: Allan Lin <allan.lin@centml.ai> update update update update upate update update update update fix update update update update' remove llama update dependency update update update update update update add llama update update format refactor update update shard spec data structure update update update update update update update format refactor fix update fix fix
Fix llama2 and add test for num_heads != num_key_value_heads.