Handle API rate limit #18
Description
hello @andrew2net i have rerun the document generate today but the issue still persists however the number of unreachable entries seems to have decreased. i wonder why they are not reaching the server?
2024-05-30T11:34:58.3096511Z [relaton] ERROR: `doi:10.1111/ips.12026_1` -- unexpected token at '<html>
2024-05-30T11:34:58.3098081Z <head><title>504 Gateway Time-out</title></head>
2024-05-30T11:34:58.3126326Z <body>
2024-05-30T11:34:58.3126975Z <center><h1>504 Gateway Time-out</h1></center>
2024-05-30T11:34:58.3127597Z </body>
2024-05-30T11:34:58.3127967Z </html>
2024-05-30T11:34:58.3128356Z '
2024-05-30T11:34:58.3128851Z [relaton-doi] (doi:10.1145/3425898.3426958) Fetching from search.crossref.org ...
2024-05-30T11:35:05.0569180Z [relaton-doi] (doi:10.1145/3425898.3426958) Found: `10.1145/3425898.3426958`
2024-05-30T11:36:05.1556862Z [relaton] ERROR: `doi:10.1145/3425898.3426958` -- unexpected token at '<html>
2024-05-30T11:36:05.1558747Z <head><title>504 Gateway Time-out</title></head>
2024-05-30T11:36:05.1608365Z <body>
2024-05-30T11:36:05.1609054Z <center><h1>504 Gateway Time-out</h1></center>
2024-05-30T11:36:05.1609715Z </body>
2024-05-30T11:36:05.1610110Z </html>
2024-05-30T11:36:05.1610536Z '
2024-05-30T11:36:05.1611341Z [relaton-doi] (doi:10.1111/psj.12212) Fetching from search.crossref.org ...
2024-05-30T11:36:13.1994063Z [relaton-doi] (doi:10.1111/psj.12212) Found: `10.1111/psj.12212`
2024-05-30T11:37:13.3203786Z [relaton] ERROR: `doi:10.1111/psj.12212` -- unexpected token at '<html>
2024-05-30T11:37:13.3205349Z <head><title>504 Gateway Time-out</title></head>
2024-05-30T11:37:13.3234983Z <body>
2024-05-30T11:37:13.3235804Z <center><h1>504 Gateway Time-out</h1></center>
2024-05-30T11:37:13.3236458Z </body>
2024-05-30T11:37:13.3236845Z </html>
2024-05-30T11:37:13.3237467Z '
2024-05-30T11:37:13.3238094Z [relaton-doi] (doi:10.1177/26339137231222481) Fetching from search.crossref.org ...
2024-05-30T11:37:15.4186069Z [relaton-doi] (doi:10.1177/26339137231222481) Found: `10.1177/26339137231222481`
2024-05-30T11:38:15.6547511Z [relaton] ERROR: `doi:10.1177/26339137231222481` -- unexpected token at '<html>
2024-05-30T11:38:15.6548882Z <head><title>504 Gateway Time-out</title></head>
2024-05-30T11:38:15.6549745Z <body>
2024-05-30T11:38:15.6550454Z <center><h1>504 Gateway Time-out</h1></center>
2024-05-30T11:38:15.6551222Z </body>
2024-05-30T11:38:15.6551756Z </html>
2024-05-30T11:38:15.6552373Z '
2024-05-30T11:38:15.6553372Z [relaton-doi] (doi:10.1007/978-3-031-01584-7) Fetching from search.crossref.org ...
2024-05-30T11:38:27.6612589Z [relaton-doi] (doi:10.1007/978-3-031-01584-7) Found: `10.1007/978-3-031-01584-7`
2024-05-30T11:39:21.7247801Z [relaton-doi] (doi:10.1080/19460171.2014.957056) Fetching from search.crossref.org ...
2024-05-30T11:39:22.3553079Z [relaton-doi] (doi:10.1080/19460171.2014.957056) Found: `10.1080/19460171.2014.957056`
2024-05-30T11:40:20.9806824Z [relaton-doi] (doi:10.1038/s41893-021-00707-5) Fetching from search.crossref.org ...
2024-05-30T11:40:40.8723479Z [relaton-doi] (doi:10.1038/s41893-021-00707-5) Found: `10.1038/s41893-021-00707-5`
2024-05-30T11:41:41.1328409Z [relaton] ERROR: `doi:10.1038/s41893-021-00707-5` -- Net::ReadTimeout with #<TCPSocket:(closed)>
when they are missing the bibliography the errors are populated throughout the document. please advise how to deal with this. thank you.
Originally posted by @ReesePlews in relaton/relaton-iso#166 (comment)