Skip to content

Revise the consolidation with Crossref #1397

@lfoppiano

Description

@lfoppiano

After a discussion with Crossref, we should revise the consolidation mechanism:

  • Update all Huggingfaces and public images to use the polite way (set the mailto in the header - via configuration)
  • Add a reaction to 429 slowing down with exponential backoff + jitter or killing the consolidation
  • Add a status field in the header to feedback the users about the status of the consolidation (like in citations Feature: Flagging (un)matched references when consolidating enabled #1312)
  • Revise the concurrency for polite and non-polite (probably already good, we could use different pool size for the two cases)

Ref: https://www.crossref.org/documentation/retrieve-metadata/rest-api/access-and-authentication/#74000

Metadata

Metadata

Assignees

No one assigned

    Labels

    consolidationIssue related to consolidation and biblio-glutton/crossref external serviceenhancement

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions