We currently maintain both a pyproject.toml and a requirements.txt file in our repository. Both files contain overlapping dependency information, which introduces redundancy and the risk of inconsistencies between them. Our pyproject.toml is actually currently missing many dependencies in requirements.txt.

I have two questions:

Do we need both files? If pyproject.toml serves as the primary source for dependencies, do we still need to maintain a separate requirements.txt file?
What is the best practice for handling dependencies between these two files, particularly in CI pipelines? Should requirements.txt be generated automatically from pyproject.toml to prevent divergence?