Currently, the detectTokens method in TokenDetectionController has a hardcoded upper limit of 2000 on the number of tokens it can process.
- This logic should be rewritten so that any number of tokens can be processed in batches of 1000.
- Unit tests need to be written.