Summary by CodeRabbit

• New Features

  • Added comprehensive end-to-end integration tests for both legacy and V2 pipelines, improving test coverage and validation of Merkle tree rollovers, queue processing, and registration logic.
  • Introduced Python scripts for analyzing and comparing performance metrics and TPS statistics from log files.
  • Added public functions for state and address Merkle tree rollovers.

• Enhancements

  • Refactored batch processing to use asynchronous streaming, enabling more efficient, incremental, and concurrent transaction handling.
  • Improved error handling and logging for queue metrics and processing rates.
  • Increased default batch instructions per transaction and RPC pool size for improved throughput.
  • Added support for API keys in client and connection configurations for enhanced security and flexibility.
  • Updated client configurations to include indexer URLs and API keys for improved integration.
  • Enhanced Forester status fetching to use indexer URL and API key.

• Bug Fixes

  • Fixed queue metric logging to provide clearer insights into queue states.

• Documentation

  • Expanded README with detailed environment variable documentation for running e2e V2 tests.

• Chores

  • Updated dependencies and script hashes for Photon indexer installation.
  • Simplified and consolidated GitHub Actions test workflows.
  • Removed deprecated traits and error types across the codebase.

• Tests

  • Added new utility functions and removed ignored attributes to enable more robust automated test execution.
  • Improved test utilities for slot and protocol config management.
  • Added legacy priority fee tests to validate fee capping and RPC fee estimation.

• Refactor

  • Removed deprecated traits and error types, simplifying codebase and generic constraints.
  • Streamlined batch and transaction processing logic for maintainability and performance.
  • Consolidated streaming abstractions for batch instruction generation and transaction submission.
  • Simplified trait bounds and removed IndexerType trait usage throughout the codebase.