BUG REPORT

Tendermint version: 0.20.0-27bd1dea

Environment:

• OS: Ubuntu 18.04 LTS (Bionic Beaver)
• Processor: Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz (10 cores)
• Memory: 15GB

What happened:
The tm-bench tool shows a performance degradation over time. Initially, I can get performance on the order of 2000tx/s, but this drops off rapidly as the test duration increases. After 1000s, I see transaction rates of only ~200tx/s, and this continues to fall as the test duration increases.

What you expected to happen:
Tendermint transaction rates should be consistent, regardless of test duration.

How to reproduce it:
A detailed report of the study can be found here

This report contains scripts to reproduce the problem, as well as the config.toml from the test runs.

Anything else do we need to know:
I'll be out of the office and unable to check emails for the next week, but I'll be happy to communicate with your team about this issue when I'm back on 9.7.18