The kafka client we use is not really maintained anymore: https://github.com/dpkp/kafka-python.

There is a fork (https://github.com/wbarnha/kafka-python-ng), but I'm inclined to switch to confluent kafka which is better maintained. We'll have to confirm that confluent kafka has the compatibility that we are interested in first.