Summary

This is a feature meta issue to implement the encrypted disk queue for the shipper. The scope is restricted to implementation of encryption for the existing beats disk queue, changing how the queue interacts with producers, consumers and pipelines is out of scope. Design doc can be found here.

Milestones

This feature is considered complete when the following conditions are met:

• benchmark existing beats disk queue
• Implement encrypted queue in beats repo
• Add end to end test that exercises encrypted queue in beats repo
• Add to shipper binary
  • Libbeat disk queue should support custom serialization #41
  • Obtain and store the encryption key: [Shipper][Design] Generate and securely store an encryption key for the shipper's encrypted disk queue elastic-agent#582
• benchmark encrypted disk queue

Related Issues

• elastic/obs-dc-team#729