This ended up being an issue with the underlying encryption sdk library. https://github.com/awslabs/aws-encryption-sdk-python/issues/13