What work does this Task describe?

This task extends the work of #24443 by increasing coverage of PubsubWriteSchemaTransformProviderIT. The #24443 PR began this task by completing tests that detect errors in writing simple bytes only payload to a non-schema defined Pub/Sub topic within an integration testing context. However, prior to the PR's submission, attempts failed at validating the same for serialized Avro formatted payload Rows written to an Avro schema containing Pub/Sub topic.

What value may result from this Task's output?

While #24443 covers on a unit test level cases addressed in this task, integration testing provides harder empirical measures of code errors that additionally signal gaps in unit test level coverage. End users will be using the code from #24443 from real Google Cloud Pub/Sub and not mocked resources as achieved in that PR.

Ready and Done Measures

Ready

The following are blockers for beginning this task.

• Review/Merge of Implement PubsubWriteSchemaTransformProvider #24443

Done

The following are measures that define this task as complete.

Within an integration testing context, tests detect errors when:

• serializing an Avro formatted Row payload and writing to a Pub/Sub topic lacking a schema definition
• serializing a Json formatted Row payload and writing to a Pub/Sub topic lacking a schema definition
• forwarding the proto not supported when attempting to write to a Pub/Sub topic containing PROTOCOL_BUFFER schema
• forwarding Schema mismatch between the Row payload and the Pub/Sub topic Avro schema
• serializing a Json formatted Row and writing to a Pub/Sub topic Avro schema

Issue Priority

Priority: 3

Issue Component

Component: io-java-gcp