-
Notifications
You must be signed in to change notification settings - Fork 4.5k
Log the reason for failure for BigQuery jobs #18419
Copy link
Copy link
Closed
Description
For BigQuery load jobs we currently retry few times and log the job ID.
It might be good to get the reason for the failure from BigQuery (prob. this is available through status poll) and log that as well. For example, failed load jobs are logged at following location.
https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/WriteTables.java#L202
Imported from Jira BEAM-2843. Original Jira may contain additional context.
Reported by: chamikara.
Reactions are currently unavailable