Skip to content

[Python] Create BigQuery wrapper with pipeline options when performing reads#27583

Merged
riteshghorse merged 1 commit intoapache:masterfrom
ahmedabu98:pass_options_to_wrapper
Jul 21, 2023
Merged

[Python] Create BigQuery wrapper with pipeline options when performing reads#27583
riteshghorse merged 1 commit intoapache:masterfrom
ahmedabu98:pass_options_to_wrapper

Conversation

@ahmedabu98
Copy link
Copy Markdown
Contributor

User mentioned they had trouble reading from an external table connected to a Google sheet because of missing Google Drive credentials. Credentials can be passed in using the GoogleCloudOptions.gcp_oauth_scopes, attribute but we were always creating the BQ wrapper with an empty PipelineOptions object.

These changes create the wrappers using the pipeline's options instead.

@codecov
Copy link
Copy Markdown

codecov bot commented Jul 20, 2023

Codecov Report

Merging #27583 (1df3907) into master (1264974) will increase coverage by 0.00%.
The diff coverage is 0.00%.

@@           Coverage Diff           @@
##           master   #27583   +/-   ##
=======================================
  Coverage   71.14%   71.14%           
=======================================
  Files         861      861           
  Lines      104560   104560           
=======================================
+ Hits        74390    74393    +3     
+ Misses      28622    28619    -3     
  Partials     1548     1548           
Flag Coverage Δ
python 80.33% <0.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
sdks/python/apache_beam/io/gcp/bigquery.py 70.61% <0.00%> (ø)

... and 8 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@github-actions
Copy link
Copy Markdown
Contributor

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @riteshghorse for label python.
R: @Abacn for label io.

Available commands:

  • stop reviewer notifications - opt out of the automated review tooling
  • remind me after tests pass - tag the comment author after tests pass
  • waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

Copy link
Copy Markdown
Contributor

@riteshghorse riteshghorse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for fixing this!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants