26,335 questions
Advice
0
votes
0
replies
5
views
Modernize Google Workspace Logs Export to BigQuery `usage_` Schema and Resolve Unpopulated Fields
Since the launch of the Google Workspace to BigQuery export feature (circa 2019), significant updates have been made to the activity_ tables (near real-time logging, new schemas for Gemini, etc.). ...
-1
votes
0
answers
40
views
Big Query Export Data Options created numerous files with headers only [duplicate]
Im currently an automation to export data from big query using python3.11.
Im just wondering if im doing it wrong because it creates a lot of file that majority contains headers only. A few a had rows ...
- 57
0
votes
1
answer
57
views
AWS Glue Connection for BigQuery gives "SparkProperties is missing but it is required" and "secretId is not defined in the schema" when using Go SDK
I'm trying to programmatically create a native Google BigQuery connection in AWS Glue using the AWS SDK for Go v2 (github.com/aws/aws-sdk-go-v2/service/glue).
According to the AWS docs (Glue 4.0+ ...
- 9,268
-3
votes
0
answers
27
views
GBQ Simba ODBC ARM package [closed]
In the 3.1.6 BigQuery ODBC driver release notes https://storage.googleapis.com/simba-bq-release/odbc/release-notes-3.1.6.1026.txt it is saying that there is a linux ARM package, however I don't see it ...
-2
votes
0
answers
12
views
How to save data in BigQuery [closed]
I've been having some trouble saving my querys in BigQuery. Ideally, I'd like to save my codes, so I don't have to type them all over again. When I try to do it, it doesn't happen. What am I missing? ...
3
votes
1
answer
81
views
Filtering dataset by geolocation data using SQL in BigQuery
I trying to determine if NCAA basketball games have an affect on liquor sales in the surrounding areas around the stadiums where the teams play their games. I am writing a query that filters and sorts ...
- 33
0
votes
1
answer
40
views
Airflow BigQueryInsertJobOperator and job re-attachment
The inciting problem
One of our DAGs suffers from an issue wherein a BigQueryInsertJobOperator task fails due to it becoming a "zombie task" (from Airflow's perspective); in the "Event ...
- 198
Best practices
0
votes
8
replies
98
views
How can I best optimize a Bigquery SQL by appending completely redundant filters to the query?
I have two different SQL calls to BigQuery. One completes in 22 seconds, the other is identical except that I add completely redundant filter at the end. This second completes in 8 seconds. The ...
- 615
1
vote
0
answers
75
views
GA4 BigQuery Daily Export Missing Data After Specific Date
I have a GA4 property linked to BigQuery for daily export (both iOS and Web data streams selected, “export all events” enabled, no filters).
Everything was working fine until 2025-11-23, when the ...
- 21
-1
votes
1
answer
127
views
Facing issue in Big Query while extracting JSON Value
We are leveraging BigQuery to create reports, with some column values represented in JSON. Below is a sample payload. I can successfully retrieve the Template value, but the objectType value remains ...
- 13
Tooling
1
vote
2
replies
65
views
Windows Shortcut
What shortcuts can I use to split strings in my database (BigQuery). I have been trying a lot of functions and I make use of the google bigquery platform. I'm getting really confused now. I tried ...
- 1
0
votes
1
answer
113
views
Optional nanoseconds when using `timestamp_format` in BigQuery Load Jobs?
I'm loading data into BigQuery and using LoadJobConfig. There's a timestamp_format field where you can specify the format of timestamps.
Checking the data I have, timestamps come in different format:
...
- 5
0
votes
0
answers
68
views
"Was expecting: <EOF>" when using BigQuery
I am trying to use BigQuery and want to search from the Google Cloud SDK Shell.
I logged in and set up with gcloud config init successfully.
I used the BigQuery console to put data in my dataset table....
- 3,834
0
votes
0
answers
77
views
How to achieve dynamic partition pruning in BigQuery TVF using a subquery lookup?
I have a Table Valued Function (TVF) that takes an array of IDs as input.
source_table: A very large table (TBs) partitioned by day on capturedTimestamp.
selection_table: A small lookup table that ...
Tooling
0
votes
3
replies
61
views
How to enforce dynamic partition pruning in BigQuery TVF using a subquery lookup?
I have a table-valued function (TVF) that takes an array of IDs as input.
source_table: a very large table (TBs) partitioned by day on capturedTimestamp
selection_table: a small lookup table that ...