Skip to content

Snowflake SQL IN where clause contains maximum number of expressions allowed #2284

@davidhcar

Description

@davidhcar

Expected behavior

Return result set for the following SQL query,

select concept_id, record_count, descendant_record_count, person_count, descendant_person_count
from _results.achilles_result_concept_count where concept_id IN(around 30000 of concept_ids)

Actual behavior

nested exception is net.snowflake.client.jdbc.SnowflakeSQLException: SQL compilation error: error line 3 at position 20
maximum number of expressions in a list exceeded, expected at most 16,384, got 30,000

Total number of records under tab 'Included Source Codes' has 69,523 records

Steps to reproduce behavior

Under Concept Sets --> tab 'Included Source Codes' when this list exceeds 16,384 the above SQL exception from Snowflake thrown.

Note: The tab Included Concept Sets record is 16,384. It looks like Atlas restricting this list to this max but missed on the 'Included Source Codes' tab ? It looks like it but not sure, wanted to include this observation.

The recommendation from snowflake is, rewrite this query with JOIN statement,
https://community.snowflake.com/s/article/maxi-expressions-exceeded

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Relationships

None yet

Development

No branches or pull requests

Issue actions