Skip to content

Athena driver doesn't properly list multiple data catalogs #920

@melduforx

Description

@melduforx

Athena driver doesn't support multiple Data Catalogs

Description

The Athena driver only connects to AwsDataCatalog and doesn't support AWS Athena's multi-catalog feature. Athena accounts can have many Data Catalogs (I have 50), but dbcode only shows one.

Expected Behavior

Enumerate all available catalogs using the ListDataCatalogs API

Current Behavior

  • Only AwsDataCatalog is shown regardless of configuration
  • Setting "database": "Stuff1" in the connection config doesn't switch catalogs - it's ignored or treated as a database name within AwsDataCatalog

AWS CLI showing multiple catalogs exist

$ aws athena list-data-catalogs --profile MyProfile --region us-east-1
{
    "DataCatalogsSummary": [
        {"CatalogName": "AwsDataCatalog", "Type": "GLUE"},
        {"CatalogName": "Stuff1", "Type": "GLUE"},
        {"CatalogName": "Stuff2", "Type": "GLUE"},
        {"CatalogName": "Stuff3", "Type": "GLUE"},
        ... (50 total catalogs)
    ]
}

Suggested Solutions

Option A - Enumerate catalogs

Call ListDataCatalogs and show all catalogs in the tree view as top-level nodes

Option B - User-specified catalog

Add a catalog field to the connection config:

{
  "name": "Analytics-Stuff1",
  "driver": "athena",
  "catalog": "Stuff1",
  ...
}

Option C - Both

Enumerate by default, but allow filtering to a specific catalog

Athena SQL syntax for cross-catalog queries

-- Athena supports catalog.database.table syntax
SELECT * FROM Stuff1.default.my_table;
SELECT * FROM AwsDataCatalog.iceberg.events;

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions