Skip to content

describegpt: Together AI interoperability problem with api key #2976

@jqnatividad

Description

@jqnatividad

@jqnatividad Looks like qsv describegpt is getting passed the models stage, but there seems to be an issue with --api-key/QSV_LLM_APIKEY.

$ qsv --version
qsv 7.1.0-mimalloc-apply;fetch;foreach;geocode;Luau 0.690;prompt;python-3.12.10 (main, Apr 22 2025, 00:00:00) [GCC 14.2.1 20240912 (Red Hat 14.2.1-3)];to;polars-0.50.0:py-1.33.0;self_update-4-4;6.12 GiB-18.64 GiB-4.20 GiB-7.65 GiB (x86_64-unknown-linux-gnu compiled with Rust 1.89) compiled

$ git log -1 --color=never
commit ed23219f3ba0076958afda03bbe84b70c5422ac5 (HEAD -> master, origin/master, origin/HEAD)
Author: Joel Natividad <1980690+jqnatividad@users.noreply.github.com>
Date:   Sat Sep 6 15:49:30 2025 -0400

    benchmarks: v7.1.0 run
    
    [skip ci]

$ qsv describegpt --api-key <long hex number> --base-url https://api.together.xyz/v1 --model "meta-llama/Llama-3.3-70B-Instruct-Turbo-Free" --prompt "What is the most common complaint?" NYC311-50k.csv
Calculating SHA256 hash of /home/rick/Documents/Conferences/InstallFest/2025/ecoli/NYC311-50k.csv...
(elapsed: 188.10ms)
Analyzing data...
  Checking analysis cache...
    Analysis disk cache hit!
Analyzed data. (elapsed: 0.05s)

Interacting with LLM...
  Inferring Data Dictionary...
HTTP 401 Unauthorized error: {
    "error": {
        "message": "Incorrect API key provided: XXXXXXXX****************************************************XXXX. You can find your API key at https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": "invalid_api_key"
    }
}

$ QSV_LLM_APIKEY=<long hex number> qsv describegpt --base-url https://api.together.xyz/v1 --model "meta-llama/Llama-3.3-70B-Instruct-Turbo-Free" --prompt "What is the most common complaint?" NYC311-50k.csv
Calculating SHA256 hash of /home/rick/Documents/Conferences/InstallFest/2025/ecoli/NYC311-50k.csv...
(elapsed: 227.15ms)
Analyzing data...
  Checking analysis cache...
    Analysis disk cache hit!
Analyzed data. (elapsed: 0.05s)

Interacting with LLM...
  Inferring Data Dictionary...
HTTP 401 Unauthorized error: {
    "error": {
        "message": "Incorrect API key provided: XXXXXXXX****************************************************XXXX. You can find your API key at https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": "invalid_api_key"
    }
}

FYI, the hex digits that are shown in the error message (shown here as X) are correct. Queries with curl (as shown before) with the same hex number still work.

Originally posted by @rickhg12hs in #2964

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions