Greptile Summary

This PR refactors endpoint format selection by renaming custom_endpoints.go → select_endpoints.go and updating SelectAPIFormatForRequestType → SelectAPIFormat, which now accepts the full *llm.Request so it can prefer an outbound endpoint whose API format matches the inbound format (enabling transparent pass-through). Two new format maps (compactCapableAPIFormats, videoCapableAPIFormats) and their corresponding switch cases for RequestTypeCompact and RequestTypeVideo are also added, covering all seven RequestType values.

Confidence Score: 5/5

Safe to merge — the previously identified P1 concern about compact format routing is fully resolved by the new RequestTypeCompact handling, and all seven request types are now covered.

No P0 or P1 issues remain. The new SelectAPIFormat correctly separates compact requests (RequestTypeCompact → compactCapableAPIFormats) from chat requests (RequestTypeChat → chatCapableAPIFormats), resolving the earlier concern. All request types are accounted for in the switch, call sites are updated consistently, and test coverage is comprehensive.

No files require special attention.

Important Files Changed

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    A[SelectAPIFormat called\nwith endpoints + req] --> B{endpoints empty?}
    B -- yes --> C[return empty string]
    B -- no --> D[requestType = req.RequestType\npreferredFormat = req.APIFormat]
    D --> E{switch requestType}
    E -- RequestTypeChat --> F[allowed = chatCapableAPIFormats]
    E -- RequestTypeCompact --> G[allowed = compactCapableAPIFormats]
    E -- RequestTypeCompletion --> H[allowed = completionCapableAPIFormats]
    E -- RequestTypeEmbedding --> I[allowed = embeddingCapableAPIFormats]
    E -- RequestTypeImage --> J[allowed = imageCapableAPIFormats]
    E -- RequestTypeRerank --> K[allowed = rerankCapableAPIFormats]
    E -- RequestTypeVideo --> L[allowed = videoCapableAPIFormats]
    F & G & H & I & J & K & L --> M{allowed != nil?}
    M -- no --> P[return endpoints 0 .APIFormat]
    M -- yes --> N{preferredFormat != empty?}
    N -- yes --> O[Loop: find ep where\nallowed AND ep.APIFormat == preferredFormat]
    O -- found --> Q[return ep.APIFormat pref match]
    O -- not found --> R[Loop: find first ep in allowed]
    N -- no --> R
    R -- found --> S[return ep.APIFormat first capable]
    R -- not found --> P

_{Reviews (4): Last reviewed commit: "feat: prefer outbound format equals to i..." | Re-trigger Greptile}