This repository was archived by the owner on Sep 30, 2024. It is now read-only.
Add configuration for Intent Detection API#63871
Merged
Merged
Conversation
janhartman
approved these changes
Jul 17, 2024
| } | ||
| r.logger.Info("detecting intent", log.String("interactionID", args.InteractionID), log.String("query", args.Query), log.String("intent", intentResponse.Intent), log.Float64("score", intentResponse.Score)) | ||
| return &chatIntentResponse{intent: intentResponse.Intent, score: intentResponse.Score}, nil | ||
| } |
Contributor
There was a problem hiding this comment.
I assume we're dumping the intent somewhere in BQ in the end? If yes, could you please point me to where that is?
Contributor
Author
There was a problem hiding this comment.
It's in Google Cloud Logging, where we can add a sink for BigQuery. https://console.cloud.google.com/logs/query;cursorTimestamp=2024-07-17T09:24:41.733603Z;duration=PT1H?project=sourcegraph-dev
Contributor
There was a problem hiding this comment.
Nice! How hard is it to get that done? It'd be really valuable to have this data for analyses or training.
Contributor
Author
There was a problem hiding this comment.
It's 5m of click-ops, I just want to wait for the messages to start appearing so I can craft a selective filter.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds site-config configuration for RFC 969 intent detection, making the Intent Detection API endpoint and token configurable without code changes. Additionally, adds an option to hit multiple intent detection backends with the same query.
Previously, URL was hardcoded in code, so if the backend has changed, we had to redeploy sourcegraph.com.
As we iterate on intent detection, we want to be able to test multiple models in parallel, so this PR adds a setting for
extrabackends - if provided, additional .com -> backend requests will be sent, but the client-initiated request will not wait for those requests.Closes AI-128.
Test plan
to
experimentalFeaturesin dev-private.