I have a local server running and setup my script with the text_qa.run_batch example. Is there a way to get the logprobs for each token like in the OpenAI API?
I have a local server running and setup my script with the text_qa.run_batch example.
Is there a way to get the logprobs for each token like in the OpenAI API?