Prerequisites

• I am running the latest code. Mention the version if possible as well.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

In the server tool, I would like the stream returned by the /completion endpoint to return "prompt processing progress" similar to what is displayed in the server log.

slot update_slots: id  0 | task 0 | prompt processing progress, n_past = 19200, n_tokens = 256, progress = 0.827836

Motivation

This would allow me to show evaluation progress to the user for long completion processes.

Possible Implementation

No response