And gets recorded in llm logs:

[
  {
    "id": "01h7rnv3398bvttagrhfkv1txk",
    "model": "mlc-chat-Llama-2-7b-chat-hf-q4f16_1",
    "prompt": "Two names for a pet dog",
    "system": null,
    "prompt_json": null,
    "options_json": {
      "temperature": 0.99
    },
    "response": "Great, I'd be happy to help! Here are two potential names for a pet dog:\n\n1. Max - This is a classic name that suits a dog of any breed or size. It's simple, easy to pronounce, and has a playful, friendly vibe.\n2. Bella - This name means \"beautiful\" in Italian, and it's a popular choice for dogs because it's both elegant and endearing. It's a good choice for a dog that's lovely to look at and a pleasure to be around.\n\nI hope these suggestions are helpful! Let me know if you have any other questions.",
    "response_json": null,
    "conversation_id": "01h7rnv3382c3dn946p6wfd1gs",
    "duration_ms": 4873,
    "datetime_utc": "2023-08-14T00:06:22.302200",
    "conversation_name": "Two names for a pet dog",
    "conversation_model": "mlc-chat-Llama-2-7b-chat-hf-q4f16_1"
  },
  {
    "id": "01h7rnttbgysb7s6gjyr9we26q",
    "model": "mlc-chat-Llama-2-7b-chat-hf-q4f16_1",
    "prompt": "Two names for a pet dog",
    "system": null,
    "prompt_json": null,
    "options_json": {
      "temperature": 0.1
    },
    "response": "Great, I'd be happy to help! Here are two name suggestions for a pet dog:\n\n1. Max - This is a classic name that suits a dog of any breed or size. It's a simple, yet strong name that conveys a sense of loyalty and friendship.\n2. Bella - This name means \"beautiful\" in Italian, making it a fitting choice for a dog that brings joy and beauty to your life. It's a versatile name that works well for dogs of all breeds and personalities.\n\nI hope these suggestions help you find the perfect name for your new furry friend!",
    "response_json": null,
    "conversation_id": "01h7rnttbfmdp601tb0d1z5c7n",
    "duration_ms": 4828,
    "datetime_utc": "2023-08-14T00:06:13.393375",
    "conversation_name": "Two names for a pet dog",
    "conversation_model": "mlc-chat-Llama-2-7b-chat-hf-q4f16_1"
  }

Uh oh!

Options for temperature etc #7

Description

Metadata

Metadata

Assignees

Labels

Projects

Milestone

Relationships

Development

Issue actions