Skip to content

Allow customizing token cost calculation #97

@yuzisun

Description

@yuzisun

When reducing the token usage limit in external proc, we need a way to allow customizing the token cost calculation such as input_tokens*weight + output_tokens

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions