Skip to content

feat(minor): add more flags to the chat command #147

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
giladgd merged 9 commits into from
Jan 24, 2024
Merged

feat(minor): add more flags to the chat command #147

giladgd merged 9 commits into from
Jan 24, 2024

Conversation

@giladgd
Copy link
Member

@giladgd giladgd commented Jan 22, 2024

Description of change

  • feat: add --systemPromptFile flag to the chat command
  • feat: add --promptFile flag to the chat command
  • feat: add --batchSize flag to the chat command

Based on #145 by @stewartoallen, adapted for the beta branch.

Pull-Request Checklist

  • Code is up-to-date with the master branch
  • npm run format to apply eslint formatting
  • npm run test passes with this change
  • This pull request links relevant issues as Fixes #0000
  • There are new or updated unit tests validating the change
  • Documentation has been updated to reflect this change
  • The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

giladgd and others added 9 commits November 26, 2023 21:29
@giladgd
feat: automatic batching (#104)
4757af8 
* feat: evaluate multiple sequences in parallel with automatic batching
* feat: improve automatic chat wrapper resolution
* feat: smart context shifting
* feat: improve TS types
* refactor: improve API
* build: support beta releases
* build: improve dev configurations

BREAKING CHANGE: completely new API (docs will be updated before a stable version is released)
@giladgd
feat: function calling (#139)
5fcdf9b 
* feat: function calling support
* feat: stateless `LlamaChat`
* feat: improve chat wrapper
* feat: `LlamaText` util
* test: add basic model-dependent tests
* fix: threads parameter
* fix: disable Metal for `x64` arch by default
@giladgd
Merge branch 'master' into beta
2cf74fa 
# Conflicts:
#	llama/addon.cpp
#	src/llamaEvaluator/LlamaContext.ts
#	src/llamaEvaluator/LlamaModel.ts
#	src/utils/getBin.ts
@giladgd
feat: show llama.cpp release in GitHub releases (#142)
36c779d
@giladgd
feat: get embedding for text (#144)
4cf1fba 
* feat: get embedding for text
* feat(minor): improve `resolveChatWrapperBasedOnModel` logic
* style: improve GitHub release notes formatting
@giladgd
Merge remote-tracking branch 'origin/master' into beta
9d033a6 
# Conflicts:
#	llama/addon.cpp
#	src/cli/commands/ChatCommand.ts
#	src/llamaEvaluator/LlamaContext.ts
#	src/utils/getBin.ts
@giladgd
chore: merge master into beta
dc530d6
@giladgd
feat: add more flags to the chat command
6146df8
@giladgd
feat: log the batch size when using the --batchSize flag in the `ch…
0f29475 
…at` command
@giladgd giladgd requested a review from ido-pluto January 22, 2024 20:21
@giladgd giladgd self-assigned this Jan 22, 2024
@giladgd giladgd mentioned this pull request Jan 22, 2024
Closed
@giladgd giladgd enabled auto-merge (squash) January 22, 2024 21:57
@giladgd giladgd disabled auto-merge January 24, 2024 21:33
@giladgd giladgd merged commit 1cae987 into master Jan 24, 2024
@giladgd giladgd deleted the gilad/chatCommandPromptFile branch January 24, 2024 21:34
@giladgd giladgd mentioned this pull request Jan 24, 2024
Merged
@giladgd giladgd restored the gilad/chatCommandPromptFile branch January 24, 2024 21:35
@giladgd
Copy link
Member Author

giladgd commented Jan 24, 2024

Merged to master by mistake, reverting

@giladgd giladgd mentioned this pull request Jan 24, 2024
Merged
7 tasks
@giladgd giladgd deleted the gilad/chatCommandPromptFile branch January 24, 2024 21:51
@github-actions
Copy link

github-actions bot commented Sep 24, 2024 •
edited by giladgd
Loading

🎉 This PR is included in version 3.0.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ido-pluto ido-pluto Awaiting requested review from ido-pluto

Assignees

@giladgd giladgd

Labels

released

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@giladgd