Opinionated GPT implementation and finetuning harness.
Cloning the repo:
git clone git@github.com:transmissions11/bistro.git
cd bistroInstalling dependencies:
pip install -r requirements.txtDownloading and setting up a base model:
python lit_script.py download --repo_id lmsys/vicuna-7b-v1.5
python lit_script.py convert_hf_checkpoint --checkpoint_dir checkpoints/lmsys/vicuna-7b-v1.5 --dtype bfloat16(Optional) Use Flash Attention 2 (only available in PyTorch 2.2)
pip uninstall -y torch torchvision torchaudio torchtext
pip install --pre torch --index-url https://download.pytorch.org/whl/nightly/cu121See lit-gpt's setup guide for additional info.
Built on lit-gpt.