Name		Name	Last commit message	Last commit date
Latest commit History 82 Commits
md-assets		md-assets
src		src
..md		..md
.gitignore		.gitignore
=2.15.0		=2.15.0
=4.66		=4.66
README.md		README.md
downloadcode.py		downloadcode.py
gpt_download.py		gpt_download.py
highlevelgptoverview.py		highlevelgptoverview.py
requirements.txt		requirements.txt
tests.ipynb		tests.ipynb
the-verdict.txt		the-verdict.txt
util.py		util.py

Repository files navigation

Building an LLM from scratch

Following this book: Build a Large Language Model From Scratch

Progress

Chapter 1: Understanding LLMs
Chapter 2: Working with Text Data
Chapter 3: Coding Attention mechanisms
Chapter 4: Implementing a GPT model from scratch to generate text
Chapter 5: Pretraining an unlabeled data
Chapter 6: Fine-tuning for classification <--
Chapter 7: Fine tuning to follow instructions

About

building rohaGPT

Report repository

Releases

No releases published

Packages

Contributors

Languages