PetitGPT · research-v1
PetitGPT: Training and Evaluating a 124.6M Language Model on One GPU
The research-v1 release: 13B pretraining positions on one RTX 4090, a 30-layer model, measured benchmark results, and the trade-offs behind instruction tuning.
Read article