Build a Mini GPT and Train It Three Ways
Build a GPT from scratch in PyTorch and train it with pre-training, SFT, and DPO.
Project work by Sarath Sadasivan Pillai on NextWork.
Build a GPT from scratch in PyTorch and train it with pre-training, SFT, and DPO.
Project work by Sarath Sadasivan Pillai on NextWork.