Show HN: TurboGPT: train 22KiB transformer in 13s

Show HN: TurboGPT: train 22KiB transformer in 13s Build Windows, Visual Studio 2022 C++ tools, and CUDA 13.4: .\build.ps1 - CudaArch 86 CudaArch is the GPU compute capability from NVIDIA's CUDA GPU list . Run .\build\ turbogpt.exe -- data hn1g.txt -- log - to runs / ctx4 The run stores its checkpoint at runs/ctx4/ctx4.pt , containing model, optimizer, scheduler, and trainer state.

This Other is relevant to the technology intelligence record because it involves NVIDIA, GPT-training, GPT-in. The source article should remain the factual reference for follow-up coverage.

• Build Windows, Visual Studio 2022 C++ tools, and CUDA 13.4: .\build.ps1 - CudaArch 86 CudaArch is the GPU compute capability from NVIDIA's CUDA GPU list .
• Run .\build\ turbogpt.exe -- data hn1g.txt -- log - to runs / ctx4 The run stores its checkpoint at runs/ctx4/ctx4.pt , containing model, optimizer, scheduler, and trainer state.
• Use --load CHECKPOINT.pt to resume it.
• runs/ctx4/report.json is derived from the log directory.
• Logs are TensorBoard-compatible: one report per batch, capped at 8Mi reports, and flushed with periodic or final checkpoints.
• Result hn1g after 1.5G training tokens: 2.52435 BPB .