[Diário de Bordo Maeumjigi Capstone #12] Tentativa de Fine-Tuning do Modelo Gigante 70B & A Batalha Contra GPU OOM
· 3 min para ler
On May 3, having gained enough experience with the 8B models, our team finally challenged the ultimate kings of performance: fine-tuning massive 70B (70 billion parameters) models. We attempted to train both Llama 3.3 70B and DeepSeek-R1 70B, but as expected, we hit a massive hardware resource wall.