I fine-tuned a GPT-2 model for ham/spam SMS classification in Elixir.
This post follows chapter 6 of Sebastian Raschka’s Build a Large Language Model From Scratch, but instead of Python/PyTorch, I implemented the training pipeline in Elixir with Nx.
For me, the most interesting part is not only that GPT-2 can be fine-tuned for classification, but that Elixir is becoming a serious environment for machine learning experiments.

https://karlosmid.com/2026/06/fine-tuning-for-classification/