Bytecode Rails LLMs
huggingface.co/bytecodehrPublic Hugging Face models fine-tuned for idiomatic Ruby on Rails code generation.
Problem: General coding models often miss team conventions and generate Rails code that looks plausible but does not match how mature Rails products are actually built and maintained.
What I did:
- Built and published Bytecode’s Rails-focused Hugging Face models
- Fine-tuned Qwen3-based models on 111,000 samples from internal Rails projects
- Prepared GGUF/Ollama-friendly releases for local development workflows
- Documented the dataset engineering, training, quantization, and deployment process
Result: Public Rails-specialized LLMs, including an 8B laptop-friendly model and a 31B MoE flagship model, that encode Bytecode’s Rails conventions directly into the weights.
Tech: Hugging Face, Qwen3, QLoRA, Unsloth, GGUF, Ollama, Ruby on Rails