Dean Byrne's picture
πŸ”„ In a Training Loop

Dean Byrne PRO

Quazim0t0

AI & ML interests

DaisyChainAI🌼 / SmallLM's / San Francisco / Open Source

Recent Activity

updated a model about 16 hours ago
Quazim0t0/On-Fly-Jev
reacted to DedeProGames's post with πŸ€— about 18 hours ago
πŸš€ Introducing Kiyo-230M-Instruct β€” my compact English & Portuguese chat model! Built on Kiyo-230M-Preview, a base model I pretrained from scratch, Kiyo now has an instruction-tuned release for everyday conversations, rewriting, and lightweight assistant experiments. 🧠 229.7M parameters 🌍 English + Portuguese πŸ’¬ Native chat template for multi-turn conversations πŸ“ 2,048-token context window πŸ“¦ 459 MB of BF16 safetensors weights πŸ”“ Apache-2.0 license For instruction tuning, I used 165,735 conversations from SmolTalk2, smol-smoltalk, UltraChat, and Dolci-Instruct-SFT. Training ran for two complete epochs with assistant-only loss, using a roughly 70% English / 30% Portuguese token mix. The updated model card includes benchmarks against SmolLM2-135M-Instruct, BananaMind, and Supra2, plus example conversations, CPU measurements, training details, and a Transformers quickstart. The results are mixed: Kiyo is competitive with these small models across the reported evaluations, while SmolLM2 and BananaMind score higher on the instruction-following benchmarks. Portuguese was a highlight in the small conversational sanity test. This is an experimental 230M model, with plenty of room to improve reasoning, factual accuracy, and strict instruction following. I’m excited to share it with people exploring how much we can get from small, accessible models! πŸ€— Model & full README: https://huggingface.co/DedeProGames/Kiyo-230M-Instruct πŸ’¬ Try the chat demo: https://huggingface.co/spaces/DedeProGames/kiyo-230m-chat Try it in English or Portuguese β€” I’d love to see your examples, feedback, and experiments!
reacted to DedeProGames's post with 🀯 about 18 hours ago
πŸš€ Introducing Kiyo-230M-Instruct β€” my compact English & Portuguese chat model! Built on Kiyo-230M-Preview, a base model I pretrained from scratch, Kiyo now has an instruction-tuned release for everyday conversations, rewriting, and lightweight assistant experiments. 🧠 229.7M parameters 🌍 English + Portuguese πŸ’¬ Native chat template for multi-turn conversations πŸ“ 2,048-token context window πŸ“¦ 459 MB of BF16 safetensors weights πŸ”“ Apache-2.0 license For instruction tuning, I used 165,735 conversations from SmolTalk2, smol-smoltalk, UltraChat, and Dolci-Instruct-SFT. Training ran for two complete epochs with assistant-only loss, using a roughly 70% English / 30% Portuguese token mix. The updated model card includes benchmarks against SmolLM2-135M-Instruct, BananaMind, and Supra2, plus example conversations, CPU measurements, training details, and a Transformers quickstart. The results are mixed: Kiyo is competitive with these small models across the reported evaluations, while SmolLM2 and BananaMind score higher on the instruction-following benchmarks. Portuguese was a highlight in the small conversational sanity test. This is an experimental 230M model, with plenty of room to improve reasoning, factual accuracy, and strict instruction following. I’m excited to share it with people exploring how much we can get from small, accessible models! πŸ€— Model & full README: https://huggingface.co/DedeProGames/Kiyo-230M-Instruct πŸ’¬ Try the chat demo: https://huggingface.co/spaces/DedeProGames/kiyo-230m-chat Try it in English or Portuguese β€” I’d love to see your examples, feedback, and experiments!
View all activity

Organizations

Build Small Hackathon's profile picture Neural Verified's profile picture DaisyChainAI's profile picture