Transformers have revolutionized deep learning, but have you ever wondered how the decoder in a transformer actually works?

AI2 has unveiled Bolmo, a byte-level model created by retrofitting its OLMo 3 model with <1% of the compute budget.