Editing Openai/69191dd5-6360-800d-b47b-7ebcc8b69dc8 (section)

===== - For example, the paper reports that the 8B variant (“Zebra-Llama-8B”) reduces the KV cache size to ~2.73 % of the original model’s cache while preserving >97 % of average zero-shot performance on the LM Harness benchmark (for 8B variant). Hugging Face<ref>{{cite web|title=Hugging Face|url=https://huggingface.co/amd/Zebra-Llama-8B-8MLA-24Mamba-SFT|publisher=Hugging Face|access-date=2025-11-16}}</ref> =====
* Throughput improvements: up to ~2.6-3.8× higher tokens/sec for up to 32k context length compared to e.g., MambaInLLaMA baseline. arXiv<ref>{{cite web|title=arXiv|url=https://arxiv.org/html/2505.17272v1|publisher=arxiv.org|access-date=2025-11-16}}</ref>
* Training token efficiency: The hybrid models trained on only ~7-11 billion tokens (vs trillions in full pre-training). arXiv<ref>{{cite web|title=arXiv|url=https://arxiv.org/abs/2505.17272|publisher=arxiv.org|access-date=2025-11-16}}</ref>