💾 LLM Architecture Cheat Sheet: from GPT-2 to Trillion-scale Models

LLM Architecture Gallery — a page with cards for 39 models (2019–2026): DeepSeek, Qwen, Llama, Kimi, Grok, Nemotron, and others. For each — an architecture diagram, decoder type (dense / sparse MoE / hybrid), attention type, and links to technical reports and configs from HuggingFace.

It's clear how the market has converged on MoE + MLA for large models and why hybrid architectures (Mamba-2, DeltaNet, Lightning Attention) are gaining momentum.

🔘 Open Gallery
https://sebastianraschka.com/llm-architecture-gallery/

https://t.me/DataScienceT 🔴