https://answer.freetools.me/categories/%E6%A8%A1%E5%9E%8B%E6%9E%B6%E6%9E%84/ Recent content in 模型架构 on Answer Hugo -- 0.152.2 zh-cn Mon, 09 Mar 2026 07:42:35 +0800 https://answer.freetools.me/%E4%B8%8D%E6%98%AF%E6%89%80%E6%9C%89-token-%E9%83%BD%E5%80%BC%E5%BE%97%E8%A2%AB%E5%90%8C%E7%AD%89%E5%AF%B9%E5%BE%85mixture-of-depths-%E5%A6%82%E4%BD%95%E9%87%8D%E5%A1%91-transformer-%E7%9A%84%E8%AE%A1%E7%AE%97%E8%8C%83%E5%BC%8F/ Mon, 09 Mar 2026 07:42:35 +0800 https://answer.freetools.me/%E4%B8%8D%E6%98%AF%E6%89%80%E6%9C%89-token-%E9%83%BD%E5%80%BC%E5%BE%97%E8%A2%AB%E5%90%8C%E7%AD%89%E5%AF%B9%E5%BE%85mixture-of-depths-%E5%A6%82%E4%BD%95%E9%87%8D%E5%A1%91-transformer-%E7%9A%84%E8%AE%A1%E7%AE%97%E8%8C%83%E5%BC%8F/ 深入解析 Google DeepMind 提出的 Mixture-of-Depths 架构，探讨如何通过动态计算分配重塑 Transformer 的效率范式。从条件计算的演进历史到路由机制的设计细节，再到 MoDification 等后续改进，全面呈现这一技术路线的核心洞见与实践权衡。