https://answer.freetools.me/categories/ai%E4%B8%8E%E5%A4%A7%E6%A8%A1%E5%9E%8B/ Recent content in AI与大模型 on Answer Hugo -- 0.152.2 zh-cn Wed, 11 Mar 2026 19:16:29 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88transformer%E7%9A%84%E6%B3%A8%E6%84%8F%E5%8A%9B%E8%A6%81%E9%99%A4%E4%BB%A5d%E2%82%96%E4%BB%8E%E6%96%B9%E5%B7%AE%E5%88%B0%E6%A2%AF%E5%BA%A6%E6%B6%88%E5%A4%B1%E7%9A%84%E5%AE%8C%E6%95%B4%E6%95%B0%E5%AD%A6%E8%A7%A3%E6%9E%90/ Wed, 11 Mar 2026 19:16:29 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88transformer%E7%9A%84%E6%B3%A8%E6%84%8F%E5%8A%9B%E8%A6%81%E9%99%A4%E4%BB%A5d%E2%82%96%E4%BB%8E%E6%96%B9%E5%B7%AE%E5%88%B0%E6%A2%AF%E5%BA%A6%E6%B6%88%E5%A4%B1%E7%9A%84%E5%AE%8C%E6%95%B4%E6%95%B0%E5%AD%A6%E8%A7%A3%E6%9E%90/ 深入解析Transformer缩放点积注意力中√dₖ缩放因子的数学原理：从点积方差随维度增长、Softmax饱和导致的梯度消失，到与Xavier初始化的深层联系。涵盖完整数学推导、数值示例、与加性注意力的对比分析。