https://answer.freetools.me/categories/transformer/ Recent content in Transformer on Answer Hugo -- 0.152.2 zh-cn Wed, 11 Mar 2026 23:54:43 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88gpt%E5%92%8Cllama%E9%83%BD%E9%80%89%E6%8B%A9pre-lntransformer%E5%B1%82%E5%BD%92%E4%B8%80%E5%8C%96%E4%BD%8D%E7%BD%AE%E7%9A%84%E5%8D%81%E5%B9%B4%E6%8A%89%E6%8B%A9/ Wed, 11 Mar 2026 23:54:43 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88gpt%E5%92%8Cllama%E9%83%BD%E9%80%89%E6%8B%A9pre-lntransformer%E5%B1%82%E5%BD%92%E4%B8%80%E5%8C%96%E4%BD%8D%E7%BD%AE%E7%9A%84%E5%8D%81%E5%B9%B4%E6%8A%89%E6%8B%A9/ 为什么GPT和LLaMA都选择Pre-LN？Transformer层归一化位置的十年抉择 https://answer.freetools.me/softmax%E5%87%BD%E6%95%B0%E4%B8%BA%E4%BB%80%E4%B9%88%E8%BF%99%E4%B8%AA%E5%85%AC%E5%BC%8F%E7%BB%9F%E6%B2%BB%E4%BA%86%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C%E7%9A%84%E6%A6%82%E7%8E%87%E8%BE%93%E5%87%BA/ Wed, 11 Mar 2026 20:47:14 +0800 https://answer.freetools.me/softmax%E5%87%BD%E6%95%B0%E4%B8%BA%E4%BB%80%E4%B9%88%E8%BF%99%E4%B8%AA%E5%85%AC%E5%BC%8F%E7%BB%9F%E6%B2%BB%E4%BA%86%E7%A5%9E%E7%BB%8F%E7%BD%91%E7%BB%9C%E7%9A%84%E6%A6%82%E7%8E%87%E8%BE%93%E5%87%BA/ 从指数函数的放大效应到温度参数的物理意义，从交叉熵损失的完美配合到Transformer注意力机制，深入解析Softmax函数的数学原理、工程实践与替代方案演进。