https://answer.freetools.me/tags/transformer%E8%AE%AD%E7%BB%83/ Recent content in Transformer训练 on Answer Hugo -- 0.152.2 zh-cn Thu, 12 Mar 2026 08:26:13 +0800 https://answer.freetools.me/%E6%9D%83%E9%87%8D%E8%A1%B0%E5%87%8F%E4%B8%8El2%E6%AD%A3%E5%88%99%E5%8C%96%E4%B8%BA%E4%BB%80%E4%B9%88%E8%BF%99%E4%B8%AA%E7%9C%8B%E4%BC%BC%E5%BE%AE%E5%B0%8F%E7%9A%84%E5%8C%BA%E5%88%AB%E8%AE%A9adamw%E6%88%90%E4%B8%BA%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%AE%AD%E7%BB%83%E7%9A%84%E6%A0%87%E9%85%8D/ Thu, 12 Mar 2026 08:26:13 +0800 https://answer.freetools.me/%E6%9D%83%E9%87%8D%E8%A1%B0%E5%87%8F%E4%B8%8El2%E6%AD%A3%E5%88%99%E5%8C%96%E4%B8%BA%E4%BB%80%E4%B9%88%E8%BF%99%E4%B8%AA%E7%9C%8B%E4%BC%BC%E5%BE%AE%E5%B0%8F%E7%9A%84%E5%8C%BA%E5%88%AB%E8%AE%A9adamw%E6%88%90%E4%B8%BA%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%AE%AD%E7%BB%83%E7%9A%84%E6%A0%87%E9%85%8D/ 深入解析权重衰减与L2正则化在SGD中等价但在Adam中不等价的原因，揭示AdamW如何通过解耦机制实现正确的正则化效果，成为Transformer和大语言模型训练的默认优化器。