https://answer.freetools.me/tags/%E9%9A%90%E5%BC%8F%E5%BE%AE%E8%B0%83/ Recent content in 隐式微调 on Answer Hugo -- 0.152.2 zh-cn Mon, 09 Mar 2026 01:56:34 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%83%BD%E4%BB%8E%E5%87%A0%E4%B8%AA%E4%BE%8B%E5%AD%90%E4%B8%AD%E5%AD%A6%E4%BC%9A%E6%96%B0%E4%BB%BB%E5%8A%A1%E4%BB%8E%E9%9A%90%E5%BC%8F%E6%A2%AF%E5%BA%A6%E4%B8%8B%E9%99%8D%E5%88%B0induction-head%E7%9A%84%E6%8A%80%E6%9C%AF%E8%A7%A3%E5%AF%86/ Mon, 09 Mar 2026 01:56:34 +0800 https://answer.freetools.me/%E4%B8%BA%E4%BB%80%E4%B9%88%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%83%BD%E4%BB%8E%E5%87%A0%E4%B8%AA%E4%BE%8B%E5%AD%90%E4%B8%AD%E5%AD%A6%E4%BC%9A%E6%96%B0%E4%BB%BB%E5%8A%A1%E4%BB%8E%E9%9A%90%E5%BC%8F%E6%A2%AF%E5%BA%A6%E4%B8%8B%E9%99%8D%E5%88%B0induction-head%E7%9A%84%E6%8A%80%E6%9C%AF%E8%A7%A3%E5%AF%86/ 深入解析大语言模型上下文学习(In-Context Learning)的底层机制。从2020年GPT-3的意外发现，到2023年微软研究院的隐式微调理论，再到Anthropic的Induction Head机制，系统梳理这一改变AI应用范式的核心技术。涵盖Transformer注意力与梯度下降的对偶形式、训练过程中的相变现象、ICL与微调的质量差距分析，以及影响ICL性能的关键因素。