https://answer.freetools.me/tags/gradient-checkpointing/ Recent content in Gradient Checkpointing on Answer Hugo -- 0.152.2 zh-cn Sat, 21 Mar 2026 15:50:17 +0800 https://answer.freetools.me/%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%AE%AD%E7%BB%83%E7%9A%84%E6%98%BE%E5%AD%98%E7%93%B6%E9%A2%88%E5%A6%82%E4%BD%95%E7%AA%81%E7%A0%B4%E4%BB%8Ezero%E5%88%B0flash-attention%E7%9A%84%E4%BA%94%E5%B9%B4%E6%8A%80%E6%9C%AF%E6%BC%94%E8%BF%9B/ Sat, 21 Mar 2026 15:50:17 +0800 https://answer.freetools.me/%E5%A4%A7%E6%A8%A1%E5%9E%8B%E8%AE%AD%E7%BB%83%E7%9A%84%E6%98%BE%E5%AD%98%E7%93%B6%E9%A2%88%E5%A6%82%E4%BD%95%E7%AA%81%E7%A0%B4%E4%BB%8Ezero%E5%88%B0flash-attention%E7%9A%84%E4%BA%94%E5%B9%B4%E6%8A%80%E6%9C%AF%E6%BC%94%E8%BF%9B/ 深入解析大模型训练中的显存瓶颈问题，从ZeRO的分片策略到Flash Attention的IO感知算法，全面梳理五年来的显存优化技术演进。包含详细的内存计算公式、技术对比和实战配置指南。