Fault Tolerance | Zhonghao Chenhttps://diogeneschen.github.io/tags/fault-tolerance/Fault ToleranceHugo Blox Builder (https://hugoblox.com)en-usThu, 01 Jan 2026 00:00:00 +0000https://diogeneschen.github.io/media/icon_hu18301096222111465208.pngFault Tolerancehttps://diogeneschen.github.io/tags/fault-tolerance/SPARe: Stacked Parallelism with Adaptive Reordering for Fault-Tolerant LLM Pretraining Systems with 100k+ GPUshttps://diogeneschen.github.io/publication/spare-icml-2026/Thu, 01 Jan 2026 00:00:00 +0000https://diogeneschen.github.io/publication/spare-icml-2026/<p>SPARe studies fault-tolerant LLM pretraining at extreme scale, combining stacked parallelism with adaptive reordering to improve resilience and efficiency for 100k+ GPU systems.</p>