关键词: 容错, 异构, 无盘检查点, Charm++, 负载均衡, 分布式冗余

Abstract: Fault tolerance is an inevitable issue for long-running large-scale applications. Heterogeneous devices make the reliability problem more extrude. Focusing on the hardware failures, this paper presents a fault-tolerant mechanism in the heterogeneous clusters. It’s also implemented in the large-scale parallelization software of the cosmological fluid simulation in WIGEON based on the parallel pattern of Charm++ RTS and CUDA. What’s more, it’s combined with dynamic load-balancing for adapting the unbalanced computing node configuration after failures. Through the experiments and analysis on Mole8.5, it validates the efficiency and feasibility of this algorithm, and the recovery time only takes 1~4 seconds, and it also uses the distributed redundant data to improve Double-in-Memory checkpoint algorithm. The new fault-tolerant algorithm reduces memory footprint by 50% at the most without extra performance loss.

Key words: fault tolerance, heterogeneous, in-memory checkpoint, Charm++, load-balancing, distributed redundant