【[906星]DualPipe：DeepSeek开源的创新的双向流水线并行算法，完美解决深度学习中的计算与通信瓶颈问题。亮点：1. 实现前向和后向计算通信的完全重叠，效率大幅提升；2. 减少流水线气泡，优化性能；3. 支持PyTorch 2.0及以上版本，无缝融入现代深度学习框架】
'DualPipe is an innovative bidirectional pipeline parallelism algorithm introduced in the DeepSeek-V3 Technical Report. It achieves full overlap of forward and backward computation-communication phases, also reducing pipeline bubbles.'
GitHub: github.com/deepseek-ai/DualPipe
