devscope.io

microsoft/DeepSpeed

Python DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.


← Repository List

8216

Stars

962

Forks

8216

Watchers

576

Open Issues



Topics: billion-parameters, compression, data-parallelism, deep-learning, gpu, inference, machine-learning, mixture-of-experts, model-parallelism, pipeline-parallelism, pytorch, trillion-parameters, zero



Repo Information

Age 2yrs
Vendor microsoft
Repo Name DeepSpeed
Primary Language Python
Default Branch master
Last Update 2 days ago

DeepSpeed Issue History



DeepSpeed Watcher Count History

DeepSpeed Repo Size History

πŸ—£οΈ DeepSpeed Issues

πŸ’Ύ DeepSpeed Corrupt BLOOM output [BUG] πŸ’¬ 9 closed πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed [QUESTION] Cuda graph support for word size > 1 πŸ’¬ 3 closed πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed don't gather partitioned activations for mp size 1 πŸ’¬ 7 closed πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed [BUG] Does Zeros optimizations works on windows? any eta when it will? πŸ’¬ 2 closed πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed Deepspeed quantization library v0.1 πŸ’¬ 2 open πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed Add SLURM Multinode Runner πŸ’¬ 4 open πŸ—“οΈ 1 month ago
πŸ’Ύ DeepSpeed [BUG] Bloated MoE expert checkpoint files with ZeRO 2 πŸ’¬ 4 open πŸ—“οΈ 1 month ago