Skip to content

Pull requests: microsoft/DeepSpeed

New pull request New
116 Open 2,999 Closed
116 Open 2,999 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Autotp training
#6922 opened Jan 2, 2025 by inkcherry Loading…
3
fix: RuntimeError for UCP large DP
#6918 opened Dec 29, 2024 by saforem2 Loading…
1
Tecorigin sdaa accelerator
#6903 opened Dec 23, 2024 by siqi654321 Loading…
1
Fix: forbid repeated deepspeed.initialize on training objects
#6874 opened Dec 16, 2024 by traincheck-team Loading…
1
13
Use ds-specific module id to avoid conflicts
#6847 opened Dec 10, 2024 by tjruwase Loading…
1
[inf] Add config var to enable keeping module on host
#6846 opened Dec 10, 2024 by oelayan7 Loading…
4
Support pure meta model lm_head tp
#6812 opened Dec 2, 2024 by Yejing-Lai Loading…
Check transformers version in BLOOM for inference v1
#6766 opened Nov 19, 2024 by lekurile Loading…
2
Add the missing view operations from sequence parallel(async).
#6750 opened Nov 14, 2024 by inkcherry Loading…
3
Fix building on Windows with presence of Triton
#6749 opened Nov 14, 2024 by woct0rdho Loading…
2
Training ops kernels: Speeding up the Llama-based MoE architectures
#6734 opened Nov 8, 2024 by RezaYazdaniAminabadi • Draft
1
Support latest transformers with DSChat
#6711 opened Nov 4, 2024 by loadams Loading…
Allow launcher to include --include=node3, not just --include=node3:1,2,3,4,5,6,7,8
#6698 opened Nov 1, 2024 by stephen-nju Loading…
1
9
Update MII tests to support transformers latest
#6686 opened Oct 29, 2024 by loadams Loading…
Support the parallel conversion from ZeRO checkpoints to FP32/FP16/BF16 param weight
#6655 opened Oct 23, 2024 by xylian86 Loading…
5 tasks done
3
[DO NOT MERGE] Log test results to file
#6627 opened Oct 15, 2024 by tohtana • Draft
6
modify_load_save_model
#6626 opened Oct 15, 2024 by ssklzx Loading…
3
Improve consistency of zero_grad
#6554 opened Sep 18, 2024 by tohtana • Draft
Enabled configurable auto Tensor Parallelism (TP) for the inference of diverse models
#6553 opened Sep 18, 2024 by gyou2021 Loading…
4
Set shuffle=True by default in data_sampler
#6531 opened Sep 13, 2024 by ranzhejiang Loading…
3
Unpin tests that previously used a pinned version of transformers
#6387 opened Aug 20, 2024 by loadams Loading…
1
[NaN check] Add NaN check to support bfloat16.
#5879 opened Aug 8, 2024 by ys950902 Loading…
3
Fix circular import in ds_transformer.py
#5804 opened Jul 28, 2024 by sznmelvin Loading…
3
Hybrid Offloading for ZeRO3
#5625 opened Jun 7, 2024 by tohtana • Draft
state_dict_factory: llama checkpoint - support SWIGLU
#5601 opened Jun 2, 2024 by nelyahu Loading…
@tohtana
4
ProTip! Updated in the last three days: updated:>2025-01-03.