Skip to content

Issues: xrsrke/pipegoose

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

23 Open 9 Closed
23 Open 9 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Multimodal MoE help wanted Extra attention is needed High Priority
#61 opened Dec 11, 2023 by xrsrke
@xrsrke
Distributed CLIP help wanted Extra attention is needed
#60 opened Dec 10, 2023 by xrsrke
DiLoCo replication (DiLoCo: Distributed Low-Communication Training of Language Models) help wanted Extra attention is needed High Priority
#59 opened Dec 10, 2023 by xrsrke
@xrsrke
Making pipeline parallelism compatible with transformers
#52 opened Dec 1, 2023 by xrsrke
3 tasks
@xrsrke
End-to-end FP8 training help wanted Extra attention is needed High Priority
#45 opened Nov 26, 2023 by xrsrke
1 of 8 tasks
@xrsrke @3outeille
1
Automatic module mapping using torch.fx good first issue Good for newcomers
#40 opened Nov 22, 2023 by xrsrke v1
@yugen-ok
3
Tensor Parallelism
#37 opened Nov 20, 2023 by 3outeille
Distributed Logger good first issue Good for newcomers
#33 opened Nov 14, 2023 by xrsrke
2 tasks
@KevorkSulahian
1
Save and load checkpoints good first issue Good for newcomers help wanted Extra attention is needed
#29 opened Nov 8, 2023 by xrsrke
@danielgrittner
Lazy initialization of massive models help wanted Extra attention is needed
#25 opened Oct 27, 2023 by xrsrke
1
Sequence Parallelism
#22 opened Oct 25, 2023 by xrsrke
6 tasks
@xrsrke @3outeille
1
Mixture of Experts
#19 opened Oct 25, 2023 by xrsrke
3 of 11 tasks
@xrsrke
Trainer good first issue Good for newcomers
#18 opened Oct 25, 2023 by xrsrke
3 tasks
@isamu-isozaki
4
Implement new tensor parallelism technique help wanted Extra attention is needed
#17 opened Oct 25, 2023 by xrsrke
Setup documentation good first issue Good for newcomers help wanted Extra attention is needed
#16 opened Oct 25, 2023 by xrsrke
Mixed precision training in FP16 help wanted Extra attention is needed
#14 opened Oct 25, 2023 by xrsrke
3 tasks
Fused Optimizer
#13 opened Oct 25, 2023 by xrsrke
3 tasks
@isamu-isozaki
8
Kernel Fusion using torch.jit good first issue Good for newcomers
#10 opened Oct 25, 2023 by xrsrke
3 tasks
@sami-bg
3
Port CUDA Kernels good first issue Good for newcomers help wanted Extra attention is needed
#8 opened Oct 25, 2023 by xrsrke
2 tasks
@isamu-isozaki
6
Implement new pipeline parallelism technique High Priority
#7 opened Oct 25, 2023 by xrsrke
@xrsrke @danielgrittner
Model partitioning for pipeline parallelism
#6 opened Oct 25, 2023 by xrsrke v1
@abourramouss
1
Bucket small tensors and collective operations into larger ones
#5 opened Oct 25, 2023 by xrsrke v1
@xrsrke
Gradient Checkpointing
#4 opened Oct 25, 2023 by xrsrke
@Etelis
1
ProTip! Follow long discussions with comments:>50.