TacoSkill LAB
TacoSkill LAB
HomeSkillHubCreatePlaygroundSkillKit
© 2026 TacoSkill LAB
AboutPrivacyTerms
  1. Home
  2. /
  3. SkillHub
  4. /
  5. deepspeed
Improve

deepspeed

7.0

by zechenzhangAGI

194Favorites
177Upvotes
0Downvotes

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

distributed training

7.0

Rating

0

Installs

Machine Learning

Category

Quick Review

This is a well-structured DeepSpeed skill that provides comprehensive coverage of distributed training concepts including ZeRO optimization, pipeline parallelism, mixed precision training, and various optimization techniques. The Description clearly indicates the skill's purpose for expert guidance on DeepSpeed features. The skill includes extensive documentation organized across multiple reference files covering tutorials, API details, and configuration examples. The Quick Reference section extracts practical patterns (DeepNVMe I/O, MoE for NLG, compression techniques, profiling, configuration) that would be useful for a CLI agent. The structure is clear with categorized references. The novelty score reflects that DeepSpeed training setup, especially with ZeRO stages and complex configurations, involves many parameters and best practices that would require significant token usage for a CLI agent to discover independently. Minor deductions are for: the Quick Reference could be more concise with clearer pattern titles, and the SKILL.md could benefit from a more structured index of when to use which reference file.

LLM Signals

Description coverage8
Task knowledge9
Structure8
Novelty8

GitHub Signals

891
74
19
2
Last commit 0 days ago

Publisher

zechenzhangAGI

zechenzhangAGI

Skill Author

Related Skills

ml-pipelinesparse-autoencoder-traininghuggingface-accelerate

Loading SKILL.md…

Try onlineView on GitHub

Publisher

zechenzhangAGI avatar
zechenzhangAGI

Skill Author

Related Skills

ml-pipeline

Jeffallan

6.4

sparse-autoencoder-training

zechenzhangAGI

7.6

huggingface-accelerate

zechenzhangAGI

7.6

moe-training

zechenzhangAGI

7.6
Try online