v1.5.1

What's Changed

• Fix bug: moved handling of the case where imp is none before len is c… by @JamesKing76 in #440
• Fixed some issues in Qwen-2 Pruning. Add examples for Qwen-2.5.

New Contributors

• @JamesKing76 made their first contribution in #440

Full Changelog: v1.5.0...v1.5.1

v1.5.0: Add SliceOp; Support Phi-3 & Qwen-2

What's Changed

• Merge by @VainF in #434
• Add SliceOp; Add Phi-3 & Qwen-2 by @VainF in #435

Full Changelog: v1.4.3...v1.5.0

v1.4.3

What's Changed

• Fixed some issues in GQA Pruning
• [fix] Clarify variable naming in linear_scheduler function, add typing by @janumiko in #423

New Contributors

• @janumiko made their first contribution in #423

Full Changelog: v1.4.2...v1.4.3

v1.4.2

What's Changed

• fixed a bug in attention head pruning
• fixed potentially buggy typo by @Alejandro-Casanova in #405

New Contributors

• @Alejandro-Casanova made their first contribution in #405

Full Changelog: v1.4.1...v1.4.2

v1.4.1

What's Changed

• Add Isomorphic Pruning, an improved algorithm for global pruning.
• Unify local/global/isomorphic pruning with Scope for importance ranking
• Allow user-defined scope for importance ranking. The following key-value pair (model.layer1, model.layer2): 0.4 will perform global ranking only within layer1 and layer2, with the pruning ratio of 40%.

  pruner = tp.pruner.MetaPruner(
      ...
      global_pruning=True,
      pruning_ratio=0.5, # default pruning ratio
      pruning_ratio_dict = {(model.layer1, model.layer2): 0.4, model.layer3: 0.2}, 
      # Global pruning will be performed on layer1 and layer2
  )

• Bugfixing

New Contributors

• @Miocio-nora made their first contribution in #380

Full Changelog: v1.4.0...v1.4.1

v1.4.0: Improved Support for Huggingface Transformers & LLMs

What's Changed

• Add support for Grouped Query Attention (GQA) in Huggingface transformers.
• Include minimal examples for Large Language Models (LLaMA-2 & LLaMA-3).

Full Changelog: v1.3.7...v1.4.0

v1.3.7

• Add more docstrings and comments
• Minor bug fixing

Full Changelog: v1.3.6...v1.3.7

v1.3.6

What's Changed

• fix bug:inversed_idx do not match the origin index by @pleb631 in #321
• Remove ch_groups in tp.importance

New Contributors

• @pleb631 made their first contribution in #321

Full Changelog: v1.3.5...v1.3.6

v1.3.5: bugfixing

What's Changed

• Merge by @VainF in #312
• V1.3 by @VainF in #315

Full Changelog: v1.3.4...v1.3.5

v1.3.4

What's Changed

• fix nan and inf bug in sparse learning by @HollyLee2000 in #310
• Fixed a bug in interactive pruning + iterative pruning + sparse training by @VainF in #311

New Contributors

• @HollyLee2000 made their first contribution in #310

Full Changelog: v1.3.3...v1.3.4