New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Epic] Preference Tuning Support #335

Open

5 tasks

ktam3 opened this issue Nov 12, 2024 · 0 comments

Assignees

ktam3 commented Nov 12, 2024 •

edited

Loading

Tasks Needed:

First Phase:

Preference Tuning: Add support for pairwise data and contrastive loss #337
Preference Tuning: vllm throughput analysis for tenser parallelism vs. data parallelism #338
- Pre req to SDG implementation

Second Phase:

Add support for preference tuning pipelines sdg#376

Third Phase:
CLI:

Mustafa is currently taking point on this with Akash's team

ktam3 assigned Maxusmusti

ktam3 changed the title ~~Preference Tuning Support~~ [Epic] Preference Tuning Support

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment