Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Falcon7b] Add perf and output verification settings to demo and add demo to CI #8581

Merged
merged 1 commit into from
May 21, 2024

Conversation

skhorasganiTT
Copy link
Contributor

For the grayskull/wh/t3000 Falcon7b (tt-lib) demos:

  • Add an option to compare generated tokens against expected tokens
  • Add an option to compare e2e perf in perf_mode against expected perf
  • Add an option (disabled by default) to save generated tokens
  • Add expected output json files
  • Update readmes with new commands

For the t3000 demo:

  • Add 8-chip perf verification and output verification to demo pipeline in CI (runtime ~7m)

FYI @uaydonat @s-jovic @djordje-tt

@skhorasganiTT
Copy link
Contributor Author

skhorasganiTT commented May 17, 2024

@skhorasganiTT skhorasganiTT merged commit ccb5e56 into main May 21, 2024
5 checks passed
@skhorasganiTT skhorasganiTT deleted the skhorasgani/falcon7b_ci_demo branch May 22, 2024 14:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants