New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

论文里看到Table 8 Inference Latency with Lookahead for vLLM. #30

Open

zjjznw123 opened this issue Sep 3, 2024 · 0 comments

zjjznw123 commented Sep 3, 2024

请问vLLM+lookahead这部分代码有吗？还是要改这个代码，如果需要改，怎么改呢，才能结合vllm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment