You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Problem
TensorRT-LLM is one of the biggest features in jan. As the docker environments usually include all kind of stuff to run the software with it's full set of features, why not include it too?
Success Criteria
A container that supports TensorRT-LLM backend out-of-the-box.
The text was updated successfully, but these errors were encountered:
Problem
TensorRT-LLM is one of the biggest features in jan. As the docker environments usually include all kind of stuff to run the software with it's full set of features, why not include it too?
Success Criteria
A container that supports TensorRT-LLM backend out-of-the-box.
The text was updated successfully, but these errors were encountered: