Skip to content

Pull requests: triton-inference-server/server

New pull request New
64 Open 3,771 Closed
64 Open 3,771 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: gRPC segfault due to Low Request Cancellation Timeout PR: fix A bug fix
#7840 opened Nov 27, 2024 by yinggeh Loading…
7 of 11 tasks
@yinggeh
18
ORCA Format KV Cache Utilization in Inference Response Header
#7839 opened Nov 27, 2024 by BenjaminBraunDev • Draft
refactor: Refactor of L0_backend_python and the env subtest PR: ci Changes to our CI configuration files and scripts PR: refactor A code change that neither fixes a bug nor adds a feature
#7838 opened Nov 27, 2024 by nv-kmcgill53 • Draft
5 of 20 tasks
ci: Fix Windows CI Errors PR: ci Changes to our CI configuration files and scripts
#7837 opened Nov 27, 2024 by fpetrini15 Loading…
9 of 18 tasks
9
draft: Added gRPC timer for graceful shutdown of inflight requests
#7835 opened Nov 25, 2024 by mattwittwer Loading…
20 tasks
@mattwittwer
ci: Enables testing for pull requests
#7828 opened Nov 23, 2024 by pranavm-nvidia Loading…
3 of 20 tasks
test: Updates L0 Python API tests to run all test files
#7827 opened Nov 23, 2024 by pranavm-nvidia Loading…
4 of 20 tasks
fix: Default max tokens to None for OpenAI frontend.
#7819 opened Nov 20, 2024 by thealmightygrant Loading…
4 of 22 tasks
docs: Re-structure User Guides for Discoverability
#7807 opened Nov 16, 2024 by statiraju Loading…
8
feat: Adding RestrictedFeatures Support to the Python Frontend Bindings
#7775 opened Nov 8, 2024 by KrishnanPrash Loading…
@KrishnanPrash
13
docs: Add clarification for label_filename in classification docs
#7766 opened Nov 5, 2024 by trevoryao Loading…
7 of 22 tasks
Build: Fixing model generation
#7763 opened Nov 4, 2024 by pvijayakrish Loading…
3 of 20 tasks
docs: Simplify PR templates PR: docs Documentation only changes
#7753 opened Oct 29, 2024 by yinggeh Loading…
6 of 11 tasks
@yinggeh
10
[Do not merge!] Build: Remove TRT model generation for V100
#7712 opened Oct 16, 2024 by pvijayakrish • Draft
3 of 20 tasks
2
fix:Split L0_nomodel_perf into 2 test to ensure better debug-ability and resource util for PA
#7705 opened Oct 15, 2024 by indrajit96 • Draft
6 of 19 tasks
test: TC for Metric P0 nv_load_time per model
#7697 opened Oct 14, 2024 by indrajit96 Loading…
8 of 20 tasks
21
Build: Update TRT release branch referenced in model gen file
#7693 opened Oct 11, 2024 by pvijayakrish Loading…
3 of 20 tasks
2
Build: Update README and versions for 24.10
#7686 opened Oct 8, 2024 by pvijayakrish Loading…
3 of 20 tasks
1
Temporarily disable corner cases for response sender test
#7642 opened Sep 23, 2024 by Tabrizian Loading…
[DO NOT MERGE] Build: Update Readme and versions for 24.09
#7607 opened Sep 7, 2024 by pvijayakrish • Draft
3 of 20 tasks
1
Revert "Fixing StringTo uint32_t used only by tracing (#6883)" module: platforms Issues related to platforms, hardware, and support matrix
#7596 opened Sep 4, 2024 by rvroge Loading…
2 of 22 tasks
3
feat: Update openvino runtime version to 2024.3
#7585 opened Sep 2, 2024 by dtrawins Loading…
4 of 22 tasks
2
Userguide changes
#7502 opened Aug 6, 2024 by statiraju Loading…
20 tasks
2
test: Client-side input shape/element validation PR: test Adding missing tests or correcting existing test
#7427 opened Jul 9, 2024 by yinggeh • Draft
6 of 11 tasks
@yinggeh
19
feat: Option to add model signature
#7376 opened Jun 26, 2024 by JonasGoebel Loading…
8 of 22 tasks
ProTip! What’s not been updated in a month: updated:<2024-10-28.