Skip to content

Actions: guidance-ai/llgtrt

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
43 workflow runs
43 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

cancel requests immediately on connection drop
Docker image #43: Commit aaddb60 pushed by mmoskal
December 2, 2024 19:31 15m 6s main
December 2, 2024 19:31 15m 6s
set health check req to high priority
Docker image #42: Commit 35f2d56 pushed by mmoskal
December 2, 2024 18:55 13m 30s main
December 2, 2024 18:55 13m 30s
fix path
Docker image #41: Commit 12c8ffc pushed by mmoskal
December 2, 2024 00:13 13m 55s main
December 2, 2024 00:13 13m 55s
update to latest llguidance
Docker image #40: Commit e6af1bb pushed by mmoskal
December 1, 2024 23:59 11m 0s main
December 1, 2024 23:59 11m 0s
rename /health/live to /health/model and have /health/live just check…
Docker image #39: Commit a4f0aec pushed by mmoskal
November 25, 2024 22:51 13m 56s main
November 25, 2024 22:51 13m 56s
update llguidance
Docker image #38: Commit 5b6d7d6 pushed by mmoskal
November 22, 2024 01:28 16m 2s main
November 22, 2024 01:28 16m 2s
allow overriding n_vocab; support phi 3/3.5
Docker image #37: Commit 521aff7 pushed by mmoskal
November 21, 2024 21:55 14m 28s main
November 21, 2024 21:55 14m 28s
log max step stats
Docker image #36: Commit e85be12 pushed by mmoskal
November 15, 2024 00:32 13m 26s main
November 15, 2024 00:32 13m 26s
Bump version to 0.14.21
Docker image #35: Commit fa6b6a9 pushed by mmoskal
November 8, 2024 22:19 20m 47s v0.14.21
November 8, 2024 22:19 20m 47s
Bump version to 0.14.21
Docker image #34: Commit fa6b6a9 pushed by mmoskal
November 8, 2024 22:19 13m 26s main
November 8, 2024 22:19 13m 26s
update llguidance
Docker image #33: Commit ea3b912 pushed by mmoskal
November 8, 2024 22:17 15m 27s main
November 8, 2024 22:17 15m 27s
fix for commit_token() not called before compute_bias()
Docker image #32: Commit 1c5038b pushed by mmoskal
November 7, 2024 23:25 14m 43s main
November 7, 2024 23:25 14m 43s
disable ': keep-alive' messages in streaming
Docker image #31: Commit 948c235 pushed by mmoskal
November 6, 2024 19:24 13m 16s main
November 6, 2024 19:24 13m 16s
AppError should return 500 (#6)
Docker image #30: Commit 2e5cec1 pushed by mmoskal
November 6, 2024 00:26 13m 21s main
November 6, 2024 00:26 13m 21s
return first streaming error as http error
Docker image #29: Commit db6ca7a pushed by mmoskal
November 5, 2024 02:11 14m 3s main
November 5, 2024 02:11 14m 3s
add /v2/health/live,ready
Docker image #28: Commit 3fa443f pushed by mmoskal
November 5, 2024 01:52 14m 2s main
November 5, 2024 01:52 14m 2s
sample req without system prompt
Docker image #27: Commit 6162249 pushed by mmoskal
November 5, 2024 01:10 14m 53s main
November 5, 2024 01:10 14m 53s
lark_grammar support
Docker image #26: Commit a92abe9 pushed by mmoskal
November 4, 2024 23:57 14m 26s main
November 4, 2024 23:57 14m 26s
don't print out 'event:error' in streaming mode
Docker image #25: Commit b3fe64d pushed by mmoskal
November 4, 2024 23:42 14m 40s main
November 4, 2024 23:42 14m 40s
tokenizer warmup req properly
Docker image #24: Commit 85d5a03 pushed by mmoskal
November 1, 2024 18:47 13m 45s main
November 1, 2024 18:47 13m 45s
Bump version to 0.14.20
Docker image #23: Commit fa42cba pushed by mmoskal
November 1, 2024 17:24 21m 48s v0.14.20
November 1, 2024 17:24 21m 48s
Bump version to 0.14.20
Docker image #22: Commit fa42cba pushed by mmoskal
November 1, 2024 17:24 14m 23s main
November 1, 2024 17:24 14m 23s
Bump version to 0.14.10
Docker image #21: Commit da432d9 pushed by mmoskal
November 1, 2024 17:22 33s v0.14.10
November 1, 2024 17:22 33s
update TensorRT-LLM to 0.14.0 (#5)
Docker image #20: Commit 6c62d42 pushed by mmoskal
November 1, 2024 16:58 14m 2s main
November 1, 2024 16:58 14m 2s
doc fixes
Docker image #19: Commit ceb95bc pushed by mmoskal
October 30, 2024 17:36 14m 11s main
October 30, 2024 17:36 14m 11s