Code

Support constrained decoding#1038

Code

Open

Taka152 wants to merge 86 commits intomainmicrosoft/onnxruntime-genai:mainfrom yingxiong/constrained_decodingmicrosoft/onnxruntime-genai:yingxiong/constrained_decodingCopy head branch name to clipboard

+718-22

Commits

Commits on Oct 31, 2024

• add llguidance based logits processor

  Taka152

  committed
  bf38535

• add unit test

  Taka152

  committed
  c151d52

Commits on Nov 1, 2024

• constrained decoding fixes (#1023)

  Show description for 9d5a8a0
  mmoskal

  authored
  9d5a8a0

• add test grammars

  Taka152

  committed
  48c3e96

• support cuda

  Taka152

  committed
  d70b849

Commits on Nov 4, 2024

• use tokenize.json to generate token_bytes

  Taka152

  committed
  6b90c1c

Commits on Nov 5, 2024

• fix win build

  Taka152

  committed
  bdb9ca4

Commits on Nov 6, 2024

• async compute mask

  Taka152

  committed
  a25de8e

• add llguidance build in cmake

  Taka152

  committed
  edc0bae

• update windows build

  Taka152

  committed
  09861d7

• clean cmake

  Taka152

  committed
  ee94df8

• add install rust to GHA

  Taka152

  committed
  4d077cf

• test action

  Taka152

  committed
  15b20b8

• test win cpu build action

  Taka152

  committed
  6029510

• update win build action

  Taka152

  committed
  4d8d8a6

• update win build action

  Taka152

  committed
  346f88c

• update win build action

  Taka152

  committed
  c00d8fa

• update win build action

  Taka152

  committed
  39fb7ed

• update win build action

  Taka152

  committed
  8038723

• update win build action

  Taka152

  committed
  324f550

• update win build action

  Taka152

  committed
  8722727

Commits on Nov 7, 2024

• add rust install to workflows

  Taka152

  committed
  d620422

• support batch infer

  Taka152

  committed
  c1ede01

Commits on Nov 8, 2024

• add corrosion to deps.txt

  Taka152

  committed
  d2f47e2

• Merge branch 'main' into yingxiong/constrained_decoding

  Taka152

  committed
  8deba60

• fix merge

  Taka152

  committed
  b256e6d

• fix bugs

  Taka152

  committed
  e5d6dad

• update linux gpu workflow

  Taka152

  committed
  2fd52d2

• update linux gpu workfow

  Taka152

  committed
  a11684b

• update linux gpu workflow

  Taka152

  committed
  56663c0

• update workflow

  Taka152

  committed
  8997064

• update workflow

  Taka152

  committed
  ddda727

• update workflows

  Taka152

  committed
  cb55778

Commits on Nov 15, 2024

• add shared lib of llguidance

  Taka152

  committed
  4cf5b5f

• add disable_guidance option

  Taka152

  committed
  18c2f6c

• fix format

  Taka152

  committed
  65340f2

• fix win error

  Taka152

  committed
  eca06f5

Commits on Nov 18, 2024

• fix segfault

  Taka152

  committed
  b306428

• fix segfault and move test

  Taka152

  committed
  df34b1e

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  2a5efe1

• minor fixes

  Taka152

  committed
  92251d4

Commits on Nov 20, 2024

• fix bug when is_stop

  Taka152

  committed
  56ab9ee

• fixes for reviews

  Taka152

  committed
  03a6bb7

• fix

  Taka152

  committed
  29fc868

• fix win error

  Taka152

  committed
  3b046c3

• add rust env to dockerfile

  Taka152

  committed
  e9c818e

• fix dockerfile env

  Taka152

  committed
  e06fb0a

• update workflows

  Taka152

  committed
  ef141f2

• Update Rust environment in Dockerfiles

  Taka152

  committed
  13056b6

• Update Rust environment permissions in Dockerfiles

  Taka152

  committed
  22c7c37

• Update Rust installation in Dockerfiles

  Taka152

  committed
  a1186a5

• revert linux arm workflow

  Taka152

  committed
  2c9b02c

Commits on Nov 22, 2024

• Update Rust installation with specific version

  Taka152

  committed
  899edf9

• fix android error

  Taka152

  committed
  2d47c20

Commits on Nov 25, 2024

• fix for review

  Taka152

  committed
  9a15385

Commits on Nov 27, 2024

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  ec09868

Commits on Dec 6, 2024

• fix SetGuidance unit test

  Taka152

  committed
  ff94fe1

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  88f8ef4

• fix format

  Taka152

  committed
  4ca4075

Commits on Dec 11, 2024

• fix to new continuous decoding api

  Taka152

  committed
  9849f65

Commits on Dec 12, 2024

• remove comments

  Taka152

  committed
  13e5100

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  aea5323

• fix

  Taka152

  committed
  9b5a6ce

• fix segfault

  Taka152

  committed
  a9390e3

Commits on Dec 13, 2024

• fix win build

  Taka152

  committed
  fc4b7e9

• fix win error

  Taka152

  committed
  a0710d5

Commits on Dec 16, 2024

• fix win error

  Taka152

  committed
  7d4d6bb

• add comments

  Taka152

  committed
  5d175a7

• fix format

  Taka152

  committed
  52ccc8b

Commits on Dec 17, 2024

• fix bug

  Taka152

  committed
  161fcfc

• Merge branch 'main' into yingxiong/constrained_decoding

  Taka152

  committed
  ca6d86c

• suuport build in ios GHA

  Taka152

  committed
  8e03735

• update win azure ci

  Taka152

  committed
  db3062b

• update linux ci

  Taka152

  committed
  0cdb4ac

• fix win ci

  Taka152

  committed
  991a012

• fix win ci

  Taka152

  committed
  4fdbea6

• fix macos arm

  Taka152

  committed
  e99ae65

• fix macos azure ci

  Taka152

  committed
  ed96504

Commits on Dec 18, 2024

• fix for review

  Taka152

  committed
  4cb9e55

• fix

  Taka152

  committed
  e75166a

• fix ios ci

  Taka152

  committed
  82d33e5

• disable on ios ci

  Taka152

  committed
  3498e0e

Commits on Dec 19, 2024

• Merge remote-tracking branch 'origin/main' into yingxiong/constrained_decoding

  Taka152

  committed
  2dbc6ee

• disable by default

  Taka152

  committed
  ce846c9

• remove azure ci code

  Taka152

  committed
  c644b26

• build and test with use_guidance

  Taka152

  committed
  422af28