File tree
16 files changed
+49
-91
lines changed- docs/source/features
- examples/online_serving
- tests/entrypoints/openai
- vllm
- engine
- entrypoints/openai
- model_executor/guided_decoding
16 files changed
+49
-91
lines changedLines changed: 5 additions & 8 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
21 | 21 |
| |
22 | 22 |
| |
23 | 23 |
| |
24 |
| - | |
| 24 | + | |
25 | 25 |
| |
26 | 26 |
| |
27 |
| - | |
28 |
| - | |
| 27 | + | |
29 | 28 |
| |
30 | 29 |
| |
31 | 30 |
| |
| |||
140 | 139 |
| |
141 | 140 |
| |
142 | 141 |
| |
143 |
| - | |
144 |
| - | |
| 142 | + | |
145 | 143 |
| |
146 | 144 |
| |
147 | 145 |
| |
| |||
316 | 314 |
| |
317 | 315 |
| |
318 | 316 |
| |
319 |
| - | |
| 317 | + | |
320 | 318 |
| |
321 | 319 |
| |
322 |
| - | |
323 |
| - | |
| 320 | + | |
324 | 321 |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
9 | 9 |
| |
10 | 10 |
| |
11 | 11 |
| |
12 |
| - | |
| 12 | + | |
13 | 13 |
| |
14 | 14 |
| |
15 | 15 |
| |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
9 | 9 |
| |
10 | 10 |
| |
11 | 11 |
| |
12 |
| - | |
| 12 | + | |
13 | 13 |
| |
14 | 14 |
| |
15 | 15 |
| |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
8 | 8 |
| |
9 | 9 |
| |
10 | 10 |
| |
11 |
| - | |
| 11 | + | |
12 | 12 |
| |
13 | 13 |
| |
14 | 14 |
| |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
8 | 8 |
| |
9 | 9 |
| |
10 | 10 |
| |
11 |
| - | |
| 11 | + | |
12 | 12 |
| |
13 | 13 |
| |
14 | 14 |
| |
|
Lines changed: 3 additions & 3 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
13 | 13 |
| |
14 | 14 |
| |
15 | 15 |
| |
16 |
| - | |
17 |
| - | |
18 |
| - | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
19 | 19 |
| |
20 | 20 |
| |
21 | 21 |
| |
|
Lines changed: 3 additions & 11 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
122 | 122 |
| |
123 | 123 |
| |
124 | 124 |
| |
125 |
| - | |
| 125 | + | |
| 126 | + | |
126 | 127 |
| |
127 | 128 |
| |
128 | 129 |
| |
129 | 130 |
| |
130 | 131 |
| |
131 |
| - | |
| 132 | + | |
132 | 133 |
| |
133 | 134 |
| |
134 | 135 |
| |
135 |
| - | |
136 | 136 |
| |
137 | 137 |
| |
138 | 138 |
| |
139 | 139 |
| |
140 | 140 |
| |
141 | 141 |
| |
142 |
| - | |
143 |
| - | |
144 |
| - | |
145 |
| - | |
146 |
| - | |
147 |
| - | |
148 |
| - | |
149 |
| - | |
150 | 142 |
| |
151 | 143 |
| |
152 | 144 |
| |
|
Lines changed: 2 additions & 3 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
3225 | 3225 |
| |
3226 | 3226 |
| |
3227 | 3227 |
| |
3228 |
| - | |
| 3228 | + | |
3229 | 3229 |
| |
3230 |
| - | |
3231 |
| - | |
| 3230 | + | |
3232 | 3231 |
| |
3233 | 3232 |
| |
3234 | 3233 |
| |
|
Lines changed: 12 additions & 5 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
365 | 365 |
| |
366 | 366 |
| |
367 | 367 |
| |
368 |
| - | |
369 |
| - | |
| 368 | + | |
| 369 | + | |
| 370 | + | |
370 | 371 |
| |
371 | 372 |
| |
372 | 373 |
| |
| |||
798 | 799 |
| |
799 | 800 |
| |
800 | 801 |
| |
801 |
| - | |
802 |
| - | |
| 802 | + | |
| 803 | + | |
| 804 | + | |
| 805 | + | |
| 806 | + | |
| 807 | + | |
| 808 | + | |
| 809 | + | |
| 810 | + | |
803 | 811 |
| |
804 | 812 |
| |
805 | 813 |
| |
| |||
1088 | 1096 |
| |
1089 | 1097 |
| |
1090 | 1098 |
| |
1091 |
| - | |
1092 | 1099 |
| |
1093 | 1100 |
| |
1094 | 1101 |
| |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
2096 | 2096 |
| |
2097 | 2097 |
| |
2098 | 2098 |
| |
2099 |
| - | |
| 2099 | + | |
2100 | 2100 |
| |
2101 | 2101 |
| |
2102 | 2102 |
| |
|
Lines changed: 1 addition & 2 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
967 | 967 |
| |
968 | 968 |
| |
969 | 969 |
| |
970 |
| - | |
971 | 970 |
| |
972 | 971 |
| |
973 | 972 |
| |
| |||
1053 | 1052 |
| |
1054 | 1053 |
| |
1055 | 1054 |
| |
1056 |
| - | |
| 1055 | + | |
1057 | 1056 |
| |
1058 | 1057 |
| |
1059 | 1058 |
| |
|
Lines changed: 0 additions & 5 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
284 | 284 |
| |
285 | 285 |
| |
286 | 286 |
| |
287 |
| - | |
288 |
| - | |
289 |
| - | |
290 |
| - | |
291 |
| - | |
292 | 287 |
| |
293 | 288 |
| |
294 | 289 |
| |
|
Lines changed: 14 additions & 45 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
58 | 58 |
| |
59 | 59 |
| |
60 | 60 |
| |
61 |
| - | |
62 |
| - | |
| 61 | + | |
63 | 62 |
| |
64 | 63 |
| |
65 | 64 |
| |
| |||
82 | 81 |
| |
83 | 82 |
| |
84 | 83 |
| |
85 |
| - | |
86 | 84 |
| |
87 | 85 |
| |
88 |
| - | |
| 86 | + | |
89 | 87 |
| |
90 | 88 |
| |
91 | 89 |
| |
92 | 90 |
| |
| 91 | + | |
93 | 92 |
| |
94 |
| - | |
95 |
| - | |
96 |
| - | |
| 93 | + | |
| 94 | + | |
97 | 95 |
| |
98 | 96 |
| |
99 | 97 |
| |
| |||
423 | 421 |
| |
424 | 422 |
| |
425 | 423 |
| |
426 |
| - | |
427 |
| - | |
428 |
| - | |
429 | 424 |
| |
430 | 425 |
| |
431 | 426 |
| |
432 | 427 |
| |
433 | 428 |
| |
434 |
| - | |
| 429 | + | |
435 | 430 |
| |
436 | 431 |
| |
437 | 432 |
| |
| |||
446 | 441 |
| |
447 | 442 |
| |
448 | 443 |
| |
449 |
| - | |
450 |
| - | |
451 |
| - | |
452 |
| - | |
453 |
| - | |
454 |
| - | |
| 444 | + | |
455 | 445 |
| |
456 | 446 |
| |
457 | 447 |
| |
458 | 448 |
| |
459 | 449 |
| |
460 | 450 |
| |
461 | 451 |
| |
462 |
| - | |
463 | 452 |
| |
464 | 453 |
| |
465 | 454 |
| |
| |||
592 | 581 |
| |
593 | 582 |
| |
594 | 583 |
| |
595 |
| - | |
| 584 | + | |
596 | 585 |
| |
597 | 586 |
| |
598 | 587 |
| |
| |||
603 | 592 |
| |
604 | 593 |
| |
605 | 594 |
| |
606 |
| - | |
| 595 | + | |
607 | 596 |
| |
608 | 597 |
| |
609 | 598 |
| |
| |||
630 | 619 |
| |
631 | 620 |
| |
632 | 621 |
| |
633 |
| - | |
| 622 | + | |
634 | 623 |
| |
635 | 624 |
| |
636 | 625 |
| |
| |||
660 | 649 |
| |
661 | 650 |
| |
662 | 651 |
| |
663 |
| - | |
| 652 | + | |
664 | 653 |
| |
665 | 654 |
| |
666 | 655 |
| |
| |||
728 | 717 |
| |
729 | 718 |
| |
730 | 719 |
| |
731 |
| - | |
732 |
| - | |
| 720 | + | |
733 | 721 |
| |
734 | 722 |
| |
735 | 723 |
| |
| |||
744 | 732 |
| |
745 | 733 |
| |
746 | 734 |
| |
747 |
| - | |
| 735 | + | |
748 | 736 |
| |
749 | 737 |
| |
750 | 738 |
| |
| |||
931 | 919 |
| |
932 | 920 |
| |
933 | 921 |
| |
934 |
| - | |
935 |
| - | |
936 |
| - | |
937 |
| - | |
938 |
| - | |
939 |
| - | |
940 |
| - | |
941 | 922 |
| |
942 | 923 |
| |
943 |
| - | |
944 |
| - | |
| 924 | + | |
945 | 925 |
| |
946 | 926 |
| |
947 | 927 |
| |
| |||
1176 | 1156 |
| |
1177 | 1157 |
| |
1178 | 1158 |
| |
1179 |
| - | |
1180 |
| - | |
1181 |
| - | |
1182 |
| - | |
1183 |
| - | |
1184 |
| - | |
1185 |
| - | |
1186 |
| - | |
1187 |
| - | |
1188 |
| - | |
1189 |
| - | |
1190 | 1159 |
| |
1191 | 1160 |
| |
1192 | 1161 |
| |
|
Lines changed: 2 additions & 2 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
103 | 103 |
| |
104 | 104 |
| |
105 | 105 |
| |
106 |
| - | |
| 106 | + | |
107 | 107 |
| |
108 | 108 |
| |
109 | 109 |
| |
| |||
146 | 146 |
| |
147 | 147 |
| |
148 | 148 |
| |
149 |
| - | |
| 149 | + | |
150 | 150 |
| |
151 | 151 |
| |
152 | 152 |
| |
|
Lines changed: 1 addition & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
61 | 61 |
| |
62 | 62 |
| |
63 | 63 |
| |
64 |
| - | |
| 64 | + | |
65 | 65 |
| |
66 | 66 |
| |
67 | 67 |
| |
|
0 commit comments