Skip to content

Pull requests: HabanaAI/vllm-fork

New pull request New
83 Open 1,178 Closed
83 Open 1,178 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

consolidate pd/dp scripts
#1346 opened May 31, 2025 by hlin99 Loading…
by default disable contiguous_pa on Gaudi2.
#1345 opened May 30, 2025 by ccrhx4 Loading…
3
[WIP] Enable interleaved sliding_window for gemma3
#1344 opened May 30, 2025 by jiminha • Draft
[draft] merged_prefill for V1
#1342 opened May 29, 2025 by madamczyk-intel • Draft
2
[WIP][TC][FP8] Enable dynamo to create floating point data-dependent fxgraphs
#1340 opened May 29, 2025 by jczaja Loading…
Revise DeepSeek-R1 README and update start scripts
#1339 opened May 29, 2025 by taotod Loading…
[deepseek_r1] Enable StaticMoE for decoding phase of static activation quant path
#1338 opened May 29, 2025 by yangulei Loading…
1
fix requirements/hpu.txt for hpu extension
#1336 opened May 29, 2025 by ranzhejiang Loading…
Fix prefill warm up issue
#1335 opened May 29, 2025 by yeonsily • Draft
Upgrade to HPU docker 1.21.0 and update run_cluster.sh
#1331 opened May 28, 2025 by tvoas Loading…
[V1] Add new block scheduling queue to select blocks with lowest id
#1329 opened May 28, 2025 by jkaniecki Loading…
Fix vllm crash when running with lm-eval
#1321 opened May 27, 2025 by ccrhx4 Loading…
1
Add Flag to speed up Qwen3 fp8 warmup issue
#1319 opened May 27, 2025 by Yanli2190 Loading…
7
[Gaudi][Intel] Update Dockerfile.hpu for Gaudi 1.20.1
#1316 opened May 26, 2025 by vinayK34 Loading…
1
[draft] Optimize RotaryEmbedding for reuse in t.compile with dynamic shapes
#1315 opened May 26, 2025 by anko-intel Loading…
3
[Torch compile] Torch compilation on Sampler
#1314 opened May 26, 2025 by jczaja Loading…
Split gate and up projections in LLamaMLP for models with bias
#1310 opened May 23, 2025 by kdamaszk Loading…
10
Enabled MoE for both BF16 and INC based FP8.
#1309 opened May 23, 2025 by gyou2021 Loading…
4
parallel compile for fast warm up
#1304 opened May 22, 2025 by inkcherry Loading…
optimize transfer time. use mooncake put/get_unsafe.
#1297 opened May 22, 2025 by jikunshang Loading…
Qwen2.5 Omni
#1296 opened May 22, 2025 by wenbinc-Bin Loading…
[PoC][CI] Introduce test templates
#1293 opened May 21, 2025 by kzawora-intel • Draft
9
Add torch.compile tests into test_config.yaml
#1289 opened May 21, 2025 by kzawora-intel Loading…
1
[deepseek_r1] add scripts for benchmark throughput and serving
#1288 opened May 21, 2025 by yangulei Loading…
Increase the default value of VLLM_MOE_SLICE_LENGTH to 100k
#1287 opened May 21, 2025 by czhu15 Loading…
ProTip! Adding no:label will show everything without a label.