Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

173 Open 1,615 Closed
173 Open 1,615 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

推理模型reasoning_content字段信息处理问题
#3055 opened Mar 13, 2025 by zjxxsr
1 of 3 tasks
v1.x
1
can't use '--limit-mm-per-prompt' parameters gpu
#3054 opened Mar 13, 2025 by liuxingbo12138
1 of 3 tasks
v1.x
1
困扰了很久，拉取模型后每次重进xinference模型便找不见的问题
#3052 opened Mar 12, 2025 by bluefootp v1.x
SGLang跑QWEN2.5-32B-GPTQ-int4出现第一个token丢失问题 gpu
#3051 opened Mar 12, 2025 by luckyhfzd
1 of 3 tasks
v1.x
docker部署vllm启动单机四卡T4无论问什么都只回答感叹号 gpu
#3049 opened Mar 12, 2025 by jiasu-hezhip
1 of 3 tasks
v1.x
1
continuous_batching run flux1x-schnell failed gpu
#3048 opened Mar 12, 2025 by chenslcool
1 of 3 tasks
v1.x
1
Qwen2.5-Vl-Instruct没有vllm模型启动项，transformers启动没有正确使用到gpu gpu
#3047 opened Mar 12, 2025 by Shy280
1 of 3 tasks
v1.x
1
chatTTS接入dify1.0.0版本后提示错误
#3046 opened Mar 12, 2025 by baobeiyatou
1 of 3 tasks
v1.x
2
SenseVoiceSmall，timestamp_granularities似乎不能用？如何获得时间戳？ gpu
#3045 opened Mar 11, 2025 by zitao233
1 of 3 tasks
v1.x
1
使用V1.3.0镜像，启动SD3.5medium,报错expected mat1 and mat2 to have the same dtype, but got: c10::Half != c10::BFloat16 gpu
#3042 opened Mar 11, 2025 by tong1311 v1.x
2
准备使用vllm部署另一个语言模型，报错误 gpu
#3041 opened Mar 11, 2025 by yanglaiyi
1 of 3 tasks
v1.x
1
注册一个新的模型的时候，总是会报 raise asyncio.TimeoutError gpu
#3040 opened Mar 11, 2025 by Liguoz
1 of 3 tasks
v1.x
1
xoscar.errors.ServerClosed: [address=0.0.0.0:25940, pid=142] Remote server unixsocket:///297795584 closed: 0 bytes read on a total of 11 expected bytes gpu
#3039 opened Mar 11, 2025 by wu-xiaochen
1 of 3 tasks
v1.x
1
Vllm多机多卡部署支持 feature
#3038 opened Mar 11, 2025 by rexjm v1.x
默认开启鉴权 feature
#3037 opened Mar 11, 2025 by huixiangyang v1.x
4
QwQ_32B没有think标签
#3036 opened Mar 11, 2025 by pyaaaa
3 tasks
v1.x
4
supervisor、worker不在一个节点，cached不生效
#3035 opened Mar 11, 2025 by sunmiao1991
3 tasks
v1.x
xinterface部署了Kokoro-82M，如何在tts中识别中文 gpu
#3034 opened Mar 11, 2025 by m199369309
1 of 3 tasks
v1.x
@codingl2k1
2
win10 run xinference-local error
#3033 opened Mar 10, 2025 by kfchandsome
1 of 3 tasks
v1.x
新增支持代理配置 feature
#3032 opened Mar 10, 2025 by Liguoz v1.x
部署DeepSeek-R1-Distill-Llama-70B，无标签头<think> feature
#3029 opened Mar 10, 2025 by micohuang v1.x
3
无论是否开启Parsing Reasoning Content，模型的思考过程都以逗号开头
#3026 opened Mar 10, 2025 by frankSARU v1.x
7
qwen2-vl 和qwen2.5-vl都没有vllm引擎选项
#3025 opened Mar 10, 2025 by pyaaaa
3 tasks
v1.x
model auto load when requested via api feature
#3022 opened Mar 9, 2025 by mamema v1.x
1
自定义模型无法删除 gpu
#3021 opened Mar 9, 2025 by zjxxsr
1 of 3 tasks
v1.x
1
ProTip! no:milestone will show everything without a milestone.