Does Tensorrt-llm or its dependencies require licence for hosting and deploying an open-source llm for commercial purposes #4377
Unanswered
plsomasundaram93
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi Everyone,
I noticed that tensorrt-llm is licensed under Apache 2.0. However, when installing it via pip, it pulls in tensorrt as a dependency, which appears to be licensed under an "other/proprietary" license. There are also several other NVIDIA dependencies with similar "other/proprietary" license designations.
If I install tensorrt-llm on a system with an NVIDIA A10 GPU and use it to serve LLaMA for commercial gains, would I require a license?
Additionally, is there a link or documentation available that explains the terms of the "other/proprietary" license?
I would appreciate any clarification you can provide.
Beta Was this translation helpful? Give feedback.
All reactions