thxCode
359dc3c6e2
chore(docker): collect dockerfile together
...
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
thxCode
6168713804
fix(ray): conflict in random runtime env agent port
...
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
linyinli
13f96d7e6f
docs: corrections and additions
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
linyinli
eec744793b
docs: update installation and faq docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
linyinli
bf33757623
docs: update installer url
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
thxCode
6208c7c3a5
refactor(vllm/ray): parameterize all ports as we can
...
- add --ray-dashboard-port, default to 8265
- add --ray-dashboard-agent-grpc-port, default to 40101
- add --ray-dashboard-agent-listen-port, default to 52365
- add --ray-metrics-export-port, default to 40103
- adjust --ray-worker-port-range, default to 40200-40999
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
gitlawr
733f2c1482
docs: use deployments page
5 months ago
gitlawr
a888661621
docs: update script installation deprecation
5 months ago
gitlawr
65591e10ea
docs: desktop installation rephrasing
5 months ago
thxCode
0749e40d1b
fix(vllm/ascend/ray): failed on picking several nodes from the whole group 2
...
- correct sitecustomize location
- narrow worker range port to 40100-40999
- correct ray request unit resource key
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
thxCode
12a4a4ef9f
refactor(ray): extend ray worker port range
...
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
Yuxing Deng
fc4aa6b6c2
docs: add installer docs
5 months ago
jialin
f8cc92ab0b
docs: update quickstart and upgrade docs
5 months ago
jialin
e254d7bfd8
Revert "docs: update quick start"
...
This reverts commit 10c2ae6fbc .
6 months ago
jialin
b0c85bb603
Revert "docs(upgrade): update upgrade steps for deprecated installation script"
...
This reverts commit 5ffdefdbae .
6 months ago
jialin
5ffdefdbae
docs(upgrade): update upgrade steps for deprecated installation script
6 months ago
jialin
10c2ae6fbc
docs: update quick start
6 months ago
jialin
eef0700bdc
docs: update screenshots, add desktop installer
6 months ago
linyinli
0b90cf50c0
docs: fix typos and minor corrections
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
6 months ago
hello-daydayup
64a7d18cf8
add Cambricon MLU
6 months ago
gitlawr
ec9e646105
docs: remove invalid link
7 months ago
linyinli
0e34f487a7
feat: support vllm ascend
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
7 months ago
peiyuan.zhang
27ee8566cb
remove Installation Script
7 months ago
peiyuan.zhang
c060a51f76
support iluvatar
7 months ago
linyinli
6bae4a7d99
docs: remove Docker port mapping from installation
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
8 months ago
linyinli
a83cdaf255
docs: update docs and fix incorrect content
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
8 months ago
gitlawr
8eaefdc89c
docs: clarify host network for dist vllm
8 months ago
gitlawr
745a80f9e9
fix: set node/object manager port for ray head
8 months ago
linyinli
afa4445408
docs: upgrade command explanation
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
8 months ago
linyinli
1dc45ff18b
docs: add cpu check
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
9 months ago
linyinli
00951c9d9d
docs: update dcu dependencies
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
9 months ago
linyinli
5ac85e3d03
docs: add ascend 310p installation docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
9 months ago
linyinli
82ed35c595
refactor: docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
9 months ago
Jiangzhou Li
cb75979c04
fix: making VRAM configurable from UMA for macOS
...
fix: resolve CR questions
fix: resolve CR questions
fix: update sha256sum
chroe: update install md
fix: update comment
9 months ago
gitlawr
4189283f4b
docs: update port requirements
10 months ago
linyinli
0c53040da5
docs: add worker manually
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
10 months ago
linyinli
764e13ab2e
docs: add instructions for disabling systemd cgroup management
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
10 months ago
linyinli
e23d53769a
docs: update installation docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
10 months ago
michelia
0b2a611102
docs: update air gapped installation
11 months ago
linyinli
3785da3983
docs: add view password command
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
11 months ago
michelia
8b48d6daa9
feat: support hygon dcu
11 months ago
Peng Jiang
2b2cf616ef
docs: update docker installation guide
11 months ago
Peng Jiang
ba4b2a76cd
docs: update docker installation guide
...
Current server installation guide is incorrect and may cause incorrect built-in worker ip registration and issue in distributed inference.
11 months ago
Yinlin Li
b6843951c6
docs: fix command in docker installation
...
Signed-off-by: Yinlin Li <yinlin@gpustack.ai>
12 months ago
Yinlin Li
f137f5efd9
docs: update docker installation
...
Signed-off-by: Yinlin Li <yinlin@gpustack.ai>
12 months ago
pengjiang80
5096a11887
docs: update intro and other parts to improve consistency and clarity
1 year ago
michelia
fd52c4cc8b
docs: add amd gpu support
1 year ago
gitlawr
c73f01e326
docs: update port range
1 year ago
gitlawr
3e0580fb08
docs: update installation requirements
1 year ago
gitlawr
55c0db5d29
docs: update python version
1 year ago