dfdafd036d
docs: update huggingface_token config example
4 months ago
4535fb182d
docs: update sso cli flags
4 months ago
6168713804
fix(ray): conflict in random runtime env agent port
...
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
13f96d7e6f
docs: corrections and additions
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
1703ed9af4
docs: update architecture diagrams and cli options
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
eec744793b
docs: update installation and faq docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
5 months ago
6208c7c3a5
refactor(vllm/ray): parameterize all ports as we can
...
- add --ray-dashboard-port, default to 8265
- add --ray-dashboard-agent-grpc-port, default to 40101
- add --ray-dashboard-agent-listen-port, default to 52365
- add --ray-metrics-export-port, default to 40103
- adjust --ray-worker-port-range, default to 40200-40999
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
0749e40d1b
fix(vllm/ascend/ray): failed on picking several nodes from the whole group 2
...
- correct sitecustomize location
- narrow worker range port to 40100-40999
- correct ray request unit resource key
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
12a4a4ef9f
refactor(ray): extend ray worker port range
...
Signed-off-by: thxCode <thxcode0824@gmail.com>
5 months ago
554f5c0180
chore: update start.md
...
Describe the environment variable `GPUSTACK_DISABLE_DYNAMIC_LINK_LLAMA_BOX`.
5 months ago
eef0700bdc
docs: update screenshots, add desktop installer
5 months ago
890f15faed
fix:rpc-server-args recognization
...
allow input `-k=v` and `-k v` pairs
6 months ago
68a3915e4e
fix: allow override --rpc-server-cache-dir
6 months ago
555d0c81ba
docs: update description for start flags
7 months ago
a83cdaf255
docs: update docs and fix incorrect content
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
8 months ago
b1a9070e28
feat: support MySQL as external database
8 months ago
53d2645a29
feat: add `--disable-openapi-docs` flag to disable Swagger, ReDoc, and /openapi.json
8 months ago
82ed35c595
refactor: docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
9 months ago
edfbd61c6f
feat: Add an option to use hf_transfer for HF Hub downloads
...
fix: update comment
fix: update start.md
9 months ago
06c5d5c4b3
fix: modify the default configuration of allow_methods and allow_headers
...
fix: update cors config
9 months ago
8db63e5e0a
fix: Allow users to customize CORS-related parameters.
...
fix: support user control over the CORS switch
fix: Remove the value, use hyphens
9 months ago
4189283f4b
docs: update port requirements
10 months ago
dde432343d
docs: vLLM with Ray
10 months ago
e23d53769a
docs: update installation docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
10 months ago
de62729b99
feat: support configuring rpc-server arguments
10 months ago
4af55016f8
docs: worker name flag in cli reference
11 months ago
a22db746f2
fix: reserved 1GiB vram by default
11 months ago
deff985ab0
feat: add model catalog
12 months ago
85db5d8a20
feat: support custom hf endpoint
1 year ago
e4a7bf3b54
feat: configurable rpc-servers
1 year ago
d8c7d1482f
feat: support pgsql
1 year ago
631b8db02a
feat: support configuring cache-dir
1 year ago
81cf0695b4
feat: configurable tools_download_base_url
1 year ago
cdc59d3bf5
docs: update cli options
1 year ago
000ca67347
feat: support deploy huggingface model require token
1 year ago
29f98ba69d
fix: reserve no vram by default
1 year ago
b7609b9f5d
docs: update memory and gpu memory to ram and vram
1 year ago
6b312f31a5
refactor: update start argument parsing
...
1. move all defaults to config init so that we can have option priority CLI_ARGS > CONFIG_FILE
2. update enable-metrics to disable-metrics. There's no way to disable formerly.
1 year ago
0c2cae74c4
docs: instruction and example for custom ollama url
1 year ago
119a4c92e4
fix: update docs
1 year ago
be391a2da1
fix: windows install flag error
1 year ago
a64d1eb95e
refactor: update windows params docs
1 year ago
8772cd8a83
docs: clarify Powershell ISE and worker port option
1 year ago
7d9e6a9121
docs: suppress db url flag
1 year ago
3fca419df7
docs: add config file example
1 year ago
1dcd94bbb9
docs: update skeleton
1 year ago
gitlawr
thxCode
linyinli
cyx
jialin
xiaoping378
kekao
Jiangzhou Li
michelia