edfbd61c6f
feat: Add an option to use hf_transfer for HF Hub downloads
...
fix: update comment
fix: update start.md
11 months ago
06c5d5c4b3
fix: modify the default configuration of allow_methods and allow_headers
...
fix: update cors config
11 months ago
8db63e5e0a
fix: Allow users to customize CORS-related parameters.
...
fix: support user control over the CORS switch
fix: Remove the value, use hyphens
11 months ago
4189283f4b
docs: update port requirements
11 months ago
dde432343d
docs: vLLM with Ray
11 months ago
e23d53769a
docs: update installation docs
...
Signed-off-by: linyinli <yinlin@gpustack.ai>
11 months ago
de62729b99
feat: support configuring rpc-server arguments
12 months ago
4af55016f8
docs: worker name flag in cli reference
1 year ago
a22db746f2
fix: reserved 1GiB vram by default
1 year ago
deff985ab0
feat: add model catalog
1 year ago
a0249f80e6
fix: no warmup for cli generated model
1 year ago
52b7fc57de
docs: update draw cmd and quickstart
1 year ago
85db5d8a20
feat: support custom hf endpoint
1 year ago
e4a7bf3b54
feat: configurable rpc-servers
1 year ago
800f3cc294
chore: make cpu device clear
1 year ago
d6f7f05c66
feat: airgap instruction
1 year ago
d8c7d1482f
feat: support pgsql
1 year ago
631b8db02a
feat: support configuring cache-dir
1 year ago
81cf0695b4
feat: configurable tools_download_base_url
1 year ago
cdc59d3bf5
docs: update cli options
1 year ago
000ca67347
feat: support deploy huggingface model require token
1 year ago
29f98ba69d
fix: reserve no vram by default
1 year ago
b7609b9f5d
docs: update memory and gpu memory to ram and vram
1 year ago
6b312f31a5
refactor: update start argument parsing
...
1. move all defaults to config init so that we can have option priority CLI_ARGS > CONFIG_FILE
2. update enable-metrics to disable-metrics. There's no way to disable formerly.
1 year ago
0c2cae74c4
docs: instruction and example for custom ollama url
2 years ago
119a4c92e4
fix: update docs
2 years ago
be391a2da1
fix: windows install flag error
2 years ago
a64d1eb95e
refactor: update windows params docs
2 years ago
8772cd8a83
docs: clarify Powershell ISE and worker port option
2 years ago
91936959f6
fix: clarify chat external server and better validations
2 years ago
7d9e6a9121
docs: suppress db url flag
2 years ago
3fca419df7
docs: add config file example
2 years ago
1dcd94bbb9
docs: update skeleton
2 years ago
Jiangzhou Li
gitlawr
linyinli
michelia