myhloli
|
39e7aa52a2
fix: improve device type and backend handling in lmdeploy configuration
|
2 weeks ago |
myhloli
|
6bafca0555
fix: disable tokenizers parallelism in lmdeploy server configuration
|
2 weeks ago |
myhloli
|
7516d3ddf4
fix: disable tokenizers parallelism in lmdeploy server configuration
|
2 weeks ago |
myhloli
|
a2136c22a5
fix: add backend argument handling and logging for lmdeploy backend configuration
|
2 weeks ago |
myhloli
|
3fcca35c73
fix: add Linux environment detection and set lmdeploy backend based on device type
|
2 weeks ago |
myhloli
|
672e252506
fix: set default device type to 'cuda' in lmdeploy server
|
2 weeks ago |
myhloli
|
85558061ff
feat: add lmdeploy backend support and refactor related components
|
2 weeks ago |