 Michael Yang
|
e40145a39d
lint
|
hai 7 meses |
 Daniel Hiltgen
|
34b9db5afc
Request and model concurrency
|
hai 9 meses |
 Daniel Hiltgen
|
de2fbdec99
Merge pull request #1819 from dhiltgen/multi_variant
|
hai 1 ano |
|
Daniel Hiltgen
|
39928a42e8
Always dynamically load the llm server library
|
hai 1 ano |
 Fabian Preiß
|
3bc8b9832b
fix gpu_test.go Error (same type) uint64->uint32 (#1921)
|
hai 1 ano |
 Jeffrey Morgan
|
c336693f07
calculate overhead based number of gpu devices (#1875)
|
hai 1 ano |
|
Daniel Hiltgen
|
a2ad952440
Fix windows system memory lookup
|
hai 1 ano |
|
Daniel Hiltgen
|
d966b730ac
Switch windows build to fully dynamic
|
hai 1 ano |
|
Daniel Hiltgen
|
35934b2e05
Adapted rocm support to cgo based llama.cpp
|
hai 1 ano |
