whisper.cpp / ggml-rpc.cpp

Commit History

rpc : fix ggml_backend_rpc_supports_buft() (llama/7918)
56e6751

rgerganov commited on

move BLAS to a separate backend (llama/6210)
c773aa9

slaren ggerganov commited on

llama : offload to RPC in addition to other backends (llama/7640)
eab8082

rgerganov slaren commited on

rpc : resource management rework (llama/7562)
7571b13

rgerganov commited on

rpc : track allocated buffers (llama/7411)
925eb7a

rgerganov commited on

rpc : set SO_REUSEADDR for the server socket (llama/7320)
195fe29

rgerganov commited on

rpc : add command line arg for specifying backend memory
b441739

rgerganov commited on

ggml : add RPC backend (llama/6829)
5838a14
unverified

rgerganov commited on