vault81/redvault-ai
4
0
Fork 0
Code Issues 1 Pull requests 1 Projects 1 Releases Packages Wiki Activity

Update README.md

Browse source
This commit is contained in:
Tristan D. 2024-10-08 15:36:08 +00:00
parent 034895d7d4
commit 66cf52e2ce
1 changed files with 12 additions and 4 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
README.md
View file

@ -2,10 +2,18 @@
## Current Repos ## Current Repos
- llama-forge-rs #### llama-forge-rs:
old alpha-state webview based GUI app for chatting with ai, manages a llama-server in the background
- llama-proxy-man - old alpha-state webview based GUI app for chatting with ai
proxy which auto starts/stops llama.cpp instances, while retring requests and keeping the connection open so you can run more models than your VRAM can fit, with all api requests working (they'll just be slow if you have to start instances to make them happen) - basic streaming
- manages a llama-server in the background
- currently unmaintained
#### llama-proxy-man:
- proxy which auto starts/stops llama.cpp instances for you
- retries requests in the background and keeps the connection open
- enables you to run more models than your VRAM can fit, with HTTP-API requests working like they do (they'll just be slow if you have to start instances to make them happen)
## Ideas ## Ideas