vault81/redvault-ai
4
0
Fork 0
Code Issues 1 Pull requests 1 Projects 1 Releases Packages Wiki Activity

Update main README.md

Browse source
This commit is contained in:
Tristan D. 2024-10-08 17:33:43 +02:00
parent 39305f92ad
commit 034895d7d4
Signed by: tristan
SSH key fingerprint: SHA256:3RU4RLOoM8oAjFU19f1W6t8uouZbA7GWkaSW6rjp1k8
1 changed files with 10 additions and 6 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

16
README.md
View file

@ -1,11 +1,15 @@
# Redvau.lt AI Monorepo
## TODOS
## Current Repos
- nix
- readd new llama.cpp with automated patches
- add build override for rocmTarget etc
- llama-forge-rs
old alpha-state webview based GUI app for chatting with ai, manages a llama-server in the background
- llama-proxy-man
proxy which auto starts/stops llama.cpp instances, while retring requests and keeping the connection open so you can run more models than your VRAM can fit, with all api requests working (they'll just be slow if you have to start instances to make them happen)
## Ideas
- emacs-qwen-plugin
- use emacs-module-rs + llama.cpp/proxy to get awesome qwen integration into emacs
- agent
- add experimental rag+agent framework