From 034895d7d430ff3f8b8a9739abe0f4301505ce80 Mon Sep 17 00:00:00 2001 From: Tristan Druyen Date: Tue, 8 Oct 2024 17:33:43 +0200 Subject: [PATCH] Update main README.md --- README.md | 16 ++++++++++------ 1 file changed, 10 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index 933f0b4..de972ce 100644 --- a/README.md +++ b/README.md @@ -1,11 +1,15 @@ # Redvau.lt AI Monorepo -## TODOS +## Current Repos -- nix - - readd new llama.cpp with automated patches - - add build override for rocmTarget etc +- llama-forge-rs + old alpha-state webview based GUI app for chatting with ai, manages a llama-server in the background +- llama-proxy-man + proxy which auto starts/stops llama.cpp instances, while retring requests and keeping the connection open so you can run more models than your VRAM can fit, with all api requests working (they'll just be slow if you have to start instances to make them happen) + +## Ideas + +- emacs-qwen-plugin + - use emacs-module-rs + llama.cpp/proxy to get awesome qwen integration into emacs - agent - add experimental rag+agent framework - -