vault81/redvault-ai
4
0
Fork 0
Code Issues 1 Pull requests 1 Projects 1 Releases Packages Wiki Activity
No description
36 commits 2 branches 0 tags 5.3 MiB
Rust 68.9%
Emacs Lisp 17.6%
Nix 5.5%
TypeScript 2.8%
SCSS 2.1%
Other 3.1%
Find a file
Tristan Druyen 604410ef61
chore: Update llama.cpp dependency to b4681 
- Update flake.lock and flake.nix to use llama.cpp rev d7b31a9d84297b493a61c9a8ee3a458e7ccc64a7
- Re-enable nixcache.vlt81.de substituter and trusted public key
2025-02-10 16:05:26 +01:00
.nix Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
llama_forge_rs Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
llama_proxy_man Fmt 2025-01-31 18:45:19 +01:00
redvault_el_rs Add mvp plans for redvault-el 2025-01-31 13:20:26 +01:00
.envrc Init 2024-07-21 02:42:48 +02:00
.gitignore Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
Cargo.lock Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
Cargo.toml Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
clippy.yml Remove unused pkg 2024-09-09 15:49:41 +02:00
flake.lock chore: Update llama.cpp dependency to b4681 2025-02-10 16:05:26 +01:00
flake.nix chore: Update llama.cpp dependency to b4681 2025-02-10 16:05:26 +01:00
package-lock.json Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
package.json Fix llama_forge_rs build & maintain a bit 2025-02-10 15:51:46 +01:00
README.md Update README.md 2024-10-08 15:36:08 +00:00
rust-toolchain.toml Update deps 2025-01-31 13:19:28 +01:00

README.md

Redvau.lt AI Monorepo

Current Repos

llama-forge-rs:

  • old alpha-state webview based GUI app for chatting with ai
  • basic streaming
  • manages a llama-server in the background
  • currently unmaintained

llama-proxy-man:

  • proxy which auto starts/stops llama.cpp instances for you
  • retries requests in the background and keeps the connection open
  • enables you to run more models than your VRAM can fit, with HTTP-API requests working like they do (they'll just be slow if you have to start instances to make them happen)

Ideas

  • emacs-qwen-plugin
    • use emacs-module-rs + llama.cpp/proxy to get awesome qwen integration into emacs
  • agent
    • add experimental rag+agent framework