vault81/redvault-ai
4
0
Fork 0
Code Issues 1 Pull requests 1 Projects 1 Releases Packages Wiki Activity

New Native GUI Chat App ideation #1

New issue
Open
opened 2024-08-28 13:57:35 +00:00 by tristan · 0 comments
tristan commented 2024-08-28 13:57:35 +00:00
Owner
Copy link

Stack:

  • iced instead of webview foo ?
  • sqlite or ideally libsql
  • tokio
  • rust

Headline mvp features

  • NeatTM Chat

    • iced_widget::markdown 😄

  • Model management

    • quantize existing models to gguf
    • model dir config
    • index huggingface by

  • Native

    • minimize to tray
    • bring up simple chat widget via hotkey
    • clipboard integration

  • Backend Flexibility

    • automatically managed llama.cpp servers (binary in PATH for now)
      • async std/stdout IO with tokio support for this weird caching/prediction with a small model speedup strategy
      • start on demand, provide multi model api
    • any openai compatible chat api (unmanaged)
    • clustering ? and declaring resources?, incl. weird edge devices?, like browsers and embed pi/phones ???

Future Ideas

  • TTS & Speech Synth
  • RAG
  • Agents
  • ImageGen (TODO research non-python sd backends)
### Stack: - iced instead of webview foo ? - sqlite or ideally libsql - tokio - rust ### Headline mvp features - Neat<sup>TM</sup> Chat - `iced_widget::markdown` 😄 - Model management - quantize existing models to gguf - model dir config - index huggingface by - Native - minimize to tray - bring up simple chat widget via hotkey - clipboard integration - Backend Flexibility - automatically managed llama.cpp servers (binary in PATH for now) - async std/stdout IO with tokio support for this weird caching/prediction with a small model speedup strategy - start on demand, provide multi model api - any openai compatible chat api (unmanaged) - clustering ? and declaring resources?, incl. weird edge devices?, like browsers and embed pi/phones ??? ### Future Ideas - TTS & Speech Synth - RAG - Agents - ImageGen (TODO research non-python sd backends)
tristan added this to the Planning project 2024-08-28 13:57:35 +00:00
tristan changed title from Native App Planning to New Native GUI Chat App ideation 2024-10-08 15:39:26 +00:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
renovate/configure
No results found.
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Planning
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: vault81/redvault-ai#1
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?