Comments (2)
Also for this and #13, if we can figure out a solution approach that you're happy with (and that I'm capable of implementing), I'm happy to contribute.
from butterfish.
Heyo @bhazzard - these are good thoughts and I'm bullish on this. I've been most focused on shell dev and for personal reasons (just had a baby) I haven't had as much time lately for development, if you want to contribute these I'm all for it! Tag me on PRs.
Some specific notes:
- I haven't gone down the external vector store road myself because I haven't used it myself heavily and my understanding is that the threshold at which it makes sense to use a non-bruteforce vector search is actually sort of high (I've read like 100k vectors is where it starts to matter, which matches my intuition). BUT I totally buy that if you're already using an external vector store that it makes sense.
- In general the local vector management code is fairly primitive so don't be afraid of modifying it.
- If butterfish does ship with external vector store capabilities I would want to avoid installing shared libs by default, i.e. that install should be optional.
- The idea of allowing external querying similar to plugin access to your local machine is something I haven't thought of and a cool idea. If you want to implement I would copy how the plugin setup currently works.
- The plugin goes through a separate private repo of mine that I use to manage https://butterfi.sh. The pathway is OpenAI plugin -> butterfi.sh server -> local gRPC client. I will share you in to the private repo. If you implement this I'm happy to host it, up to you.
- Also if you contribute, I don't have a contributor agreement, I think it's fine to just comment with "I'll assign copyright to the butterfish project under the MIT License" and let's call it done 😃 .
Anyway I'll add you to the separate repo and reach out separately. HAVE AT IT!
from butterfish.
Related Issues (20)
- Feature Request: Safe Retrieval Plugin
- Error: [404:invalid_request_error] The model: `gpt-4` does not exist HOT 7
- Error: system message is required for full chat completion on summarize request HOT 3
- Feature Request: Enhanced Multiline and Clipboard Input in `butterfish prompt` HOT 13
- Feature Request:Azure OpenAI support HOT 5
- Feature Request: Shell Specific Shortcuts HOT 1
- LLM prompts get interpreted as commands with zsh/prezto HOT 3
- text-generation-webui label:question HOT 4
- Bugs with text in bash/gnome terminal HOT 5
- Question: Is this compatible with atuin HOT 4
- Feature Request: fish shell support HOT 3
- Prompt mode context HOT 1
- Feature request: offer ti runa command after `gencmd` suggestion
- Feature request: option to remove all timeouts/deadlines for slow local LLMs
- please close
- [nit] When specifying a locally hosted api endpoint, butterfish still demands an API token for OpenAI
- [Feature Request] Enable using other AI sources as a first class citizen
- [Bug] panic on interface conversion when using the verbose log option HOT 4
- using a local llm HOT 1
- How to install on Linux?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from butterfish.