Comments (7)
I'm currently working on fine-tuning my own models (codellama-7b with a simple qlora fine-tune performs surprisingly well) and writing an OpenAI-compatible server that'd support function calling; I'll give you an update whenever it's usable (which will hopefully be by the end of the week). Right now as far as I'm aware the only project that does this is called functionary, and it has its own caveats (not that mine won't have similar ones).
from local-llm-function-calling.
thats awesome , i am waiting excitingly for it. I need something which can handle tons of functions and call them accordingly.
btw look here: https://huggingface.co/PathOr/PathOr_LLama_70B_CHAT
from local-llm-function-calling.
Any updates here?
from local-llm-function-calling.
any update ?
from local-llm-function-calling.
any update?
from local-llm-function-calling.
any update ?
from local-llm-function-calling.
Thanks, everyone. This project should work with most open-source models that support function calls. I just implemented a prompter for my fine-tuning of codellama, and to integrate your chosen model, you just have to implement a prompter, I am, however, getting started on writing prompters for other models. I don't have access to PathOr specifically yet. What models would you like to see integrated?
from local-llm-function-calling.
Related Issues (14)
- About the parameter extraction? HOT 3
- Problems when trying to use Llama-2 models for function calling HOT 2
- Using CUDA for inference
- Function Calling with LM Studio Server Model HOT 2
- How does this project be compatible with BPE tokenizers? HOT 1
- Lm studio support?
- ERROR: No matching distribution found for local-llm-function-calling HOT 1
- is it possible for us to connect over mail? HOT 1
- Could not install via pip HOT 2
- Docs example doesn't seem correct HOT 2
- Error at installing HOT 1
- Benchmark data HOT 1
- Function calling Issue HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from local-llm-function-calling.