Comments (4)
Is there maybe a way of downloading the model manually?
from serge.
When I run 'docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 30B'
I get
"C:\Users\Dwel>docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 30B
no configuration file provided: not found"
Or
"C:\Users\Dwel\serge>docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 30B
service "api" is not running container #1"
I do not know what I am doing, although, I try.
from serge.
When I run 'docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 30B'
I get "C:\Users\Dwel>docker compose exec api python3 /usr/src/app/utils/download.py tokenizer 7B no configuration file provided: not found"
I think your version is quite out of date, there's no download.py file anymore. Feel free to pull the latest changes and check the readme. Should be a lot easier to get models now.
from serge.
Your response was quicker than my edit. Everything was installed fresh today.
Docker is v4.17.1
Python is 3.11.2
from serge.
Related Issues (20)
- Cant edit the front end HOT 1
- Feature Request: LLamahub Integration for Serge-Chat Web Interface HOT 1
- Installing Surge on Windows 11, Step issues?
- Responses to API questions place the full API output in chat HOT 1
- add llama 2 support
- Not working HOT 5
- Feature: Add user accounts to support multiple users on a single node. HOT 2
- Where is the LLM stored HOT 1
- IPv6 Support HOT 2
- [Feature Request] Support InternLM HOT 1
- 'docker compose -f docker-compose.dev.yml up -d --build' does not work HOT 2
- Issues loading Facebook-LLaMA2-70B HOT 8
- 🚀 [Feature]: Implement a Spinner for Background Process Feedback HOT 1
- 🐛 [Bug]: Minotaur-15B model stuck at download and does not run HOT 4
- No models running at all HOT 1
- 🚀 [Feature]: add vigogne and Marx-3B models HOT 4
- 🐛 [Bug]: Seems like support for CPU-only is gone with the new version of serge? HOT 5
- 🐛 [Bug]: Chat responses show up in all chats during response time HOT 2
- 🚀 [Feature]: Ability to rename chats HOT 1
- 🚀 [Feature]: Ability to stop response in progress
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from serge.