Comments (4)
yeah, it would be good to show more clarity on whether user is waiting for model to load or waiting in an actual queue
from helix.
visual indicator to the user that the system is currently processing and that they are in a waiting state
from helix.
Why is this closed? I don't see any corresponding PR? This issue is about showing the place in the queue like 3/17 or that you're at the front of the queue and waiting for model weights to load etc
from helix.
issue of showing the user's place in the queue addressed
from helix.
Related Issues (20)
- ollama modelinstance can permafail with "connection refused"
- cloning session file exists error
- sentry slack not working
- wait for weights to download before pulling jobs
- Sessions/Chat API no longer returns results HOT 1
- Have a way to not load mistral and sdxl HOT 2
- Get rid of The start of something beautiful
- Get rid of the `Add Url, Add Text Or Choose Files Buttons on localhost/?mode=finetune&type=text
- View or edit files and Continue Button
- Get rid of the Or Choose files button
- View or Edit Images and Continue Button
- Docs - Requests & Amends List HOT 2
- Ensure all models have temperature and top_k control
- if a job can't schedule, fail immediately
- don't log scary messages into api logs about warmup sessions
- get llama:70b working on multi-gpu node
- Propagate all errors back to user
- The Existential Crisis of Tools and Apps: Consolidate apps and tools in the Code, the UI and the Docs HOT 1
- [UI] Chopping off content when streaming text responses
- [llama] Sessions constantly report being busy despite not being busy (and slow time to first token times) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from helix.