Comments (2)
Hey @alitto thank you for your reply
We need to check the worker count using the
workerCount
counter becauseidleWorkerCount
is not as reliable. If we only check whetherp.Idle() > 0
, then it could happen that we submit a task to thetasks
channel right before this line https://github.com/alitto/pond/blob/master/pond.go#L331, whereidleWorkerCount
is decremented.
If we check runningWorkerCount>0 && p.Idle()>0
, it could also happen that we submit a task to the tasks
channel right before this line https://github.com/alitto/pond/blob/master/pond.go#L331, where idleWorkerCount
is decremented. and at that moment, the runningWorkerCount may be 1, am i right ?
This can cause the task to wait in the tasks channel forever (if no other tasks are submitted afterwards). But i do not know how to prove it.
from pond.
Hey @chengyayu! thank you 🙂
We need to check the worker count using the workerCount
counter because idleWorkerCount
is not as reliable. If we only check whether p.Idle() > 0
, then it could happen that we submit a task to the tasks
channel right before this line https://github.com/alitto/pond/blob/master/pond.go#L331, where idleWorkerCount
is decremented.
This can cause the task to wait in the tasks
channel forever (if no other tasks are submitted afterwards).
workerCount
, on the other hand, is updated in a synchronized fashion using a mutex, and that, along with checking the idle counter > 0, guarantees there is at least 1 running goroutine. This goroutine may or may not be really idle, but that's fine because we just need to make sure the task will eventually be picked up.
from pond.
Related Issues (20)
- add support go 1.17.x HOT 11
- Iterating over a slice of strings (paths to files) and applying this to it HOT 2
- Why use atomic.AddInt32() and sync.Mutex at the same time HOT 2
- Access channel concurrently HOT 3
- Exceptions may occur when closing the pool HOT 7
- does pond support serial queue? HOT 3
- Question: What happens to the pool when a worker panic HOT 3
- goroutine running on other thread; stack unavailable HOT 2
- error handling HOT 4
- Deadlock on zero minimum workers HOT 3
- Unaligned 64-bit atomic operation error when built for linux HOT 2
- pond.New(30, 100, pond.MinWorkers(30)) creates 60 goroutines not 30 HOT 2
- Crash on arm 32-bits (RPi4)
- panic: send on closed channel, when lots of goroutine are running(may be for a long time) HOT 3
- IdleWorkers RunningWorkers HOT 3
- metric problem HOT 3
- run stop panic
- support task priority
- 1 pool for 3 different tasks with the same number of workers on each task HOT 1
- Will requesting to submit an asynchronous task cause blocking? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pond.