Comments (11)
hintjens
commented on June 20, 2024
I can't reproduce this. Can you get the animation output? Thanks.
from zbroker.
rpedde
commented on June 20, 2024
exercise test looked like this:
read_pipe = zbroker.Zpipe('local|write_test')
write_pipe = zbroker.Zpipe('local2|>write_test')
read_pipe.close()
write_pipe.close()
read_pipe = zbroker.Zpipe('local|write_test')
write_pipe = zbroker.Zpipe('local2|>write_test')
read_pipe.close()
write_pipe.close()
Animation output:
14-05-02 10:17:23 I: joining cluster as 5907A26F11B11E8FD32288C1CEBD4774
14-05-02 10:17:23 N: starting zpipes_server service
14-05-02 10:17:23 N: binding zpipes service to 'ipc://@/zpipes/local'
14-05-02 10:17:23 I: ZPIPES server appeared at 2D3AD12281261F8F04045407688B9B47
14-05-02 10:17:27 366: start:
14-05-02 10:17:27 366: INPUT
14-05-02 10:17:27 366: $ lookup or create pipe
14-05-02 10:17:27 366: $ open pipe reader
14-05-02 10:17:27 366: > before reading
14-05-02 10:17:27 366: before reading:
14-05-02 10:17:27 366: ok
14-05-02 10:17:27 366: $ send INPUT_OK
14-05-02 10:17:27 366: > reading
14-05-02 10:17:27 366: reading:
14-05-02 10:17:27 366: CLOSE
14-05-02 10:17:27 366: $ close pipe reader
14-05-02 10:17:27 366: $ send CLOSE_OK
14-05-02 10:17:27 366: > start
14-05-02 10:17:27 367: start:
14-05-02 10:17:27 367: INPUT
14-05-02 10:17:27 367: $ lookup or create pipe
14-05-02 10:17:27 367: $ open pipe reader
Program received signal SIGSEGV, Segmentation fault.
backtrace:
0x00007ffff7bc5dcc in s_client_execute (self=0xffffffffffffffff, event=10)
at zpipes_server_engine.h:521
521 self->next_event = event;
(gdb) bt
#0 0x00007ffff7bc5dcc in s_client_execute (self=0xffffffffffffffff, event=10)
at zpipes_server_engine.h:521
#1 0x00007ffff7bc532c in engine_send_event (client=0xffffffffffffffff,
event=have_reader_event) at zpipes_server_engine.h:340
#2 0x00007ffff7bcb353 in pipe_attach_local_reader (self=0x7ffff0008600,
reader=0x7ffff0008910) at zpipes_server.c:220
#3 0x00007ffff7bcc44a in open_pipe_reader (self=0x7ffff0008910) at zpipes_server.c:481
#4 0x00007ffff7bc60ff in s_client_execute (self=0x7ffff0008910, event=2)
at zpipes_server_engine.h:562
#5 0x00007ffff7bca95e in s_server_client_message (loop=0x7ffff00018b0,
item=0x7ffff0007810, argument=0x60ecb0) at zpipes_server_engine.h:1447
#6 0x00007ffff776dc6c in zloop_start (self=0x7ffff00018b0) at zloop.c:463
#7 0x00007ffff7bcaac7 in s_server_task (args=0x0, ctx=0x608ec0, pipe=0x6091f0)
at zpipes_server_engine.h:1465
#8 0x00007ffff777915f in s_thread_shim (args=0x608e90) at zthread.c:81
This looks like a race as it isn't 100% reliable. On my hardware it segv 3 of 4 times. Works fine the other.
from zbroker.
rpedde
commented on June 20, 2024
And sorry, yes, this is multi broker. Works fine single broker.
from zbroker.
hintjens
commented on June 20, 2024
Is there any chance you're still running the version prior to the fix for #46?
from zbroker.
rpedde
commented on June 20, 2024
yup, sure am.
from zbroker.
hintjens
commented on June 20, 2024
Then it'll crash in exactly the same way :-)
Pretty much any cluster test will crash that code, since it was blithely sending events to an invalid pointer (-1). It escaped my initial testing just by luck.
from zbroker.
rpedde
commented on June 20, 2024
k. that's why I linked it to the other one, it looked like an identical backtrace.
from zbroker.
rpedde
commented on June 20, 2024
Are you going to pr the fix?
from zbroker.
hintjens
commented on June 20, 2024
Just for interest, how many brokers are you testing in a cluster now?
On Fri, May 2, 2014 at 5:45 PM, Ron Pedde [email protected] wrote:
k. that's why I linked it to the other one, it looked like an identical
backtrace.—
Reply to this email directly or view it on GitHubhttps://github.com//issues/47#issuecomment-42045893
.
from zbroker.
hintjens
commented on June 20, 2024
Are you going to pr the fix?
Oh, sorry... I didn't realize I'd forgotten to do that.
from zbroker.
rpedde
commented on June 20, 2024
Right now in my test cluster, I'm only running 5 brokers, and my litmus test is a topology with 1000 mappers to one reducer. My larger cluster will be 20 brokers, but with that, I hope to be able to do a topology with as many as 70K edges.
from zbroker.
Related Issues (20)
- problem: beacon mode discovery does not work HOT 9
- problem: zbroker (gossip) sometimes asserts in connect HOT 11
- problem: zbroker sometimes ignores read data
- problem: announce config value still honored HOT 1
- problem: server state flapping HOT 1
- Problem building zbroker: cannot link with -lczmq, install libczmq
- Problem: zyre sometimes goes crazy. O_o HOT 12
- Problem: need to control what interface broker is active on HOT 2
- Problem: Reader attempting to write to unrelated pipe HOT 5
- zyre issues on larger clusters HOT 5
- Problem: Zyre announcement issues HOT 5
- Feature request: configuration-based discovery HOT 9
- Feature request: longer pipe name in logs HOT 1
- Feature request: configurable zyre identification
- Problem: strange zyre_uuid HOT 4
- Problem: need way to configure cluster interface
- problem: zbroker doesn't compile HOT 1
- problem: zyre doesn't log to syslog HOT 2
- feature request: dump server state HOT 1
- problem: zyre/interface not honored HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zbroker.