Comments (9)
ieQu1
commented on June 4, 2024
Hello,
I suspect this is might be a dashboard problem. It would be helpful for us to see:
emqx.log.xfiles from the EMQX nodes- Is there any warnings in the browser debug console?
from emqx.
seinshah
commented on June 4, 2024
Thanks for the response @ieQu1.
The following was the only message in emqx.log.*
2024-01-12T11:41:47.804168+00:00 [warning] msg: dashboard_monitor_error, mfa: emqx_dashboard_monitor:current_rate/1(144), reason: {noproc,{gen_server,call,[emqx_dashboard_monitor,current_rate,5000]}}
I have removed the resources for now, but if warnings in the browser debug console is necessary, please let me know to re-deploy and monitor the situation.
from emqx.
ieQu1
commented on June 4, 2024
It can't be the only message in the logs... Normally EMQX outputs quite a few messages when it joins the cluster. Can I see full logs (not just warnings)?
from emqx.
seinshah
commented on June 4, 2024
Here are the logs (cat emqx/log/*) from each of the nodes on the custer:
TL;DR
- There is a warning with
reason: joinin the second core node initialization - There is no log in any of the nodes regarding joining the cluster
- First replicant shows the second core node as
stoppedwhile other nodes claim it'srunning - Second core does not list the first replicant as part of the cluster nodes, neither
runningnorstopped
First replicant ----> Second core is stopped
Second core -----> There is no first replicant
And here is the list of dashboard console errors:
First Code Node ([email protected])
This was the first core node and therefore no other node existed to join to.
Result of emqx_ctl cluster status:
Cluster status: #{running_nodes =>
['[email protected]','[email protected]','[email protected]',
'[email protected]'],
stopped_nodes => []}
Logs:
=====
===== LOGGING STARTED Wed Jan 17 10:59:11 UTC 2024
=====
Erlang/OTP 25 [erts-13.2.2] [emqx] [64-bit] [smp:2:2] [ds:2:2:8] [async-threads:4] [jit:ns]
Listener ssl:default on 0.0.0.0:8883 started.
Listener tcp:default on 0.0.0.0:1883 started.
Listener ws:default on 0.0.0.0:8083 started.
Listener wss:default on 0.0.0.0:8084 started.
Listener http:dashboard on :18083 started.
EMQX 5.4.1 is running now!
Restricted Eshell V13.2.2 (abort with ^G)
v5.4.1([email protected])1> run_erl [2358] Wed Jan 17 10:59:11 2024
Args before exec of shell:
run_erl [2358] Wed Jan 17 10:59:11 2024
argv[0] = sh
run_erl [2358] Wed Jan 17 10:59:11 2024
argv[1] = -c
run_erl [2358] Wed Jan 17 10:59:11 2024
argv[2] = exec "/home/ubuntu/emqx/bin/emqx" "console"
First Replicant Node ([email protected])
This was created immediately after creating the first core node and joined the first core node as provided in the static seed.
Result of emqx_ctl cluster status:
Cluster status: #{running_nodes =>
['[email protected]','[email protected]','[email protected]'],
stopped_nodes => ['[email protected]']}
Logs:
=====
===== LOGGING STARTED Wed Jan 17 10:59:50 UTC 2024
=====
Erlang/OTP 25 [erts-13.2.2] [emqx] [64-bit] [smp:2:2] [ds:2:2:8] [async-threads:4] [jit:ns]
Listener ssl:default on 0.0.0.0:8883 started.
Listener tcp:default on 0.0.0.0:1883 started.
Listener ws:default on 0.0.0.0:8083 started.
Listener wss:default on 0.0.0.0:8084 started.
Listener http:dashboard on :18083 started.
EMQX 5.4.1 is running now!
Restricted Eshell V13.2.2 (abort with ^G)
v5.4.1([email protected])1>
===== ALIVE Wed Jan 17 11:15:03 UTC 2024
run_erl [2351] Wed Jan 17 10:59:50 2024
Args before exec of shell:
run_erl [2351] Wed Jan 17 10:59:50 2024
argv[0] = sh
run_erl [2351] Wed Jan 17 10:59:50 2024
argv[1] = -c
run_erl [2351] Wed Jan 17 10:59:50 2024
argv[2] = exec "/home/ubuntu/emqx/bin/emqx" "console"
Second Core Node ([email protected])
This was added later to the cluster with first core and replicant nodes as the static seeds.
Result of emqx_ctl cluster status:
Cluster status: #{running_nodes =>
['[email protected]','[email protected]','[email protected]'],
stopped_nodes => []}
Logs:
=====
===== LOGGING STARTED Wed Jan 17 11:07:42 UTC 2024
=====
Erlang/OTP 25 [erts-13.2.2] [emqx] [64-bit] [smp:2:2] [ds:2:2:8] [async-threads:4] [jit:ns]
Listener ssl:default on 0.0.0.0:8883 started.
Listener tcp:default on 0.0.0.0:1883 started.
Listener ws:default on 0.0.0.0:8083 started.
Listener wss:default on 0.0.0.0:8084 started.
Listener http:dashboard on :18083 started.
EMQX 5.4.1 is running now!
Restricted Eshell V13.2.2 (abort with ^G)
v5.4.1([email protected])1> 2024-01-17T11:07:54.605274+00:00 [warning] msg: Stopping mria, mfa: mria:stop/1(134), reason: join
Stop listener http:dashboard on :18083 successfully.
Listener ssl:default on 0.0.0.0:8883 stopped.
Listener tcp:default on 0.0.0.0:1883 stopped.
Listener ws:default on 0.0.0.0:8083 stopped.
Listener wss:default on 0.0.0.0:8084 stopped.
Listener ssl:default on 0.0.0.0:8883 started.
Listener tcp:default on 0.0.0.0:1883 started.
Listener ws:default on 0.0.0.0:8083 started.
Listener wss:default on 0.0.0.0:8084 started.
Listener http:dashboard on :18083 started.
run_erl [2352] Wed Jan 17 11:07:42 2024
Args before exec of shell:
run_erl [2352] Wed Jan 17 11:07:42 2024
argv[0] = sh
run_erl [2352] Wed Jan 17 11:07:42 2024
argv[1] = -c
run_erl [2352] Wed Jan 17 11:07:42 2024
argv[2] = exec "/home/ubuntu/emqx/bin/emqx" "console"
Second Replicant Node ([email protected])
This was added immediately after adding second core node and has first and second core and first replicant nodes as its static seeds.
Result of emqx_ctl cluster status:
Cluster status: #{running_nodes =>
['[email protected]','[email protected]','[email protected]',
'[email protected]'],
stopped_nodes => []}
Logs:
=====
===== LOGGING STARTED Wed Jan 17 11:08:20 UTC 2024
=====
Erlang/OTP 25 [erts-13.2.2] [emqx] [64-bit] [smp:2:2] [ds:2:2:8] [async-threads:4] [jit:ns]
Listener ssl:default on 0.0.0.0:8883 started.
Listener tcp:default on 0.0.0.0:1883 started.
Listener ws:default on 0.0.0.0:8083 started.
Listener wss:default on 0.0.0.0:8084 started.
Listener http:dashboard on :18083 started.
EMQX 5.4.1 is running now!
Restricted Eshell V13.2.2 (abort with ^G)
v5.4.1([email protected])1>
===== ALIVE Wed Jan 17 11:23:32 UTC 2024
run_erl [2342] Wed Jan 17 11:08:20 2024
Args before exec of shell:
run_erl [2342] Wed Jan 17 11:08:20 2024
argv[0] = sh
run_erl [2342] Wed Jan 17 11:08:20 2024
argv[1] = -c
run_erl [2342] Wed Jan 17 11:08:20 2024
argv[2] = exec "/home/ubuntu/emqx/bin/emqx" "console"
from emqx.
Related Issues (20)
- crash logs HOT 1
- EMQX docker environment variables of dashboard default username and password ignores `#` and its following characters. HOT 2
- server_keepalive ineffective HOT 1
- emqx使用static集群报连接 HOT 3
- emqx 5.3.2 with emqx-operator won't start on k8s HOT 5
- when the etcd cluster down for 1-2 minutes, then recover, emqx experiences an exception. and cannot recover HOT 1
- When a session using shared subscription is expired, offline messages are not redistributed HOT 6
- emqx重启后,网关exproto接入认证中保存的用户管理相关的数据丢失 HOT 1
- EMQX v5.4.1 - Connector configuration (bridge egress): missing config. options? HOT 10
- Action/Bridge/Connector Config Breaks in > 5.3.0 HOT 9
- User is able to publish/subscribe to the topic that they not allow when they subscribe '#' topic. HOT 12
- Starting MQTT on Neuron fails | MQTT Conversion
- Very very Buggest broker! HOT 1
- gen_rpc error on ipv6 only environment HOT 6
- Is it necessary to provide map_get and mput functions? HOT 4
- Rule Engine’s FOREACH cannot handle JSON arrays directly
- Function `map_put/3` in the rule engine cannot handle Payload field directly
- Excessive memory spike after a MQTT client publishes a large payload (e.g. ~100mb), causing broker crash HOT 39
- When I use non-existent variables in MQTT bridge actions, unexpected_event errors will occur
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from emqx.