ThingsBoard performance tests
Project that is able to stress test ThingsBoard server with a huge number of MQTT messages published simultaneously from different devices.
To run test against ThingsBoard first create plain text file to set up test configuration (in our example configuration file name is .env):
touch .envEdit this .env file:
nano .envand put next content into the text file (modify it according to your test goals):
REST_URL=http://IP_ADDRESS_OF_TB_INSTANCE:8080
# IP_ADDRESS_OF_TB_INSTANCE is your local IP address if you run ThingsBoard on your dev machine in docker
# Port should be modified as well if needed
[email protected]
REST_PASSWORD=tenant
REST_POOL_SIZE=4
MQTT_HOST=IP_ADDRESS_OF_TB_INSTANCE
# IP_ADDRESS_OF_TB_INSTANCE is your local IP address if you run ThingsBoard on your dev machine in docker
MQTT_PORT=1883
MQTT_SSL_ENABLED=false
MQTT_SSL_KEY_STORE=mqttclient.jks
MQTT_SSL_KEY_STORE_PASSWORD=
# Test API to use - device or gateway. In case device data is send directly to devices, in case gateway - over MQTT gateway API
TEST_API=gateway
# Device API to use - MQTT or HTTP. HTTP applicable only in case TEST_API=device
DEVICE_API=MQTT
DEVICE_START_IDX=0
DEVICE_END_IDX=10
DEVICE_CREATE_ON_START=true
DEVICE_DELETE_ON_COMPLETE=true
GATEWAY_START_IDX=0
GATEWAY_END_IDX=3
GATEWAY_CREATE_ON_START=true
GATEWAY_DELETE_ON_COMPLETE=true
WARMUP_ENABLED=true
# Type of the payload to send: DEFAULT, SMART_TRACKER, SMART_METER
# RANDOM - TODO: add description
# SMART_TRACKER - sample payload: {"latitude": 42.222222, "longitude": 73.333333, "speed": 55.5, "fuel": 92, "batteryLevel": 81}
# SMART_METER - sample payload: {"pulseCounter": 1234567, "leakage": false, "batteryLevel": 81}
TEST_PAYLOAD_TYPE=SMART_METER
TEST_ENABLED=true
# true - send data to devices by device ids, false - select random devices from the list
TEST_SEQUENTIAL=false
MESSAGES_PER_SECOND=1000
DURATION_IN_SECONDS=300
UPDATE_ROOT_RULE_CHAIN=false
REVERT_ROOT_RULE_CHAIN=false
RULE_CHAIN_NAME=root_rule_chain_ce.json
Where:
REST_URL- Rest URL of the TB instance. Default: http://localhost:8080REST_USERNAME- Login of the user. Default: [email protected]REST_PASSWORD- Password of the user. Default: tenantMQTT_HOST- URL of the ThingsBoard MQTT broker. Default: localhostMQTT_PORT- Port of the ThingsBoard MQTT broker. Default: 1883DEVICE_API- Use MQTT, HTTP or LWM2M Device API for send messages. Default: MQTTDEVICE_START_IDX- First index of the device that is going to be used in the test. Token of the device is going to be index of this device during testDEVICE_END_IDX- Last index of the device that is going to be used in the testDEVICE_CREATE_ON_START- Create devices before testDEVICE_DELETE_ON_COMPLETE- Delete devices after test, there were created on start of the testMESSAGES_PER_SECOND- Number of the messages to be published per second to ThingsBoardDURATION_IN_SECONDS- Number of seconds run of the testMQTT_SSL_ENABLED- Enable/disable ssl for MQTT. Default: falseMQTT_SSL_KEY_STORE- MQTT key store file locationMQTT_SSL_KEY_STORE_PASSWORD- MQTT key store file password
Once params are configured to run test simple type from the folder where configuration file is located:
docker run -it --env-file .env --name tb-perf-test thingsboard/tb-ce-performance-test:latestSimply run test on the same machine (service, IDE, Docker)
docker run -it --rm --network host --pull always --log-driver none --name tb-perf-test thingsboard/tb-ce-performance-test:latestSimply run test somewhere else
docker run -it --rm --network host --name tb-perf-test \
--pull always --log-driver none \
--env REST_URL=http://127.0.0.1:8080 \
--env MQTT_HOST=127.0.0.1 \
--env [email protected] \
--env REST_PASSWORD=tenant \
--env DEVICE_END_IDX=1111 \
--env MESSAGES_PER_SECOND=1000 \
--env DURATION_IN_SECONDS=86400 \
--env ALARMS_PER_SECOND=1 \
--env DEVICE_CREATE_ON_START=true \
--env TEST_PAYLOAD_TYPE=SMART_METER \
thingsboard/tb-ce-performance-test:latest
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent