iba-group-it / iot-data-simulator Goto Github PK

we used IoT-data-simulator to generate dataset, but we are facing problem to export or download the option. In the given option such as minio , mqtt(we used mosquito to connect but we couldnt find where the dataset got collected) we are facing error, can anyone help us any alternative way to get download the generated dataset quickly or provide detail walkthrough for exporting data to target system options
i running the iot data simulator in my vm , is there any chance i can download or find generated data into my local system

I want to test this in Ubuntu 18, I'm a virgin instance and I need cheatsheet for installation correctly, can u pls put that .md file for following?
Tnks

I have a CSV file with this format:
datetime,temperature,humidity,pressure,carbon_dioxide,oxygen
2021-12-25T00:58:18Z,21,60,101.3,409.9,20
2021-12-25T00:58:19Z,21.05,60.1,101.6,410.3,20

I have defined the datetime (column 1) as a date type and a format of YYYY-MM-DDTHH:MM:SSZ. But it appears that the simulator is failing parsing this format. Is this an issue or is there a different way to define the datetime format for ISO-8601?

Error from log
2021-04-28 13:01:37Vehicle Simulationjava.lang.IllegalArgumentException: Illegal pattern character 'T'

Thanks for you help

When creating a new target system, if we pass target url as http://something.something.com/A/B then the during sending the data, the rest endpoint is taken as only "http://something.something.com" which causes the request to fail. How to fix this? where in the code can I find where url is parsed incorrectly.

---> Running in e8bb6b388c21
fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.6/community/x86_64/APKINDEX.tar.gz
(1/25) Installing ncurses-terminfo-base (6.0_p20171125-r0)
(2/25) Installing ncurses-terminfo (6.0_p20171125-r0)
ERROR: ncurses-terminfo-6.0_p20171125-r0: Protocol error
(3/25) Installing ncurses-libs (6.0_p20171125-r0)
(4/25) Installing readline (6.3.008-r5)
(5/25) Installing bash (4.3.48-r1)
(6/25) Installing binutils-libs (2.30-r1)
ERROR: bash-4.3.48-r1: Protocol error
(7/25) Installing binutils (2.30-r1)
(8/25) Installing gmp (6.1.2-r0)
(9/25) Installing isl (0.17.1-r0)
(10/25) Installing libgomp (6.3.0-r4)
(11/25) Installing libatomic (6.3.0-r4)

ERROR: libatomic-6.3.0-r4: temporary error (try again later)
(12/25) Installing pkgconf (1.3.7-r0)
(13/25) Installing mpfr3 (3.1.5-r0)
ERROR: mpfr3-3.1.5-r0: Protocol error
(14/25) Installing mpc1 (1.0.3-r0)
(15/25) Installing gcc (6.3.0-r4)
ERROR: gcc-6.3.0-r4: Protocol error
(16/25) Installing musl-dev (1.1.16-r14)
(17/25) Installing libc-dev (0.7.1-r0)
(18/25) Installing g++ (6.3.0-r4)
ERROR: (19/25) Installing make (4.2.1-r0)
g++-6.3.0-r4: Protocol error
(20/25) Installing libbz2 (1.0.6-r5)
(21/25) Installing expat (2.2.0-r1)
(22/25) Installing libffi (3.2.1-r3)
ERROR: libffi-3.2.1-r3: Protocol error
(23/25) Installing gdbm (1.12-r0)
(24/25) Installing sqlite-libs (3.20.1-r2)
ERROR: sqlite-libs-3.20.1-r2: Protocol error
(25/25) Installing python2 (2.7.14-r0)
Executing busybox-1.26.2-r9.trigger
8 errors; 68 MiB in 30 packages
ERROR: Service 'data-sender' failed to build: The command '/bin/sh -c apk add --no-cache make gcc g++ python bash' returned a non-zero code: 8

Hi,
Tried to install today, but I got the following error:

U20LTS:/usr/local/IoT_Data_Simulator$ docker-compose pull
ERROR: yaml.scanner.ScannerError: mapping values are not allowed here
  in "./docker-compose.yml", line 92, column 65

As I am not a programmer, I don't know what to do here.
Can you help?
thank you!!

I am getting an error like this when I create a session connecting AWS IoT Core.
Cannot read property 'publish' of undefined

Can someone please help me?
I have attached few other screenshots below.

This feature should provide possibility to automatically restart session when it is completed until manual session terminating.

C:\Users\dockerforsena\lab>dir
 Volume in drive C is Windows
 Volume Serial Number is 488A-E391

 Directory of C:\Users\dockerforsena\lab

05/12/2021  06:35 PM    <DIR>          .
05/12/2021  06:35 PM    <DIR>          ..
05/12/2021  06:35 PM    <DIR>          IoT-data-simulator
			   0 File(s)              0 bytes
			   3 Dir(s)  113,609,580,544 bytes free

C:\Users\dockerforsena\lab>cd IoT-data-simulator

C:\Users\dockerforsena\lab\IoT-data-simulator>docker-compose pull
Traceback (most recent call last):
  File "docker\api\client.py", line 214, in _retrieve_server_version
  File "docker\api\daemon.py", line 181, in version
  File "docker\utils\decorators.py", line 46, in inner
  File "docker\api\client.py", line 237, in _get
  File "requests\sessions.py", line 543, in get
  File "requests\sessions.py", line 530, in request
  File "requests\sessions.py", line 643, in send
  File "requests\adapters.py", line 439, in send
  File "urllib3\connectionpool.py", line 670, in urlopen
  File "urllib3\connectionpool.py", line 392, in _make_request
  File "http\client.py", line 1255, in request
  File "http\client.py", line 1301, in _send_request
  File "http\client.py", line 1250, in endheaders
  File "http\client.py", line 1010, in _send_output
  File "http\client.py", line 950, in send
  File "docker\transport\npipeconn.py", line 32, in connect
  File "docker\transport\npipesocket.py", line 23, in wrapped
  File "docker\transport\npipesocket.py", line 72, in connect
  File "docker\transport\npipesocket.py", line 52, in connect
pywintypes.error: (2, 'CreateFile', 'The system cannot find the file specified.')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "docker-compose", line 3, in <module>
  File "compose\cli\main.py", line 81, in main
  File "compose\cli\main.py", line 200, in perform_command
  File "compose\cli\command.py", line 60, in project_from_options
  File "compose\cli\command.py", line 152, in get_project
  File "compose\cli\docker_client.py", line 41, in get_client
  File "compose\cli\docker_client.py", line 170, in docker_client
  File "docker\api\client.py", line 197, in __init__
  File "docker\api\client.py", line 221, in _retrieve_server_version
docker.errors.DockerException: Error while fetching server API version: (2, 'CreateFile', 'The system cannot find the file specified.')
[4092] Failed to execute script docker-compose

C:\Users\dockerforsena\lab\IoT-data-simulator>docker-compose up -d
Traceback (most recent call last):
  File "docker\api\client.py", line 214, in _retrieve_server_version
  File "docker\api\daemon.py", line 181, in version
  File "docker\utils\decorators.py", line 46, in inner
  File "docker\api\client.py", line 237, in _get
  File "requests\sessions.py", line 543, in get
  File "requests\sessions.py", line 530, in request
  File "requests\sessions.py", line 643, in send
  File "requests\adapters.py", line 439, in send
  File "urllib3\connectionpool.py", line 670, in urlopen
  File "urllib3\connectionpool.py", line 392, in _make_request
  File "http\client.py", line 1255, in request
  File "http\client.py", line 1301, in _send_request
  File "http\client.py", line 1250, in endheaders
  File "http\client.py", line 1010, in _send_output
  File "http\client.py", line 950, in send
  File "docker\transport\npipeconn.py", line 32, in connect
  File "docker\transport\npipesocket.py", line 23, in wrapped
  File "docker\transport\npipesocket.py", line 72, in connect
  File "docker\transport\npipesocket.py", line 52, in connect
pywintypes.error: (2, 'CreateFile', 'The system cannot find the file specified.')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "docker-compose", line 3, in <module>
  File "compose\cli\main.py", line 81, in main
  File "compose\cli\main.py", line 200, in perform_command
  File "compose\cli\command.py", line 60, in project_from_options
  File "compose\cli\command.py", line 152, in get_project
  File "compose\cli\docker_client.py", line 41, in get_client
  File "compose\cli\docker_client.py", line 170, in docker_client
  File "docker\api\client.py", line 197, in __init__
  File "docker\api\client.py", line 221, in _retrieve_server_version
docker.errors.DockerException: Error while fetching server API version: (2, 'CreateFile', 'The system cannot find the file specified.')
[760] Failed to execute script docker-compose

How can solve this?

As far as I see the data-sender project uses the 2.3.1 version of kafka-node. That means it's using the old version of Kafka Client.
Since it uses an old version of Kafka Client, It can't produce the latest Kafka topics. So, you need to upgrade the kafka-node version.
If we think the same, I can send a pull request for this problem.
Thanks.

I define a json schema and there are nesting objects. The rule type in this situation seems useless because it just another nesting json schema and the data is defined inside.

This picture shows below:

I want to use this to do a poc with Azure IOT hub. Is it possible to do that? Send the data from this tool to Azure IOT?

I create a server flask that receive GET and POST on a certain port. From the browser it works, but if I set the target of the session of IoT-data-simulator to server URL I receive this kind of error "Error: connect ECONNREFUSED 127.0.0.1:8001".

Hi,
I need to create a large number of devices to test my IoT solution. does there any way to create identical devices at one time without the need to create each one individually?
Thanks in advance

i mean:
sessions
data
devices
target systems

Stay alert

Hi,

I tried to up the docker-compose, but I received that error

ERROR: build path /Users/WilliamSca/Projetos/Python Projects/IOT/rabbitmq either does not exist, is not accessible, or is not a valid URL.

I got it using docker-compose up --no-build

Check if it's possible to implement via mobx-utils chunkProcessor

Ticks number provision will make possible the following scenarious:

1. Replay only N first data entries from dataset.
2. Generate some limited amount of data in case of data generation on fly.

Session should be automatically completed when tick number exceeds.