xdev-developer / gen4s Goto Github PK

Implement file system output - out generated content to file.

support of sending kafka message with key/value.

add scenario config, with multiple steps - run generation one, two, three, etc

• avro serialization
• template rendering

Add Rest API interface with in memory DB.
So you can up simple internal web service and kick off generation using Postman or CURL (Before e2e tests).

CSV schema support, where
Header row - variables
Rows - values.

This is usefult when you need load some data from existing storage (export to csv) and generate other part of data using gen4s.

Maybe we also should support TCP output, what do you think? It might be useful for things like syslog listener

Implement:

• datetime generator
• string generator
• int/bool generator
• string by pattern generator (see fabricator)
• ip / mac generator
• enum generator
• static value
• env var.

Sometimes me as a user need to temporary change generated value, for example id or name.

I think it will be useful add something like -e key=value cli argument and override generated value for variable key with value provider from command args.

example:
Schema

{
  "generators": [
    { "variable": "name", "type": "pattern", "pattern":  "user-???-###"}
    ]
}    

Command:

./bin/gen4s run -e name=John -c ./examples/users/config.conf

Expected result:
name variable = John instead of user-ABC-123

Implement http output

• config (already implemented)
• flow
• tests.

Add scala coverage plugin
Add github action to run coverage
Add badge

• different types of logs

Add flow to apply template transformers. For example json minify -> decode template as json --> apply noSpaces transformation.

It will be nice add https://github.com/ctongfei/progressbar.

• config
• flow
• tests.

Add s3 output support

Add flow to:

• read input / output
• run data generation stream
• preview / output producer

Example template:

{
 "a": {{a}}
 "b": {{b}}
 "sum": ${{a + b}}
}

Result:

{
 "a": 1
 "b": 2
 "sum": 3
}

Json validator, template variables validator.