autonomobile / autopylot Goto Github PK

This is not a harware problem as the input is actual recorded by autopylot. this is a probably an issue with a state that disable the recording.
In joystic.py line 131 the fvalue is updated correctly but the car doesn't turn for a weird reason

Make the Arduino Code to drive the car

Load and save images using opencv (cv2)

• one function to load images using a filename
• one function to save the image using a filename
• one function to load .json files
• one function to save .json files
• functions that combine both
• create tests for those functions

Price per T-shirt : 20€ (logo Autonomobile + Texte)
If you are okay, I need a better quality logo

Had a minor issue with the serial port / arduino for the speed, acted weird with high speed loops as if the serial port was flooded even if I think the limit is pretty far. Will investigate why this happens (shouldn't cause too much problems as we will only work at 30hz at most).

Do a basic program to control the car with a controller

using controller buttons values:

• determine when we should drive
• determine when we should record images

We will later on have a class that will be responsible for feeding data into the model during the training.

We could just feed the raw images, but we won't stop here.
The idea is to have some functions that will modify the images and annotations to increase the accuracy of the model.

Here are some function ideas (higher is highest priority):

• image / annotation flip : flipping images and steering (and maybe some other values that can be mirrored)
• random noise : add some noise to the image.
• random brightness : change the brightness of the image.
• random shadows : change the brightness of a region on the image.
• color shift : maybe vary a bit the colors on the image.
• simulate a car in front : add a randomly placed image of back of cars on the image (maybe also offset the steering to be able to overtake). The size of the car will also vary.

I think autopylot is lacking of some basic but important settings:
for instance i would like to have a CONST_SPEED: true|false which will describe if the model has to take speed from prediction or from a constant value.
This constant value may be store in another parameter of type float MAX_SPEED which will contain the maxim speed the car can approach. in the case CONST_SPEED is false, MAX_SPEED is the actual speed of the car

1. Create your own CNN model for the car.

2. Trainning it with the same datas.

3. Then competing in the most intense of competitions.

I will start by creating classes to fetch images from cameras

This should be quite quick to do but is important for the first presentation.
We will use opencv functions to draw/visualize different data on the image for instance steering, throttle and speed.

• make a function to vis every kind of data
• make a function to vis multiples data inputs for instance Ground Truth vs Prediction of the model.

new set of rules including:

• cone avoidance: test data augm approach / object detection and simple policy
• car avoidance: same as cone avoidance
• manual throttle control (just need to add this feature)

Would also like to experiment with lane detections & online trajectory planning

c'est bon

As you all know, the first presentation is coming pretty fast !
So I will try to anticipate the big midterm rush by starting to think about it right now.

Here is what we need to do according to the file we were given:

• I think it would be great to prepare individually what you all did since the beginning, you will have to present those.

• Also, I think it would be great to have a visual representation of the project: big labelled boxes that are linked to represent every part of the code (Classes and important functions)

datagenerator class to load data during the training of the model

post your ideas below !

Have a way to store values and fetch them when needed.
For performance issues, we won't use a dict but rather a class (obviously we won't add settings on the go).

Needs:

• Defaults values
• A way to generate a json file from those default values
• A way to load values from a json file (for exemple at startup)
• A way to change those values using a string (kind of like you would do with a dict but in a class)

Create a dataset class to load and save folders of data, we will consider one folder to be a dataset.
We will have to develop:

• a load dataset function
• a load multiple dataset function (taking in input multiples paths)
• every load functions but with sorted data
• every load functions but with sequences of sorted data

quick reminder: the images will have in its name the date (fetch the date using the time.time() function) followed by .png, the json should have the same name but should end with .json instead of .png

You will need to use the glob.glob() function to fetch the path of every json path in the folder

Just adding the schematics we did using Tinkercad

Thinking about a run-through configuration of the controller, eg having a small script asking to press on a given button or axes, saving those preferences to a file

this is a big issue in our pipeline as we get more and more outputs we can't guess anymore what output is which. Need to get this fixed reliably using: https://www.tensorflow.org/lite/guide/signatures

@MaxMartelo, @DieuCrevette, @Maximellerbach please find some content you would like to see on the website.
For example a car image, some texts and description about the project. Please send bellow any kind of ressources

We need some widgets to add to the server.
Feel free to provide ideas. We need to present data in a usefull way.
Here are some example :

• Speed indicator
• Speed History
• Live view
• Controls to remote control the car
• notifications center
• etc ...

Need to investigate the difference between data coming from simulator and webcam (one is np.uint8 and the other np.float64), will need to make both have the same type to avoid any future issues

Everybody has to write min 2 (in project report part 2 / realized tasks) pages about what he did since January