Code for the paper "Collaborative Target Search with a Visual Drone Swarm: Adaptive Curriculum Embedded Multi-stage Reinforcement Learning Approach". Publication is in process.
Collaborative Target Search with a Visual Drone Swarm: Adaptive Curriculum Embedded Multi-stage Reinforcement Learning Approach
Code for the paper "Collaborative Target Search with a Visual Drone Swarm: Adaptive Curriculum Embedded Multi-stage Reinforcement Learning Approach"
Pipeline
Demo
Setup
pip install -r requirements.txt to set up the dependencies and software requirements. This result of running this command does not include ROS installation. This requirement is tested on an AMD64 architecture device running Ubuntu 20.04 and ROS Noetic.
Connect the computing center to the same network used by the OptiTrack Mocap Server. It is recommended that the ethernet cable is used for this connection to avoid using multiple wireless adapters.
Configure Motive application on the OptiTrack Mocap Server to stream data related to drones to address location 192.168.1.100
Edit sample.launch default launch file of vrpn_client_ros (use roscd vrpn_client_ros && cd launch to navigate to the launch file) to change the IP address from localhost to 192.168.1.100, used by the OptiTrack Mocap Server
Connect a DJI Tello Edu drone using wireless adapter directly or docker container (please refer to the extra instruction)
Running Program
Navigate to the repository folder
Type in the terminal cd Control
Type in the terminal python3 single_drone_control.py for controlling a single drone or python3 collaborative_two_drones_control.pyfor controlling two drones using one computing device for each drone
Programs List
/Models/
1.1. VisualDrone_single_drone.onnx: Trained neural network model file for single drone target search in ONNX format
1.2. VisualDrone_collaborative_drones.onnx: Trained neural network model file for collaborative two drones target search in ONNX format
/Control/
2.1. single_drone_control.py: Python script file for controlling the single drone target search using the model in (1.1)
2.2. collaborative_two_drones_control.py: Python script file for controlling the collaborative two drones target search using the model in (1.2)
System Requirement
Ubuntu 18.04 or 20.04
AMD architecture device (Strongly recommended, but not required)
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent