Skip links to main content
Logo of Geometric Image Processing Laboratory,
Computer Science Department Home
Technion Home Page

Projects Last Projects

Reinforcement Learning Approach for Formula Driverless Car

Elior Kanfi

Supervised by Yaron Honen, Roman Rabinovitch

Abstract

Formula Student Driverless is a competition between universities all over the world to build an autonomous race car that will drive successfully in a racetrack, with events and competitions happening all throughout the year in many cities around the world.
In this project I implemented Reinforcement Learning algorithm called SAC (Soft Actor Critic) on the simulated Technion autonomous Formula car, with simulation done in Unreal Engine 4 and AirSim plugin, and input being only an image from a camera mounted on the car, while the car has no knowledge or assumptions on the shape of the track.
I used a VAE (Variational Auto-Encoder) to reduce image size and thus reducing the observation space, and the output of the algorithm is a steering angle, keeping a constant speed of 7.5 m/s (27 km/h).
My work in the GIP Lab in the Technion - Israel Institute of Technology, strives to contribute to the amazing Formula Student Technion Driverless team in their efforts to compete in future events.

My code in GitHub: https://github.com/eliork/Reinforcement-Learning-on-Autonomous-Race-Car

Pictures
Project Reinforcement Learning Approach for Formula Driverless Car Picture 1
Project Reinforcement Learning Approach for Formula Driverless Car Picture 2
Project Reinforcement Learning Approach for Formula Driverless Car Picture 4
Project Reinforcement Learning Approach for Formula Driverless Car Picture 5
Project Report

Please, see project report.

Final Presentation

Please, see final presentation.

Code

Please, see Code.

Demo

Please, see demo clip.

Copyright © 2016 by Geometric Image Processing Lab. All rights reserved.