Previous Challenges
CARLA Challenge 2020
The CARLA Autonomous Driving Challenge 2020 was organized as part of the Machine Learning for Autonomous Driving Workshop at NeurIPS 2020. Being open to any participant from academia and industry, you only needed to sign up on the CARLA AD Leaderboard in order to participate in the challenge.
Results and retrospective
Video summary of the CARLA Challenge 2020 and talks from the winning teams:
Congratulations to the winning teams in the SENSORS modality:
| Team | Submission | Driving score | Route completion | Infraction penalty | Collisions pedestrians | Collisions vehicles | Collisions layout | Red light infractions | Stop sign infractions | Off-road infractions | Route deviations | Route timeouts | Agent blocked | Duration | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Units | % | % | [0, 1] | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Infractions/Km | Minutes | |||
| 1st | MaRLn | MaRLn | 24.98 | 46.97 | 0.52 | 0.00 | 2.33 | 2.47 | 0.55 | 0.00 | 1.82 | 1.44 | 0.79 | 0.94 | 9035.73 | |
| 2nd | Anonymous | Attention Ensemble (NEAT + TransFuser) | 13.49 | 23.2 | 0.72 | 0.02 | 2.06 | 0.49 | 1.50 | 0.0 | 3.26 | 0.19 | 0.0 | 8.59 | 452.42 | |
| 3rd | LBC | Learning by Cheating (CoRL 2019) | 8.94 | 17.54 | 0.73 | 0.0 | 0.4 | 1.16 | 0.71 | 0.0 | 1.52 | 0.03 | 0.0 | 4.69 | 1609.92 |
Important: The MAP modality is declared deserted this year.
We would like to thank all teams for their participation in the challenge. Remember that the CARLA Autonomous Driving Challenge will reopen in 2021 with new exciting challenges.
Statistics
- +45 teams participated in the challenge.
- +6,000 hours of driving simulation.
- +7,000 Km driven in total.
- Top-5 submissions registered average infractions per kilometer in the [0.95 - 1.7] range.
- Road departure (off-road) and collisions with other vehicles were the main infractions for top-5 submissions.
Timeline
| October 6th 2020, 00:00 PDT | |
| November 25th 2020, 23:00 PDT | |
| November 30th 2020, 23:00 PDT | |
| November 29th 2020, 23:00 PDT | |
| November 30th 2020, 23:00 PDT | |
| December 6th 2020, 23:00 PDT | |
| December 11th, 2020 |
CARLA Challenge 2019
The CARLA Challenge was also held during 2019. Find more information about the CARLA AD Challenge 2019, held at CVPR 2019.