Computer vision to improve decisions systems for self-driving cars
By Algolux | Published on February 17, 2022
Problem and objectives
Problem
- Mercedes-Benz and the European Union wanted to find a solution for future self-driving cars that would operate entirely through cameras and sensors to reduce dependence on LiDAR (Light Detection and Ranging, a remote sensing method that uses light in the form of a pulsed laser to measure ranges).
Objectives
- Develop algorithms capable of merging data from multiple sensors and prioritizing data, by determining the data to consider in decision-making (from cameras, sensors, LiDAR, etc.).
- Make self-driving cars capable of making real-time decisions from multiple data sources.
- Assist Mercedes-Benz in the creation of a European vehicle automation standard.
Proposed solution
Solution
Algolux specializes in computer vision recognition. The company provides constantly evolving object perception software for cameras from existing vehicles as well as those in production. The technologies developed by Algolux work with cloud-based tools and software that optimize embedded artificial intelligence (AI). Embedded software is software programmed into the actual hardware (such as in a sensor). Algolux worked on an autonomous vehicle project in collaboration with Daimler AG, the parent company of Mercedes-Benz, and the European Union.
Principle
Optimizing the perception of objects in all weather conditions is crucial for the proper transition to operating a self-driving car.
For example, a car must be capable of detecting objects around it during a snowstorm and of making appropriate decisions based on those objects. Algolux merges data from various sensors and cameras, and these are then simulated using AI. This dynamic sensor and mapping system will enable better performance of the space perception system in complex driving weather conditions (such as in rain or snow).
The computer vision system established by Algolux is based on data from cameras, sensors and data fusion systems.
Role of AI
One of Algolux’s main priorities is the development of computer vision solutions. The company bases its technology on AI and has been the recipient of a dozen awards for its patented technologies in recent years. The company is currently using deep learning based on data captured in real time.
Algolux used a variety of techniques to develop the algorithm, including:
- Classification models;
- Deep learning;
- Image analysis;
- Image classification;
- Image recognition.
Impacts
Main outcomes
Impact on Daimler AG:
- Creation of competitive advantage through the use of computer vision;
- Commercialization of a system with level 4 or 5 autonomy, which means the ability of a vehicle to drive completely automatically.
Impacts on the European Union:
- Standardization under way of automatic vehicle driving algorithms.
Impacts on Algolux:
- Development of AI expertise in data fusion;
- Experience working with Mercedes-Benz in the development of advanced technologies;
- New research partners and research publications;
- International recognition in the development of algorithms related to computer vision systems.
Generation and dissemination of new knowledge
- Development of AI knowledge at Mercedes-Benz through the partnership with Algolux.
Challenges takled
- Reliability issues involving camera and sensor data;
- Complexity of autonomous obstacle detection under changing weather conditions (e.g. sunshine, rain, snow).
Conditions for success
Team mobilised
About 20 people are currently working on the project. The Algolux AI project team consists of:
- Solution architects;
- Software developers;
- Computer vision researchers.
Collaborations
The following collaborations contributed to the success of the project:
- Support from Mercedes-Benz management;
- Collaboration between Algolux and the different teams of researchers from various companies such as Bosch, Daimler, Magna, etc.;
- Vehicle automation R&D with Mercedez-Benz researchers.
Project stages
R&D project with the Mercedes-Benz team through the German branch of Algolux, among others;
Request submitted to the European Union by Mercedes-Benz;
Project still under way in November 2021.
Context of the solution
Customers
Algolux mainly focuses on large international companies and exports its services. The company collaborates on research projects with different universities.