2DNeuralVision
Horizon Europe EU project meant to develop a low-power consumption computer vision system to be used under adverse weather or low light conditions
About usAbout 2DNeuralVision
2DNeuralVision is an EU project that brings together 7 European research centres, leading universities, and innovative companies from 4 different countries to develop the enabling components for a low-power consumption, computer vision system that could be used for adverse weather and low light conditions.
Within 3 years, this Horizon Europe project will develop a 2-dimensional enhanced wide spectrum image sensor and optical neural network with enabling 2-dimensional passive and active elements, mainly based on graphene and Transition Metal Dichalcogenide (TMDC).
These 2D materials will allow for smaller devices with greater functionality, leading to disruptive computer vision improvements in areas such as the automotive industry, augmented reality, virtual reality, service robotic, and mobile device sectors.
By investing in emerging enabling technologies, 2DNeuralVision will reinforce the European industry leadership across the digital supply chain and generate robust European industrial and technology presence in all key parts of a greener digital supply chain, from low-power components to advanced systems, future networks, new data technologies and platforms.
For this purpose, the EU project has been granted €5.5 million from the European Commission, under the umbrella of the Horizon Europe programme for research and innovation. Moreover, 2DNeuralVision takes part in Graphene Flagship, a large-scale European initiative to advance Europe’s strategic autonomy in technologies that rely on graphene and other 2-dimensional materials, such as Transition Metal Dichalcogenide (TMDC).
Our work packages
-
1. Project management
WP1 serves as the EU project's backbone, overseeing its smooth operation and compliance with the EU guidelines. This WP focuses on several key objectives to guarantee success. It handles financial and administrative aspects, ensuring resources are allocated efficiently. It also involves the organisation of meetings and project coordination in order to submit the reports in due time and format.
The WP also tackles risk management, identifying potential challenges and devising strategies to mitigate them. Finally, it maintains a crucial interface with the Graphene Flagship initiative and oversees collaboration management. In essence, this WP acts as 2DNeuralVision’s conductor, harmonizing various elements to meet the goals outlined in the Grant Agreement.
-
2. Spec definition and validation
WP2 collects all necessary specifications for image sensors and Optical Neural Networks (ONN) developed in this Horizon Europe project, on single element as well as on architecture level. The specification set will be updated after first production runs. A test catalogue and labelled images for ONN training are prepared to benchmark the ONN. Finally, the image sensor will be tested under simplified environmental conditions, leading to a TRL 5 (Technological Readiness Level).
-
3. Image sensor component development
WP3 focuses on creating advanced image sensor chips that can do a lot while keeping low power consumption. These so-called wide-spectrum image sensors can function like the super eyes of robotic systems, such as self-driving cars for the automotive industry, drones or AR/VR headsets. To develop them, special semiconductors like super-thin layers (2D materials like graphene and Transition Metal Dichalcogenide - TMDC) and tiny, lead-free crystals (quantum dots) are used. These materials will be put together using processes adapted from the chip industry.
The goal is to make these image sensor chips very sensitive even to low light conditions, including short-wave infrared light, work with materials safe for the environment, and do this all while using low power.
-
4. Optical neural network component development
WP4 aims to develop the very first Optical Neural Networks (ONN) based on a graphene photonics platform. In a first stage, the basic components will be developed at wafer level, targeting the specifications defined in WP2. A Process Design Kit (PDK) will be developed with all the basic components required for the design of an ONN chip. Finally, this design will be processed at wafer level and dies with integrated ONN optical PIC will be send out to the partners for characterization and integration in the demonstrators.
-
5. System integration
Within the WP5, suitable architectures for processing data in the optical domain will be devised and interfaced with reconfigurable technology developed in 2DNeuralVision. The approach will be based on photonic in-memory computing concepts, which hold promise to speed up analogue computing to very high bandwidth. These concepts will be enabled by novel 2-dimensional integrated photonic components.
-
6. Dissemination, communication & exploitation
WP6 involves all actions that contribute to increasing the impact of the 2DNeuralVision project, transcending its own consortium and timeframe. This includes the dissemination of its results in scientific and professional publications and events; the communication of its scope, activities, and results to a broader audience, with a focus on its stakeholders; and the exploitation of its results after its ending.
It is also responsible for developing policy briefs, coordinating data management in the consortium, and ensuring compliance with GDPR and intellectual property rights (IPR). Moreover, it will coordinate collaborations with the Graphene Flagship initiative.
The 2DNeuralVision consortium
-
ICFO
Spain
Role
Project coordinator and WP1 leader
The Institute of Photonic Sciences was founded in 2002 by the Government of Catalonia and the Universitat Politècnica de Catalunya, both of which are members of its board of trustees along with the Cellex and Mir-Puig Foundations. Located in the metropolitan area of Barcelona, the institute currently hosts 500 people, organized in 25 research teams in 80 state-of-the-art research laboratories.
Research lines encompass diverse areas in which photonics plays a decisive role, with an emphasis on basic and applied themes relevant to medicine and biology, advanced imaging techniques, information technologies, a range of environmental sensors, tunable and ultra-fast lasers, science and technologies, photovoltaics and the properties and applications of nano- and quantum materials such as graphene or quantum dots, among others.
In addition to two consecutive accreditations of the Severo Ochoa national program for research excellence, ICFOnians have been awarded 16 elite ICREA Professorships and 42 European Research Council grants. ICFO participates actively in the European Technological Platform Photonics21 and is very proactive in fostering collaborations with the industry.
-
QURV
Spain
Role
Project partner and WP3 leader
Qurv develops wide-spectrum image sensor technologies and integrated solutions to enable next-generation computer vision applications, addressing the expanding needs of an autonomous and intelligent new world. Qurv's technology leverages current CMOS scalable manufacturing and advanced materials to unlock new levels of performance, reliability, and function in XR devices, service robots and automotive industry. Qurv's breakthrough technology platform stemmed from more than ten years of applied research, and the company was established in 2020.
-
Black Semicondutor
Germany
Role
Project partner and WP4 leader
Black Semiconductor is a deep-tech startup, based in Aachen, Germany. It is realizing photonic interconnects for microchips with a performance order of magnitude higher than conventional technologies.
These known architectures are reaching their physical limits, wherefore Black offers an alternative solution based on light, which is a much better carrier for information than electrical signals. The capacity of optical fibres appears almost unlimited compared to copper wires. In this Horizon Europe project, it is a layer of carbon atoms that makes the difference, as it leverages the potential of the 2D material graphene to manufacture its photonic solutions.
-
Universitat Heidelberg
Germany
Role
Project partner and WP5 leader
Founded in 1386, Heidelberg University is the oldest university in today’s Germany and one of Europe’s most research-intensive institutions. Its successes in the Excellence Competitions of the German Federal and State Governments, and in internationally recognised rankings, prove Heidelberg University’s leading role in the scientific community. In educating students and supporting outstanding early-career researchers, the university relies on research-based teaching and well-structured support for doctoral candidates and postdocs.
Heidelberg University is a comprehensive research university. Its broad subject spectrum in thirteen faculties includes the humanities and social sciences, law, the natural and engineering sciences, and the life sciences, as well as medicine. Heidelberg University is committed to advancing exceptional individual disciplines, promoting dialogue beyond traditional disciplinary boundaries, and turning research findings to good use for society and the economy.
-
IMEC
Belgium
Role
Project partner
IMEC is a world-leading R&D and innovation hub in nanoelectronics and digital technologies. IMEC shapes the future by enabling nano- and digital technology innovation with significant impact on quality of life. It does so with its partners from companies, governments and academia.
Supported by the three pillars of its R&D: a unique infrastructure that includes a €2.5 billion, 300mm semiconductors pilot line; more than 5,000 expert scientists from over 96 countries; and an ecosystem of more than 600 world-leading industry partners and a global academic network.
Founded in 1984, IMEC quickly made its name as the leading research hub for advanced CMOS scaling.
It will continue to shape the roadmap for the semiconductors industry for years to come. On top of that, it leverages this deep-tech knowhow, and it combines it with software and system knowledge to build up an exceptional portfolio of advanced technologies. The combination of these technologies opens the door to smart, sustainable solutions, such as healthcare, clean energy and Industry 4.0.
-
Volkswagen Group
Germany
Role
Project partner and WP2 leader
The Volkswagen Group is one of the world's leading car makers, headquartered in Wolfsburg, Germany. It operates globally, with 119 production facilities in 19 European countries and 10 countries in the Americas, Asia and Africa. With around 676,000 employees worldwide. The Group’s vehicles are sold in over 150 countries.
With an unrivalled portfolio of strong global brands, leading technologies at scale, innovative ideas to tap into future profit pools and an entrepreneurial leadership team, the Volkswagen Group is committed to shaping the future of the automotive industry through investments in electric and autonomous driving vehicles, digitalization and sustainability.
The Volkswagen Group promise: with the electric drive, digital connectivity and autonomous driving, Volkswagen is making mobility cleaner, quieter, smarter and safer.
-
FI Group
Portugal
Role
Project partner and WP6 leader
FI Group advises companies on the management of their R&D&I financing, through the design and implementation of actions aimed at boosting their technological and economic development. These actions focus on the integral treatment of R&D&I tax incentives and the management of calls for public grants and subsidies at the national and European levels, resulting in an improvement of the companies' profit and loss accounts.
Its commitment to achieving excellence in all its services has led FI Group to assume the leadership of the sector, both at the national and European levels, thus promoting an ambitious internationalisation plan with a clear objective: to help its clients in the generation of value.
Latest news & articles
New Paper by ICFO: Environmental solution of quantum dots
The new paper by the project coordinator ICFO focuses on the development of a novel method for synthesizing InSb/InP colloidal…
The 2DNEURALVISION project receives EU funding to develop a novel low-power consumption, adverse weather, low light…
The Horizon Europe project 2DNeuralVision kicked off on 9th – 10th October in Castelldefels, Barcelona. Funded with 5.5 million euros…