top of page

D2: Technologies, devices, circuits, and algorithms for neuromorphic event-based vision system

Event

Dissemination Workshop

​When

13:30 - 18:00

Where

Room 5A

Abstract

The concept of neuromorphic events can be broadened beyond the conventional intensity change detections. For higher-level cognitive tasks, events of varying complexity are refined from simpler ones. The workshop introduces complex-event neuromorphic algorithms co-developed with sensors and computing hardware. Higher-level cognition algorithms operate with lower temporal rates than those designed for reflexes requiring immediate response to sensory data. Data transmission bottlenecks affect where simple events are transformed into more complex ones. Beyond-CMOS devices are widening the capabilities of the system in comparison to CMOS-only solutions. The workshop presents ideas and outcomes from the MISEL EU-project on neuromorphic sensing and computing, with additional insights from acknowledged experts in the field.

Organisers

Ari Paasio (Kovilta Oy, FI), Jacek Flak (VTT Technical Research Centre of Finland, FI)

Dr. Ari Paasio got this D.Sc. (Tech) degree in microelectronics from Helsinki University of Technology in 1999. Since then he has been working on integrated circuit design of massively parallel processors, thermal sensing readout optimization and ultra low-power IoT processors for e.g. medical sensors. He acted as a professor of Microelectronics at University of Turku, Finland, between 2003 and 2020. Since 2021 Paasio has worked full time at Kovilta Oy, a Finnish sensor-processor design company, where Paasio is one of the founders and a partner.

Programme 

13:30 - 13:50

On-Sensor Computer Vision with Pixel-parallel Processor Arrays

Piotr Dudek (University of Manchester, GB)

13:50 - 14:10

Spatiotemporal event processing

Eero Lehtonen (Kovilta Oy, FI)

14:10 - 14:30

Processing and transmitting simple and complex events with high data rates

Mika Laiho (Kovilta Oy, FI) 

14:30 - 14:50

Hybrid neuro-symbolic gesture recognition algorithm for ASIC-based edge devices

Krzysztof Ślot (Lodz University of Technology, PL)

14:50 - 15:10

5-bit Signed SRAM-Based In-Memory Computing CNN CMOS Macro

Victor Brea (University of Santiago de Compostela, ES)

15:10 - 15:30

A Mixed-Signal CMOS Architecture for Massively Parallel Hyperdimensional Computing

Victor Brea (University of Santiago de Compostela, ES)

15:30 - 16:00

Coffee Break

16:00 - 16:20

Technologies, Devices, Circuits: A new value chain for truly 3D Neural Networks

Cristell Maneux (University of Bordeaux, FR)

16:20 - 16:40

CMOS BEOL compatible FeRAM

Lars-Erik Wernersson (Lund University, SE)

16:40 - 17:00

Hybrid colloid quantum dots and metal-insulator-graphene diode for infrared photo sensing applications

Hendrik Schlicke (Fraunhofer-CAN, DE) & Burkay Uzlu (AMO GmbH, DE)

17:00 - 17:20

Demo Session

17:20 - 18:00

Panel Dicussion

Biosketches

Piotr Dudek is a Professor of Circuits and Systems in the Department of Electrical and Electronic Engineering at the University of Manchester. He received his PhD from UMIST (University of Manchester Institute of Science and Technology). He has been a lecturer at The University of Manchester since 2000, a Visiting Associate Professor at Hong Kong University of Science and Technology in 2008/09, a Visiting Professor at Gdansk University of Technology in 2015 and a visiting researcher at Sorbonne University in 2017/18. He was a Royal Academy of Engineering /Leverhulme Trust Senior Research Fellow in 2015/16. He was a Chair of Sensory System Technical Committee of IEEE CAS Society in 2015-17 and Associate Editor of IEEE Transactions on Circuits and Systems II in 2016-17. His expertise is in mixed-signal VLSI chip design, and his main research interest are in neuromorphic and brain-inspired electronics, fine-grain massively parallel computer architectures, cellular processor arrays and vision systems. He has been researching and developing vision sensors, with processing circuits closely integrated within the pixel arrays for over 25 years. He has received best paper awards at IJCNN’07, CNNA’08, CNNA’10, ISCAS’12 and ISCAS’20 and best demo awards at ISCAS’11, ISCAS’14, ICDCS’16, IEEVR’22 and ICCP’22.

 

Eero Lehtonen is a computer vision scientist at Kovilta Oy, Finland. He has received the M.Sc. degree in mathematics, and the D.Sc. degree in electrical engineering from University of Turku, Finland, in 2006 and 2013, respectively. His research focuses on the development of event-based machine vision and sensor fusion algorithms for real-time situational awareness.

 

Mika Laiho is a CTO of Kovilta Oy. He obtained his D.Sc. (Tech) degree in microelectronics from Helsinki University of Technology in 2003. Since then, he has been working on integrated circuit design of image sensors, massively parallel processors including artificial neural networks, and different near sensor computing approaches. In 2008, he became adjunct professor in parallel processing circuits and systems at University of Turku, Finland. He spent the year 2015 as a visiting scholar at Redwood Center for Theoretical Neuroscience, University of California Berkeley. He has authored or co-authored over 100 publications in refereed scientific conferences and journals. His current interests are in exploring and commercializing neuromorphic computing and sensing systems.

 

Krzysztof Ślot is a professor of Computer Science in Lodz University of Technology, Poland. He earned his PhD in 1991 and D.Sc. degree in 2000, both in in Electrical Engineering. He was a post-doctoral researcher at University of California at Berkeley and a visiting Professor at Chonbuk National University, South Korea. His primary research interests are in Machine Learning and Artificial Intelligence.

 

Victor Brea is an associate professor at the University of Santiago de Compostela (USC). His current research interests span from the design of low-power high-performance CMOS vision sensors for classical and deep learning algorithms with their lightweight adaptation to the underlying scarce hardware resources of a chip, up to spatio-temporal neural networks and their applications. In his career, he has been involved in several national projects related to CMOS vision sensors as a principal investigator, as well as an international project with the International Iberian Nanotechnology Laboratory (INL) in Braga (Portugal) within the framework of the Euroregion Spain-Portugal.

 

Cristell Maneux received the M.Sc. degree in electronics engineering and the Ph.D. degree in electronics from the University of Bordeaux, Bordeaux, FR, in 1994 and 1998, respectively. From 1998 to 2012, she has been Associate Professor in IMS Laboratory, Department of Sciences and Engineering, University of Bordeaux, France. Since 2012, she is Professor in the same laboratory, for which she has been the director since January 2022. Her research interests focus on Compact modelling of advanced and emerging devices: InP HBT, SiGe HBT, Carbon NanoTube Transistors, Graphene Transistors, Nanowire Transistors; Device electrical characterization: DC, RF, pulsed, Low Frequency noise, RTS Noise; Device failure mechanisms and integrated circuit reliability; THz integrated devices for Beyond 5G communications; Unconventional nanoelectronics. Currently, she leads the French ANR LEGO project (http://lego.cnrs.fr/), and the European research project FVLLMONTI, call H2020 FETPROACT-09-2020 (https://fvllmonti.eu/). She has co-authored more than 200 publications on high-impact journals and conferences. She serves as Technical Program Committee member and/or reviewer for DATE, EuMW, Euro-SOI, ISCAS, NEWCAS, and ESSDERC. Since 2022, Prof. Maneux is associated editor for IEEE Transaction of Computer Aided Design and since 2020 she is member of the Editorial Advisory Board of Solid-State Electronics. She is also director of the IMS-CEA LETI common lab since 2021 and is member of the steering committee of the IMS-ST Microelectronics common lab since 2006.

 

Lars-Erik Wernersson received the M.S degree the Ph.D. degree in Solid State Physics at Lund University in 1993 and 1998, respectively. Since 2005 he is Professor in Nanoelectronics at Lund University, following a position at University of Notre Dame 2002/2003. His main research topics include nanowire- and tunneling- based nanoelectronic devices and circuits for low-power electronics and wireless communication. He has authored/co-authored more than 200 scientific papers. He has been awarded two individual career grants, and an ERC Advanced Grant and he served as Editor for IEEE Transaction on Nanotechnology. He is founder of Acconeer related to low-power radar technology and NordAmps. 

 

Hendrik Schlicke received his PhD in Chemistry from the University of Hamburg in 2017, working on applications of nanoparticle composites in micro- and nanoelectromechanical systems for sensing applications. Joining the Quantum Materials group at Fraunhofer CAN in 2017 as a leading scientist, his work focuses on nanoparticle-based chemical sensors and optoelectronic devices, such as quantum dot-based photodetectors and light-emitting diodes.

 

Burkay Uzlu received his B.S. and M.S. in Physics from Bilkent University, specializing in graphene-based flexible optoelectronic devices operating in the visible and infrared spectrum. He obtained his Ph.D. degree in 2022 from RWTH Aachen University in Germany, with a focus on graphene-based electronics and optoelectronics devices. Following this, he joined Northwestern University as a postdoctoral researcher, working on 2D materials-based nanodevices. Currently, he is a postdoctoral researcher at AMO GmbH, where his research focuses on the development and characterization of novel electronic and optoelectronic devices based on 2D materials. His research interests include large area scalable fabrication approaches and the exploration of the long-term stability of these devices.

bottom of page