Workshop on SMLM with event-based vision sensors

When: August 29th, 14:10-15:10
Where: Main auditorium, SMLMS2024
Related preprint: Weber et al., bioRxiv, 2024
Related software: EVE

Description: Event-based vision sensors (EBSs), also known as neuromorphic vision sensors, are affordable commercially-available matrices of independent, asynchronous pixels sensitive to intensity variations. Unlike cameras, which integrate photons during a fixed exposure time to generate an image, each pixel of an EBS returns a signal only in response to light changes, providing a list of locations with a timestamp plus information on whether the intensity went up or down.

Since the response time of the pixels of an EBS is typically much faster than the minimum exposure time of sCMOS or EMCCD cameras, EBSs hold great potential to circumvent many of the limitations of SMLM, especially in terms of temporal resolution.

We have recently successfully used an EBS in SMLM experiments—which we call Eve-SMLM—showing that we could achieve spatial resolution and image quality on par with standard cameras. We also showed the benefits of using EBSs for imaging densely labeled samples: the EBS reduces the spatiotemporal density of the signal, allowing us to work under conditions with emitters too dense to localize single fluorophores with standard cameras, and therefore increasing the speed of data collection [1].

In this workshop, we aim at democratize the use of EBS technology for SMLM applications. We will describe in detail the working principle of such event-based sensor, letting the participants have a hands-on experience on how the sensor works. We will explain how data acquisition and processing are achieved in practice in an Eve-SMLM experiment. Finally, we will present and use, together with the participants, a dedicated software, EVE, which we have developed to handle, treat and analyze Eve-SMLM data for super-resolution imaging and reconstruction [2]. Finally, we will discuss the limitations, potential and promises of Eve-SMLM for future super-resolution microscopy and beyond.

[1] Cabriel et al., Nat. Photon. 17 (2023) https://doi.org/10.1038/s41566-023-01308-8
[2] Weber et al., bioRxiv, (2024) https://doi.org/10.1101/2024.08.09.607224