PhD Studentship: A Multi-spectral Single Photon Sensor for Enhanced 3D Vision

Principal Supervisor: Istvan Gyongy

Assistant Supervisor: Alistair Gorman

Project description 

Autonomous systems such as self-driving cars are increasingly relying on LIDAR systems for robust environmental perception, with single-photon avalanche diode (SPAD) sensors, which detect and time individual photons of light, being one of the key underlying technologies. In recent years, large array format SPADs have emerged, with integrated digital processing to provide 3D imaging in a compact form factor. However, challenges remain in the detection and classification of long-range objects, especially under high ambient light levels.

This project aims to develop a single-photon LIDAR system that operates at multiple wavelengths, as opposed to conventional single-wavelength systems, and as such provides enhanced perception and ambient light suppression. To this end, system-level integration will be undertaken of existing SPAD arrays with suitable optics and customised laser sources. A microcontroller or FPGA will be used to interface to a computer for real-time acquisition. There will also be a focus on developing neural network models for enhanced object detection, tailored to the multispectral single-photon data. In addition to LIDAR, there will be opportunities to explore life sciences applications of the resulting imaging system.

The project is funded by Sony and will involve close engagement with Sony Europe Technology Development Center (EUTDC) in Trento, Italy, with the results of the project potentially informing the design of future SPAD sensors. The project would suit candidates with a background in Electronics/Computer Science and strong interest in image sensor technology and AI-based image processing, as well as a readiness to conduct physical experiments.

Further Information:

References:

[1] O. Kumagai et al., (2021), A 189×600 Back-Illuminated Stacked SPAD Direct Time-of-Flight Depth Sensor for Automotive LiDAR Systems, ISSCC 2021, https://doi.org/10.1109/ISSCC42613.2021.9365961

[2] Taher J et al. (2022), Feasibility of Hyperspectral Single Photon Lidar for Robust Autonomous Vehicle Perception. Sensors, 22(15). https://doi.org/10.3390/s22155759

Funding is available for this project: 

Tuition fees + stipend are available for Home/EU and International students

Home Students:

To qualify as a Home student, you must fulfil one of the following criteria:

• You are a UK student
• You are an EU student with settled/pre-settled status who also has 3 years residency in the UK/EEA/Gibraltar/Switzerland immediately before the start of your Programme. (International students not eligible.)

Eligibility

• a 2:1 undergraduate degree (or equivalent).
• the University’s English language requirements.

An undergraduate degree at 2:1 or above (or international equivalent) in a relevant science or engineering discipline, possibly supported by an MSc degree.

Contact email: istvan.gyongy@ed.ac.uk

Advert information