Prophesee, Qualcomm Collaborate on Mobile Device Imaging

Vision systems developer Prophesee has launched a collaboration with Qualcomm Technologies to optimize its event-based Metavision sensors for use with premium Snapdragon mobile platforms from Qualcomm. The collaboration aims to bring the speed, efficiency, and quality of neuromorphic-enabled vision to mobile devices, and it will provide mobile device developers a fast and efficient way to leverage the Prophesee sensor’s ability to improve camera performance, particularly in fast-moving scenes and in low light.

Prophesee and Qualcomm Technologies Inc. collaborated to bring the speed, efficiency, and quality of neuromorphic-enabled vision — Prophesee’s technology offering — to mobile devices. The technical and business collaboration will provide mobile device developers a fast and efficient way to leverage the Prophesee sensor’s ability to improve camera performance, particularly in fast-moving dynamic scenes and in low light. Courtesy of Prophesee.

Prophesee’s sensors differ from traditional image capture technology by focusing only on changes in a scene, pixel by pixel, continuously, and at extreme speeds. Each pixel in the Metavision sensor embeds a logic core, enabling it to act as a neuron. The technology enables the acquisition speed to always match actual scene dynamics. High-performance event-based deblurring is achieved by synchronizing a frame-based sensor and Prophesee’s event-based sensor. The system then fills the gaps between and inside the frames with microsecond events to algorithmically extract pure motion information and repair motion blur.

Prophesee said it is working to create a development kit to support the integration of the Metavision sensor technology for use in devices containing next-generation Snapdragon platforms. The kit is expected to be available later this year.