Sony Semiconductor Solutions Partners with Ultralytics

ATSUGI, Japan, Nov. 19, 2024 — Sony Semiconductor Solutions has partnered with Ultralytics, a developer of AI-powered vision technology. The partnership will integrate Ultralytics’ YOLOv8 platform with Sony’s IMX500 intelligent vision sensor to enable real-time object detection capabilities on the edge. The integration allows YOLOv8 models to use advanced quantization and pruning techniques for greater efficiency without sacrificing accuracy.

The integration of Ultralytics’ YOLOv8 platform with Sony’s IMX500 intelligent vision software is facilitated by Sony’s AITRIOS software platform, which acts as a bridge between complex AI models and the limitations of edge devices. Courtesy of Sony Semiconductor Solutions.

To facilitate the integration, the partners used on-chip non-maximum suppression to overcome postprocessing bottlenecks. The approach enables postprocessing to occur directly on the sensor, bypassing the need to transfer large amounts of data to a host device. The process quadrupled the performance of the YOLOv8 Nano model, according to Sony senior product manager Amir Servi.

The combination, the companies expect, will bring on-device AI capabilities to enhance real-time decision making for businesses relying on high-performance visual data processing.

There are 439 suppliers of Cameras in the Photonics Marketplace.

CMC Electronics - Advanced Near-Infrared 2024 MR

About Sony Semiconductor Solutions Corp.

Published: November 2024

Glossary

machine vision: Machine vision, also known as computer vision or computer sight, refers to the technology that enables machines, typically computers, to interpret and understand visual information from the world, much like the human visual system. It involves the development and application of algorithms and systems that allow machines to acquire, process, analyze, and make decisions based on visual data. Key aspects of machine vision include: Image acquisition: Machine vision systems use various...
sensor: 1. A generic term for detector. 2. A complete optical/mechanical/electronic system that contains some form of radiation detector.
artificial intelligence: The ability of a machine to perform certain complex functions normally associated with human intelligence, such as judgment, pattern recognition, understanding, learning, planning, and problem solving.
computer vision: Computer vision enables computers to interpret and make decisions based on visual data, such as images and videos. It involves the development of algorithms, techniques, and systems that enable machines to gain an understanding of the visual world, similar to how humans perceive and interpret visual information. Key aspects and tasks within computer vision include: Image recognition: Identifying and categorizing objects, scenes, or patterns within images. This involves training...

Browse Cameras & Imaging, Lasers, Optical Components, Test & Measurement, and more.