APPLICATIONS

Prophesee’s Metavision® Sensing and Software solutions set a new standard for computer vision

 

We establish new benchmarks in data efficiency, dynamic range, speed and power efficiency. We successfully tackle major computer vision tasks that today pose severe challenges to conventional systems across many fields of application.

Discover below a curated list of public applications, contact us for more information.

INDUSTRIAL AUTOMATION

Industrial processes, Inspection, Monitoring, Object identification, Detection & tracking, Handling, High speed motion control/robotics, AGV

XYT MOTION ANALYSIS

Typical use cases: Movement analysis – Equipment health monitoring – Machine Behavior monitoring

Discover the power of time – space continuity for your application by visualizing your data with our XYT viewer.

See between the frames

Zoom in time and understand fine motion in the scene

ULTRA SLOW MOTION

Typical use cases: Kinematic Monitoring, Predictive Maintenance

Slow down time, down to the time-resolution equivalent of over 200,000+ frames per second, live, while generating orders of magnitude less data than traditional approaches. Understand the finest motion dynamics hiding in ultra fast and fleeting events.

Over 200,000 fps (time resolution equivalent)

OBJECT TRACKING

Typical use cases: Part pick and place – Robot Guidance – Trajectory monitoring

Track moving objects in the field of view. Leverage the low data-rate and sparse information provided by event-based sensors to track objects with low compute power.

Continuous tracking in time: no more “blind spots” between frame acquisitions

Native segmentation: analyze only motion, ignore the static background

OPTICAL FLOW

Typical use cases: Conveyor Speed Measurement – Part/Object Speed Measurement, Trajectory Monitoring, Trajectory Analysis, Trajectory Anticipation

Rediscover this fundamental computer vision building block, but with an event twist. Understand motion much more efficiently, through continuous pixel-by-pixel tracking and not sequential frame by frame analysis anymore.

17x less power compared to traditional image-based approaches 

Get features only on moving objects

HIGH-SPEED COUNTING

Typical use cases: Object counting and gauging – pharmaceutical pill counting – Mechanical part counting 

Count objects at unprecedented speeds, high accuracy, generating less data and without any motion blur. Objects are counted as they pass through the field of view, triggering each pixel independently as the object goes by.

READ MORE

>1,000 Obj/s. Throughput

>99.5% Accuracy @1,000 Obj/s.

SPATTER MONITORING

Typical use cases: Traditional milling, laser & process monitoring, Quality prediction

Track small particles with spatter-like motion. Thanks to the high time resolution and dynamic range of our Event-Based Vision sensor, small particles can be tracked in the most difficult and demanding environment.

Up to 200kHz tracking frequency (5µs time resolution)

Simultaneous XYT tracking  of all particles  

VIBRATION MONITORING

Typical use cases: Motion monitoring, Vibration monitoring, Frequency analysis for predictive maintenance

Monitor vibration frequencies continuously, remotely, with pixel precision, by tracking the temporal evolution of every pixel in a scene. For each event, the pixel coordinates, the polarity of the change and the exact timestamp are recorded, thus providing a global, continuous understanding of vibration patterns.

From 1Hz to kHz range

1 Pixel Accuracy

PARTICLE / OBJECT SIZE MONITORING

Typical use cases: High speed counting, Batch homogeneity & gauging

Control, count and measure the size of objects moving at very high speed in a channel or a conveyor.

Get instantaneous quality statistics in your production line, to control your process.

Up to 500 000 pixels / second speed

99% Counting precision

EDGELET TRACKING

Typical use cases: High speed location, Guiding and fitting for pick & place

Track 3D edges and/or Fiducial markers for your AR/VR application. Benefit from the high temporal resolution of Events to increase accuracy and robustness of your edge tracking application.

Automated 3D object detection with geometrical prior

3D object real-time tracking

VELOCITY & FLUID MONITORING

Typical use cases: Fluid dynamics monitoring, Continous process monitoring of liquid flow 

CABLE / YARN VELOCITY & SLIPPING MONITORING

Typical use cases: Yarn quality control, Cable manufacturing monitoring

PLUME MONITORING

Typical use cases: Dispensing uniformity & Coverage control, Quality & efficiency of dispersion, Fluid dynamics analysis for inline process monitoring

IoT & SURVEILLANCE

Motion detection and analysis, Intruder detection, Traffic data acquisition, Crowd management, People counting, Always-on visual input, Gesture Detection, Simultaneous Localization And Mapping

CROWD DETECTION AND TRACKING

GESTURE DETECTION

VISUAL ODOMETRY

TRAFFIC DATA ACQUISITION

AUTOMOTIVE & MOBILITY

Autonomous driving, Emergency breaking assist, Driver assistance, Collision avoidance, Pedestrian protection, Occupant identification and classification, Driver Monitoring Systems

Xperi

World-first in-cabin monitoring technologies running on neuromorphic camera systems.   

Leveraging event input from Prophesee’s Metavision sensing technologies, DTS, Inc. from Xperi Corporation developed a world-first neuromorphic driver monitoring solution (DMS), powered by Prophesee Metavision® Event-Based Vision sensor. With better low light performance for driver monitoring features as well as never seen before capabilities such as saccadic eye movement or micro-expressions monitoring, it is a breakthrough in next-generation in-cabin experiences and safety.

READ MORE

Xperi

Advanced Event-Based Vision driver assisted systems 

VoxelFlow™ developed by Terranet AB in conjunction with Mercedes-Benz, uses Prophesee Metavision® Event-Based Vision sensor so that autonomous driving (AD) and advanced driver-assistance systems (ADAS) can quickly and accurately understand and decipher what’s in front of them, enhancing existing radar, lidar, and camera systems that particularly struggle within 30 to 40 meters, when an accident is most likely to take place. 

READ MORE

HIGH-SPEED DETECTION AND TRACKING

FLICKERING LED DETECTION

HIGH DYNAMIC RANGE

LOW LIGHT

HIGH DYNAMIC RANGE DETECTION AND TRACKING

MEDICAL

Live sample sterility testing for gene therapy, Vision restoration, Blood cell tracking

VISION RESTORATION – by GENSIGHT BIOLOGICS

Nature Medicine published the first case report of partial recovery of visual function in a blind patient with late stage retinitis pigmentosa (RP). The patient is the subject of the ongoing trial of GenSight Biologics’ GS030 optogenetic therapy. 

The study combines gene therapy with a light-stimulating medical device in the form of goggles that uses Prophesee Metavision® Sensor.

“The light-stimulating goggles capture images from the visual world using a neuromorphic camera that detects changes in intensity, pixel by pixel, as distinct events.”

READ MORE