Computer Vision

Computer vision works with visual data, from a stored image to a camera feed. Common tasks include locating objects, following them across video frames, and estimating body pose. Audio processing is a separate capability. Combining visual and audio information makes a system multimodal.

In episode 70 at 3:39, Neat’s Tormod Ree describes meeting-room systems that combine cameras, microphones, and other sensors. He distinguishes detecting people from the harder task of combining signals across devices to interpret interactions and nonverbal cues.

At 5:22, Ree identifies time sensitivity, privacy, and cost as reasons for processing meeting audio and video on the device. This gives builders two separate questions to test: can the vision model detect what matters, and can the whole system act on that information quickly enough? Accurate detections alone do not establish a responsive meeting experience.