Sony has announced its first Artificial Intelligence (AI) based Edge Analytics system, the REA-C1000, dubbed “the brain†of connected camera and AV setups.
The system analyses camera inputs, automatically extracts the object in focus and combines it with other images in real time on a GPU (Graphics Processor Unit). It uses motion/face detection and colour/shape recognition and is targeted at education, government and corporate organisations .
REA-C1000 will be available in Spring 2019 handwriting extraction and presenter overlay, chroma key-less CG overlay, automatic control of output images such as PTZ auto tracking, focus area cropping and close-up by gesture available as optional extras.
Handwriting extraction and presenter overlay can extract hand-written objects from black and white boards using Sony's moving/unmoving object detection algorithm. This allows audiences to clearly see written content and diagrams, while simultaneously being able to see the gestures and expressions of the presenter. This feature is suited to lecture theatres or remote learning.
Based on Sony's motion detection technology, the REA-C1000's chroma key-less function can extract the presenter and overlay them onto any background without backscreens or specialist training. This is suitable for content like corporate videos, interviews, webinars and e-learning materials. The feature will be made available through a future software update later in 2019.
The REA-C1000 can track a presenter, ensuring they stay in frame and in focus throughout their presentation. This feature is suited to education, corporate and conference settings.
Using focus area cropping, an image from one camera can be simultaneously shown as two different output images. Users can get an overview image in 4K and a cropped image in HD. The cropped area is selectable to be static or dynamic to follow the speaker’s movement. This feature will be made available through a future software update later in 2019.
The REA-C1000 can detect and react to the gestures of audience members, allowing it to show both the whole image and zoomed image in real time. When an audience member stands up, the REA-C1000 can trigger the camera to electronically auto-zoom in to that person, which is useful in education environments to measure students’ reaction and in corporate presentation settings such as during a Q&A session.
Sony’s REA-C1000 will support 4K/HD input and output, and will be able to connect directly to Sony’s PTZ cameras, including its range of XDCAM camcorders. It has an HDMI network connection for integration into AV setups involving either multiple displays, large screen projections with monitors, or live-streaming projects.
Sony will stage an interactive demonstration of the REA-C1000 on its ISE stand - 1.N20 at RAI Amsterdam. ISE runs from February 5 to 8, 2019.