Feature: What's next for AV over IP?

• Features

• 24/01/2025

When AV over IP first emerged it promised to revolutionise the AV industry, ushering in an era of network convergence and flexibility. With time, the application of AV over IP has increased. But is the technology evolving to ensure that AV over IP continues to deliver on its promise?

What was once a focal point of industry discourse now finds itself in a state of inertia, prompting questions about its future trajectory. With minimal recent product launches, ISE 2024 did not deliver any new AV-over-IP products of note, an important question arises: has the development of AV over IP stalled?

Simon Long, director of technology strategy and transformation at CBRE Singapore, shares his thoughts: “The discourse about AV over IP was significant when the industry pivoted to IP. When big changes like these happen, things often seem quiet for a long time afterwards. What I think is happening behind the scenes now, that many people might not notice, is how network-focused all AV has become by default.”

Long continues: “When we look at systems and hardware coming out, an internet connection is always needed because the industry is moving to a position where they want to add value through cloud software. Even something as simple as an all-in-one camera-speaker bar now requires an internet connection.”

Long poses an interesting paradox. Technology is very firmly migrating to the network. And yet there does not seem to be a big, evident push from manufacturers to innovate and improve the performance of technology on the network.

A place to start looking for innovation is software. Codecs are a core component of AV over IP, but the market seems to have settled on JPEG 2000, H.264/H.265, and proprietary variants as the standard. Is there a need to move beyond these staple codec options?

Codecs: Open vs proprietary

The choice between proprietary and open codecs has long been a topic of discussion among consultants and integrators. While some lean towards the flexibility of open codecs, others advocate for the advantages offered by proprietary solutions. One example would be Crestron Electronics’ proprietary codec, named Pixel Perfect Processing.

Mavis Leung, technical sales manager, Asia, at Crestron Electronics, shares more about this: “JPEG 2000, H.264, or H.265, for instance, each offer a unique trade-off between bandwidth, video quality, and latency. We hence decided to advance the entire technology with the main rationale of enhancing the network video distribution technology. The concept of Pixel Perfect Processing aims to guarantee that our protocol delivers flawless images, aligns with IT standard infrastructures, and streamlines the deployment.”

Proprietary codecs like Crestron’s also offer end users peace of mind when it comes to security concerns in high-profile environments. Leung explains: “Standard codecs or open protocols can susceptibly be decoded by universal decoders from another end. In contrast, DM NVX leverages the most advanced network security technologies, all at the product level. Ensuring security is paramount, especially in government and military facilities, and we are proud that DM NVX is the first and only AV-over-IP solution to receive JITC certification and FIPS 140-2 validation, the US federal government’s two most rigorous security standards. This certification allows DM NVX to be confidently deployed in highly secure information network infrastructures.”

Furthermore, proprietary codecs appear to promise better quality video and image transmission, aiming to replicate visuals closely resembling those perceived by the naked eye. Paul Harris, CEO of Aurora Multimedia, talks about the brand’s proprietary codec, Mimix: “Our codec functions similarly to motion JPEG but incorporates its own unique algorithm that addresses the limitations of JPEG 2000, particularly in delivering certain aspects of image quality. As a result, our codec achieves a commendable compression rate while maintaining image fidelity.”

Another aspect to consider is that standards, according to Harris, often lag in technological advancements compared to non-standardised approaches. He elaborates: “Take, for instance, the progression from MPEG-2 to H.264 and H.265 codecs — it took a long time to get there. Moreover, standards can sometimes limit innovation because you’re trapped into using predetermined capabilities. The bottom line is that while standards provide a foundation, more dynamic and adaptable technologies often involve proprietary solutions that evolve more swiftly to meet changing demands. Even with standards in place, there’s no guarantee of future-proofing. So, it’s more important to focus on the requirements needed with each application and assess the reliability of each manufacturer.”

Recently, Extron unveiled additional features for its PURE3 codec, which claims to be the only codec designed for the pro AV industry capable of delivering pristine video on converged or isolated networks. Joe da Silva, vice president of marketing for Extron, shares more: “The PURE3 codec was purpose-built to exceed the requirements of the pro AV market, surpassing market demands — unlike repurposed codecs from the internet, broadcast, or digital cinema. Our codec delivers lossless 4K60 4:4:4 video over standard IP networks without compromise. Unlike other codecs, it withstands unpredictable network traffic, eliminating the need for costly isolated networks.”

Nevertheless, there are drawbacks associated with proprietary codecs. Long expounds on this: “People realised that at the end of the day, if system A and system B operate via two different proprietary codecs, it becomes less functional for both parties involved. The trade-off that I have historically seen in the world of AV over IP is the more you go down bespoke protocols, the more you limit your options, and the more restricted you become.”

Long illustrates further: “If I’m encoding video onto a proprietary protocol, only another box capable of receiving that protocol can handle the stream without additional steps or boxes. This not only increases costs but also limits where I can send that traffic. However, if I encode that traffic using a standard format like H.265, the possibilities are endless. I could broadcast it anywhere, on any device, as a video stream. This shows how manufacturers might have overlooked the potential of standardised formats when opting to develop proprietary protocols.”

Contrary to its rivals, ZeeVee’s approach differs in that its solutions utilise several different codecs, none of which are proprietary. At the high end, ZeeVee supports uncompressed data transmission over a 10Gb network using SDVoE solutions while other solutions in the ‘compressed’ world feature JPEG 2000, H.264, and MPEG2. Art Weeks, director of product management at ZeeVee, details the brand’s choice to develop open codecs: “We choose to focus on non-proprietary codecs to help promote interoperability among manufacturers. This became a more important feature with customers because of the recent supply chain issues that were brought on by the pandemic.”

Regardless of proprietary or open codecs, ultimately, the priority remains ensuring that the end user enjoys a positive experience with the technology at hand. As technology progresses, there appears to be a race among manufacturers to create ‘cuttingedge’, ‘groundbreaking’ solutions while inadvertently overlooking what genuinely enhances the end user experience.

Long says: “The emergence of new codecs that promise bandwidth reduction, low latency, and enhanced efficiency excites me but I always return to that key point about flexibility and versatility. Sometimes, we get too excited about creating the best of the best features in a product that we forget what a good experience is at baseline.”

Ironically, it seems like the industry has unintentionally created obstacles for itself. Long continues: “Why the industry has we’re making it so complicated and complex that people shy away from it. High-specification technology is great, and works well for those niche, high-performance environments. But we get so engrossed in the high-end detail that we forget that an average person cannot tell the difference between 4:2:2 versus 4:4:4 chroma colour.”

Long concludes the discussion around codecs by laying out the fundamental issue halting progress on the software side of AV over IP: “A codec that gives you greater efficiency and uses less bandwidth requires more CPU and processing power to be able to encode and decode data. This has led to a balancing act between needing less bandwidth but more horsepower. While networks are operating faster, codecs are getting more efficient. What’s really interesting is that we do actually have H.266 but most people don't realise this. If you look at H.266, it halves the rate of bandwidth required with H.265.”

Future-proofing hardware

We have discussed codecs in detail. Let us now switch to hardware. Can AV over IP be improved through nuts-and-bolts innovation?

Recognising that spaces are limited and should be designed with maximum efficiency, Crestron seeks to address challenges faced with bulky hardware. Leung delves into this: “We are exploring ways to address these conditions by determining the most appropriate form factor, which may involve different types of hardware or software. For hardware, we offer a range of products with smaller form factors that do not require internal fans, as well as wall plate versions that are even more compact. Moving forward, Crestron will continue enhancing the flexibility of DM NVX as a platform of video distribution. We are considering launching a software version of DM NVX that can be installed in a Windows environment, which aims to simplify installations by eliminating the need for extra hardware.”

Similarly, Extron recently introduced the NAV E 121, a new compact encoder that occupies a quarter rack-width space and is less than 1U tall. Silva says: “This economical encoder is half the size of our competitors' encoders and comes with our ZipClip 200 for convenient, discrete mounting in a lectern, under a table, or near a camera or any video source.”

Furthermore, sustainability has emerged as a primary concern for many corporate organisations and firms, aligning with efforts to strengthen ESG (environmental, social, and governance) initiatives aimed at minimising harm to the environment. Long shares insights: “Monitoring power consumption and the efficiency of devices versus their functionality is becoming increasingly crucial, if not already a priority. When justifying the need for additional equipment, such as extra boxes, power supplies, cabling, and copper, we must consider factors like recycling and heavy metals usage — viewing technology through an ESG lens.”

Manufacturers play an important role in meeting these demands, and should leverage on these opportunities to add value to their offerings. Long explains: “If a manufacturer were to say, ‘our new boxes could produce the same output while using 30% less power’, it would immediately grab my attention. For a corporate entity contemplating the purchase of a large quantity of such equipment, the prospect of achieving similar or better performance while reducing power consumption by 30% is a compelling incentive. This is a driver that has real-world implications in terms of carbon output and energy savings.”

It appears that manufacturers are indeed heeding these demands and sharing a collective responsibility to ensure that a sustainable future in AV can be attained. Weeks echoes ZeeVee’s commitment to sustainability: “Each successive generation of our products exhibits significantly reduced power consumption compared to its predecessors. Typically, our encoders and decoders consume 75% less power than those of our major competitors and feature power saving modes. Moreover, our products serve multiple functions, thereby conserving power and eliminating the need for additional boxes.”

Similarly, Leung elaborates on how Crestron has pivoted its practices towards greater sustainability: “One of our key initiatives involves adopting PoE technology to streamline power supply across our devices from initial product design phase, regardless of which country the end user is based in. This not only reduces waste by eliminating the need for multiple power adapters and sockets but it also saves costs and halves the installation time.”

Moreover, Extron stands as the first manufacturer to introduce Energy Star qualified commercial audio amplifiers and now offer more than 25 energy-efficient models across their portfolio, which is a testament that it is listening to the needs of end users. Silva elaborates: “Our AV system automation and asset management systems offer technology managers powerful tools to further reduce energy usage. They ensure that room devices are only activated when necessary, while also providing diagnostics and control features to prevent unnecessary technician visits to the room.”

But if we are looking for true, ground-breaking innovation Long has an idea: “I don't think the industry has engaged enough with consultants or end users to define some of the best products in the case of encoders and decoders. If you were to look at the optimum portfolio, it would actually be three boxes — an encoder, a decoder, and an encoder-decoder hybrid. With multiple boxes to manage, it's potentially multiple licenses on your management engine instead of one, two power supplies, two network cables, two network ports, and more. But the actual set of applications where encoding and decoding is required at the same time is less understood. So, there isn’t much impetus to develop a hardware solution that has these capabilities.”

Perhaps manufacturers will take note and get the feedback to their R&D teams?

1Gb or 10Gb?

In the discourse about AV over IP, the choice between 1Gb and 10Gb bandwidth has always sparked debate, often veering into the realms of performance metrics and hardware specifications. Perhaps, it is time to shift the focus to things that really matter. Long says: “We are talking too much about black boxes when we should be talking about applications and user requirements. These questions rarely get asked, and if they do get asked, nobody has the answers. We are in an excellent position right now with general network bandwidth going up and codec efficiency bringing down the processing requirements. What we should be talking about are the benefits that the selected bandwidth provides for the user.”

Long highlights: “When designing a network, there are various different network models we can use, and it all starts with the contention ratio. This considers the traffic that is on the network, the number of sources, the number of users, and much more to determine the performance metrics we want. From there, we can make an educated decision between whether we need 1Gb.”

On the manufacturer end, sales for 1Gb products fare considerably better than 10Gb. Harris details insights into Aurora’s market share: “Our sales for 1Gb products make up at least 90% of our total sales compared to 10Gb. 1Gb codecs have advanced and keep getting better. With 1Gb, the switches and required cabling are less expensive due to the lower bandwidth, making it easier to manage the infrastructure especially when there are multiple switches involved. 10Gb is a bit more challenging especially when moving bandwidth between many switches, and the price is higher. However, when considering applications, that’s where the decision between 1Gb and 10Gb is made.”

Weeks shares insights into ZeeVee’s sales performance: “From an endpoint volume perspective, approximately 60% of units are 1Gb compressed, while 40% are 10Gb uncompressed. There are numerous factors influencing customers’ decisions between 1Gb and 10Gb solutions. Essential considerations such as required image quality and latency rank highly. Additionally, special requirements like multiview and video walls significantly impact the decision-making process. Naturally, the end user’s available budget often plays a decisive role in many instances.”

On the other hand, Crestron has adopted a uniquely different approach, with the brand choosing not to develop 10Gb products. Leung explains why: “We try to design our products based on what clients want and can adopt, which is usually high-quality video quality and security. But there are budget constraints, and 10Gb infrastructures are too costly for many markets. While the demand for data bandwidth is increasing in the IT world, especially for video transmissions, exceeding 10Gb seems unnecessary at the moment.”

It seems like the industry has reached a consensus that 10Gb products have not had their potential fully realised yet, as the market for 10Gb remains incredibly niche and harder to diversify. Harris details: “The applications for 10Gb tend to be more niche at the moment. These include large LED walls, medical, command and control systems, and esports, particularly when latency needs to be at its lowest and image quality needs to be as free of compression as possible. 10Gb also has the benefit of windowing applications as it is a base function of the SDVoE based solutions. There's a cost-value consideration there.”

Silva adds: “Our NAV 10Gb systems are utilised in scenarios where uncompromised lossless video is crucial, such as in medical imaging. Some customers also opt for NAV 10Gb systems when future-proofing their applications is a top priority.”

There are still notable use cases of 10Gb products, as Weeks illustrates: “ZeeVee’s solutions have been deployed in the global training centre for the world's largest energy company, the governing body overseeing global health initiatives, and the largest military museum in North America. Beyond these notable sites, our solutions are also deployed across various other venues such as Sportsbook at Wrigley Field, Oneida Casino, and numerous corporate, higher education, medical, and government agencies, including the US Department of Defense.”

So, how then can businesses choose which network bandwidth to adopt for their organisations? Long notes: “We need to demystify AV over IP, highlighting its real benefits and discussing how it integrates with codecs, hardware, and their network infrastructure. Providing insights into the impact of factors like multicast on traffic can help stakeholders make informed decisions.”

Long concludes: “For integrators, engaging in such conversations early on is important too. By offering value and being involved in the planning process from the outset, they can position themselves as trusted partners and avoid being relegated to the last-minute invite list. Today, businesses understand that their networks are handling more than just laptops and mobile devices; they’re also managing AV equipment, security cameras, VR headsets, and various IOT sensors. Integrators who can assist clients in designing future-ready networks are more likely to be sought after for their expertise, rather than having to chase after business opportunities.”