Opportunities and Challenges IP-SOC DAYS Shanghai - Sep 13 th 2018 - PowerPoint PPT Presentation

Implementing AV1 video IPs Opportunities and Challenges IP-SOC DAYS Shanghai - Sep 13 th 2018 www.allegrodvt.com

Allegro DVT Overview ❑ Founded in 2003, privately owned, based in Grenoble (France) ❑ Strong and recognized expertise in video compression standards ❑ 2 product lines ▪ CS: Compliance Streams ▪ IP: Video compression and decompression IPs IP product line CS product line ❑ ❑ Industry de-facto standard video Leading semiconductor video compression compliance streams and decompression IPs 2

Compliance Streams Product Line ❑ H.264/AVC , H.265/HEVC , AVS2 , Elementary streams System streams VP9 and AV1 compliance streams, AV1 DVB-HEVC AVS2 DVB-T allowing extensive testing of video H.264 / AVC DVB-IP decoders H.264 / MVC | SVC DVB-3D ❑ Syntax, performance and error H.265 / HEVC ATSC resilience streams HEVC Rext ISDB SHVC | MV-HEVC HDR ❑ System compliance streams HEVC-SCC VP9 Most Extensive Compliance Streams Portfolio in the Industry More than 100 world-class customers • 3

Video IPs Product Line ❑ Multi-format encoder IP for ✓ Best-in-class video quality ▪ H.264, H.265, VP9, JPEG, AV1 ❑ Multi-format decoder IP for ✓ Ultra-low latency ▪ H.264, H.265, VP9, JPEG, AV1 ❑ WiGig IEEE 802.11ad WDE ✓ Minimal silicon area CODEC IP ✓ Scalability through ▪ multi-core architecture and ▪ selectable video codecs JPEG 10+ years of experience in high quality H.264/H.265/VP9 IPs • 4

Worldwide Customer Base 5

Alliance for Open Media ❑ Alliance formed in September 2015 ❑ Members across the entire ecosystem ▪ Browser vendors, content providers, hardware vendors… 6

AV1 Codec ✓ Next-generation video format ✓ Royalty-Free ▪ Interoperable and open ✓ Target Improvement of 30% over VP9/HEVC ▪ with reasonable increases in encoding and playback complexity ✓ Optimized for the web ✓ Scalable to any modern device at any bandwidth ✓ Flexible for both commercial and non-commercial content ▪ including user-generated content 7

AV1 Complexity ❑ AV1 adds a new level of complexity compared to previous codecs ▪ Number and type of transform sizes 64x32 16x64 64x64 ▪ Number and types of intra/inter prediction modes 32x64 …. 128x128 ▪ New features : warped motion… 16x64 ▪ Superblock size Superblock transforms ❑ Significant SW processing overhead, however: ▪ SW complexity different from HW complexity ▪ SW to be optimized by AOM Warped motion HW acceleration is needed to address AV1 encoding complexity 07/09/2018 8

Multi-format architecture ❑ Take advantage from resource sharing between codecs ▪ AVC, HEVC, VP9, and now AV1 HEVC AVC Multi-Standard ▪ In a single IP logic logic memory memory logic VP9 AV1 memory logic logic memory memory ❑ Leverage similarities in Codec algorithms ▪ Intra prediction o VP9 close to AVC o AV1 close to HEVC ▪ Transform o AV1 close to VP9 07/09/2018 9

Multi-core architecture ❑ Scalable architecture ▪ Baseline optimized for smaller resolutions ▪ Adding cores enables higher performance points (resolutions and frame rates) Performance scaling Nx Baseline 4x Baseline 2x Baseline Baseline performance Area 07/09/2018 10

Conclusions ❑ AV1 is a cutting edge, next generation codec ▪ Backed by major video industry players ▪ Expected to play a major role in online video industry ❑ HW acceleration is needed to tackle encoding complexity ❑ Chip vendors need to choose Multi-Format and Scalable encoder IPs to ▪ ensure implementation flexibility ▪ customize IP configuration for target applications 07/09/2018 11

12