AOMedia Video 1 (AV1) is an open, royalty-free video coding format designed for video transmissions over the Internet. It is being developed by the Alliance for Open Media (AOMedia), a consortium of leading firms from the semiconductor industry, video on demand providers, and web browser developers, founded in 2015. It is the primary contender for standardisation by the video standard working group NetVC of the Internet Engineering Task Force (IETF).[1] The group has put together a list of criteria to be met by the new video standard.[2] It is meant to replace Google's VP9 and compete with HEVC/H.265 from the Moving Picture Experts Group.

AV1 can be used together with the audio format Opus in a future version of the WebM format for HTML5 web video and WebRTC.[3]

Contents

FeaturesEdit

The main distinguishing feature is its royalty-free (patent) licensing terms that set it apart, notably from its main competitor HEVC with its complicated and costly software patent licensing situation. Whether it can be convincingly argued that it does not infringe on patents of competing companies is seen as crucial for the chances for widespread adoption. Under patent rules adopted from the World Wide Web Consortium (W3C), technology contributors license their AV1-connected patents to anyone, anywhere, anytime based on reciprocity, i.e. as long as the user on his part doesn't engage in patent litigations.[4]

It aims for state of the art performance with a noticeable compression efficiency advantage at only slightly increased coding complexity. The efficiency goal is 25% improvement over HEVC.[2] At the beginning of June 2016 its performance was already comparable to HEVC as measured using the objective metric PSNR-HVS-M.[5]

It is specifically designed for real-time applications (especially WebRTC) and higher resolutions (wider color gamuts, higher frame rates, UHD) than typical usage scenarios of the current generation (H.264) of video formats where it is expected to achieve its biggest efficiency gains. It is therefore planned to support the color space from ITU-R Recommendation BT.2020 and 10 and 12 bits of precision per color component.[6]

TechnologyEdit

 
AV1 introduces "T-shaped" partitioning schemes for coding units, a feature from VP10

AV1 is a traditional block-based frequency transform format featuring new techniques taken from several experimental formats that are testing technology for a next-generation format after HEVC and VP9.[7] Based on Google's experimental VP9 evolution project VP10,[8] it will incorporate additional techniques developed in Xiph's/Mozilla's Daala and Cisco's Thor.

Doing internal processing in higher precision (10 or 12 bits per sample) leads to compression improvement due to smaller rounding errors in reference imagery. For intra prediction, there are more (than 8) angles for directional prediction and weighted filters for per-pixel extrapolation. Temporal prediction can use more references. Prediction can happen for bigger units (≤128×128) and they can be subpartitioned in more ways. Predictions can be combined in more advanced ways (than a uniform average) in a block, including smooth and sharp gradients in different directions. This allows either inter-inter or inter-intra predictions to be combined in the same block.[9][10] Conventional scalar quantisation with binary arithmetic coding is currently used, inherited from VP9, but experiments are ongoing to investigate other systems including mutisymbol coding, and Perceptual Vector Quantization from Daala.[11] Asymmetric Numeral Systems coding is being considered for the entropy coding phase.[12] For the in-loop filtering step it has a deblocking filter and experimental deringing filters from both Thor and Daala.

The Alliance publishes a reference implementation written in C and assembly language (aomenc, aomdec) as free software under the terms of the BSD 2-Clause License.[13]

HistoryEdit

The first official announcement of the project came with the press release on the formation of the Alliance. The growing usage of its predecessor VP9 is attributed to confidence in the Alliance and (the development of) AV1 as well as the pricey and complicated licensing situation of MPEG's competitor HEVC.[14]

The roots of the project precede the Alliance, however. Individual contributors started experimental technology platforms years before: Daala already published code in 2010, VP10 was announced on September 12, 2014, and Thor was published on August 11, 2015. The first version 0.1.0 of the AV1 reference codec was published on April 7, 2016.

The bitstream format is projected to be frozen in Q4 of 2017.[15] First compatible hardware components are expected to become available within 12 months after that.

AdoptionEdit

Most browsers, with two major exceptions (Internet Explorer and Safari, see HTML5 video § browser support), already support AV1's predecessor VP9 and associated WebM and Opus formats that will continue to be used with AV1.

Video streaming service YouTube declared intent to transition to the new format as fast as possible, starting with highest resolutions within six months after the finalization of the bitstream format.[6]

Companies from within the Alliance (AMD, ARM, Intel, Nvidia) are working on hardware support for decoding and encoding AV1.[6]

ReferencesEdit

  1. ^ Rick Merritt (EE Times), 30 June 2016: Video Compression Feels a Pinch
  2. ^ a b Sebastian Grüner (2016-07-19). "Der nächste Videocodec soll 25 Prozent besser sein als H.265" (in German). golem.de. Retrieved 2017-03-01. 
  3. ^ Tsahi Levent-Levi (2015-09-03). "WebRTC Codec Wars: Rebooted". BlogGeek.me. Retrieved 2017-03-01. The beginning of the end of HEVC/H.265 video codec 
  4. ^ Neil McAllister, 1 September 2015: Web giants gang up to take on MPEG LA, HEVC Advance with royalty-free streaming codec – Joining forces for cheap, fast 4K video
  5. ^ Sebastian Grüner (2016-06-09). "Freie Videocodecs teilweise besser als H.265" (in German). golem.de. Retrieved 2017-03-01. 
  6. ^ a b c Ozer, Jan (2016-06-03). "What is AV1?". Streaming Media. Information Today, Inc. Archived from the original on 2016-11-26. Retrieved 2016-11-26. ... Once available, YouTube expects to transition to AV1 as quickly as possible, particularly for video configurations such as UHD, HDR, and high frame rate videos ... Based upon its experience with implementing VP9, YouTube estimates that they could start shipping AV1 streams within six months after the bitstream is finalized. ... 
  7. ^ Romain Bouqueau (2016-06-12). "A view on VP9 and AV1 part 1: specifications". GPAC Project on Advanced Content. Retrieved 2017-03-01. 
  8. ^ Jan Ozer, May 26, 2016: What Is VP9?
  9. ^ Debargha Mukherjee, Hui Su, Jim Bankoski, Alex Converse, Jingning Han, Zoe Liu, Yaowu Xu (Google Inc.), International Society for Optics and Photonics, ed., "An overview of new video coding tools under consideration for VP10 – the successor to VP9", SPIE Optical Engineering+ Applications 9599, doi:10.1117/12.2191104 
  10. ^ Converse, Alex (16 November 2015). "New video coding techniques under consideration for VP10 – the successor to VP9". YouTube. Retrieved 3 December 2016. 
  11. ^ Jean-Marc Valin (Xiph.org/Mozilla), June 6, 2016: Revisiting Daala Technology Demos
  12. ^ https://aomedia.googlesource.com/aom/+/master/aom_dsp/ans.h
  13. ^ https://aomedia.googlesource.com/aom/+/master/LICENSE
  14. ^ Timothy B. Terriberry (2017-01-18). "Progress in the Alliance for Open Media" (video). linux.conf.au. Retrieved 2017-03-01. 
  15. ^ https://fosdem.org/2017/schedule/event/om_av1/

External linksEdit