AOMedia Video 1
AOMedia Video 1 (AV1) is an open, royalty-free video coding format designed for video transmissions over the Internet. It is being developed by the Alliance for Open Media (AOMedia), a consortium of leading firms from the semiconductor industry, video on demand providers, and web browser developers, founded in 2015. It is the primary contender for standardisation by the video standard working group NetVC of the Internet Engineering Task Force (IETF). The group has put together a list of criteria to be met by the new video standard. It is meant to succeed its predecessor VP9 and compete with HEVC/H.265 from the Moving Picture Experts Group.
The purpose of AV1 is to be as good as possible under royalty-free patent licensing. Crucial to this objective is therefore to ensure, during development, that it does not infringe on patents of competing companies. This contrasts to its main competitor HEVC, for which IPR review was not part of the standardization process. The latter practice is stipulated in ITU-T's definition of an open standard. The case of HEVC's independent patent pools has been characterized by critical observers as a failure of price management.
Under patent rules adopted from the World Wide Web Consortium (W3C), technology contributors license their AV1-connected patents to anyone, anywhere, anytime based on reciprocity, i.e. as long as the user doesn't engage in patent litigation. As a defensive condition, anyone engaging in patent litigation loses the right to the patents of all patent holders.
It is specifically designed for real-time applications (especially WebRTC) and higher resolutions (wider color gamuts, higher frame rates, UHD) than typical usage scenarios of the current generation (H.264) of video formats where it is expected to achieve its biggest efficiency gains. It is therefore planned to support the color space from ITU-R Recommendation BT.2020 and 10 and 12 bits of precision per color component.
As of April 2017, using the 8 currently enabled experimental features (of 77 total), Bitmovin was able to demonstrate favorable objective metrics, as well as visual results, compared to HEVC on the Sintel and Tears of Steel animated films. A follow-up comparison by Jan Ozer of Streaming Media Magazine confirmed this, and concluded that AV1 is at least as good as HEVC now. Ozer noted that his and Bitmovin's results contradicted a comparison by Fraunhofer Institute for Telecommunications from late 2016 that had found AV1 32.8% less efficient than even AVC, and justified this discrepancy by having used encoding parameters endorsed by each encoder vendor, as well as having more features in the newer AV1 encoder.
AV1 is a traditional block-based frequency transform format featuring new techniques taken from several experimental formats that are testing technology for a next-generation format after HEVC and VP9. Based on Google's experimental VP9 evolution project VP10, it will incorporate additional techniques developed in Xiph's/Mozilla's Daala and Cisco's Thor.
Doing internal processing in higher precision (10 or 12 bits per sample) leads to compression improvement due to smaller rounding errors in reference imagery. For intra prediction, there are more (than 8) angles for directional prediction and weighted filters for per-pixel extrapolation. Temporal prediction can use more references. Prediction can happen for bigger units (≤128×128) and they can be subpartitioned in more ways. Predictions can be combined in more advanced ways (than a uniform average) in a block, including smooth and sharp gradients in different directions. This allows either inter-inter or inter-intra predictions to be combined in the same block. Conventional scalar quantisation with binary arithmetic coding is currently used, inherited from VP9, but experiments are ongoing to investigate other systems including multisymbol coding, and Perceptual Vector Quantization from Daala. Asymmetric Numeral Systems coding is being considered for the entropy coding phase. For the in-loop filtering step it has a deblocking filter and experimental deringing filters from both Thor and Daala.
More encoder parallelism is possible thanks to configurable prediction dependency between tile rows.
The first official announcement of the project came with the press release on the formation of the Alliance. The growing usage of its predecessor VP9 is attributed to confidence in the Alliance and (the development of) AV1 as well as the pricey and complicated licensing situation of MPEG's competitor HEVC.
The roots of the project precede the Alliance, however. Individual contributors started experimental technology platforms years before: Daala already published code in 2010, VP10 was announced on September 12, 2014, and Thor was published on August 11, 2015. The first version 0.1.0 of the AV1 reference codec was published on April 7, 2016.
It is expected that Alliance members have interest in adopting the format, in respective ways, once the bitstream is frozen. The member companies represent several industries, including browser vendors (Google, Mozilla, Microsoft), content providers (Google, Netflix, Amazon) and hardware manufacturers (Intel, AMD, ARM, Nvidia).
Video streaming service YouTube declared intent to transition to the new format as fast as possible, starting with highest resolutions within six months after the finalization of the bitstream format.
Like its predecessor VP9, AV1 will be used together with the WebM and Opus formats. These are well supported among web browsers, with the exception of Safari (desktop and mobile versions) and the discontinued Internet Explorer (prior to Edge) (see VP9 in HTML5 video § browser support).
- Rick Merritt (EE Times), 30 June 2016: Video Compression Feels a Pinch
- Sebastian Grüner (2016-07-19). "Der nächste Videocodec soll 25 Prozent besser sein als H.265" (in German). golem.de. Retrieved 2017-03-01.
- Zimmerman, Steven (15 May 2017). "Google’s Royalty-Free Answer to HEVC: A Look at AV1 and the Future of Video Codecs". XDA Developers. Archived from the original on 14 June 2017. Retrieved 10 June 2017.
- Tsahi Levent-Levi (2015-09-03). "WebRTC Codec Wars: Rebooted". BlogGeek.me. Retrieved 2017-03-01.
The beginning of the end of HEVC/H.265 video codec
- Timothy B. Terriberry (2017-01-18). "Progress in the Alliance for Open Media" (video). linux.conf.au. Retrieved 2017-03-01.
- "Standards are Failing the Streaming Industry". 4 May 2017. Retrieved 20 May 2017.
- Neil McAllister, 1 September 2015: Web giants gang up to take on MPEG LA, HEVC Advance with royalty-free streaming codec – Joining forces for cheap, fast 4K video
- Ozer, Jan (2016-06-03). "What is AV1?". Streaming Media. Information Today, Inc. Archived from the original on 2016-11-26. Retrieved 2016-11-26.
... Once available, YouTube expects to transition to AV1 as quickly as possible, particularly for video configurations such as UHD, HDR, and high frame rate videos ... Based upon its experience with implementing VP9, YouTube estimates that they could start shipping AV1 streams within six months after the bitstream is finalized. ...
- "Bitmovin Supports AV1 Encoding for VoD and Live and Joins the Alliance for Open Media". 18 April 2017. Retrieved 20 May 2017.
- Ozer, Jan. "HEVC: Rating the contenders" (PDF). Streaming Learning Center. Retrieved 22 May 2017.
- D. Grois, T, Nguyen, and D. Marpe, "Coding efficiency comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC encoders", IEEE Picture Coding Symposium (PCS) 2016 
- "Results of Elecard's latest benchmarks of AV1 compared to HEVC". 24 April 2017. Retrieved 14 June 2017.
The most intriguing result obtained after analysis of the data lies in the fact that the developed codec AV1 is currently equal in its performance with HEVC. The given streams are encoded with AV1 update of 2017.01.31
- Sebastian Grüner (2016-06-09). "Freie Videocodecs teilweise besser als H.265" (in German). golem.de. Retrieved 2017-03-01.
- Romain Bouqueau (2016-06-12). "A view on VP9 and AV1 part 1: specifications". GPAC Project on Advanced Content. Retrieved 2017-03-01.
- Jan Ozer, May 26, 2016: What Is VP9?
- Debargha Mukherjee, Hui Su, Jim Bankoski, Alex Converse, Jingning Han, Zoe Liu, Yaowu Xu (Google Inc.), International Society for Optics and Photonics, ed., "An overview of new video coding tools under consideration for VP10 – the successor to VP9", SPIE Optical Engineering+ Applications 9599, doi:10.1117/12.2191104
- Converse, Alex (16 November 2015). "New video coding techniques under consideration for VP10 – the successor to VP9". YouTube. Retrieved 3 December 2016.
- Jean-Marc Valin (Xiph.org/Mozilla), June 6, 2016: Revisiting Daala Technology Demos
- "Decoding the Buzz over AV1 Codec". 9 June 2017. Retrieved 22 June 2017.
- Timothy B. Terriberry (2017-01-18). "Progress in the Alliance for Open Media (slides)" (PDF). Retrieved 22 June 2017.