Open main menu

AOMedia Video 1 (AV1) is an open, royalty-free video coding format designed for video transmissions over the Internet. It was developed by the Alliance for Open Media (AOMedia), a consortium of firms from the semiconductor industry, video on demand providers, video content producers, software development companies and web browser vendors, founded in 2015. The AV1 bitstream specification includes a reference video codec.[2] It succeeds VP9. It can have 20% higher data compression than VP9 or HEVC/H.265 from the Moving Picture Experts Group and about 50% higher than the widely used AVC.[3][4]

AV1 logo 2018.svg
Developed byAlliance for Open Media
Initial release28 March 2018; 16 months ago (2018-03-28)
Latest release
1.0.0 Errata 1[1]
(9 January 2019; 7 months ago (2019-01-09))
Type of formatVideo compression format
Contained by
Extended from
StandardAOM AV1
Open format?Yes
Websiteaomedia.org

AV1 was announced with the creation of the Alliance for Open Media on 1 September 2015.[5] Google, Mozilla and Cisco already had ongoing research projects into royalty-free video at this time, namely VP10, Daala and Thor.[5]

AV1 is intended for use in HTML5 web video and WebRTC together with the Opus audio format.[6] AV1-based containers have also been proposed as a replacement for JPEG, similar to Better Portable Graphics and High Efficiency Image File Format which wrap HEVC.[7]

Contents

HistoryEdit

The official announcement of AV1 came with the press release on the formation of the Alliance for Open Media on 1 September 2015. The Alliance's seven founding members – Amazon, Cisco, Google, Intel, Microsoft, Mozilla and Netflix – announced that the initial focus of the video format would be delivery of high-quality web video.[5][8] The Alliance's motivations for creating AV1 included the high cost and uncertainty involved with the patent licensing of HEVC, the MPEG-designed codec expected to succeed AVC.[9][10][11] According to Microsoft's Ian LeGrow, an open-source, royalty-free technology was seen as the easiest way to eliminate this uncertainty around licensing.[9]

The negative effect of patent licensing on free and open-source software has also been cited as a reason for the creation of AV1.[10] For example, building a H.264 implementation into Firefox would prevent it from being distributed free of charge since licensing fees would have to be paid to MPEG-LA.[12][13] Free Software Foundation Europe has argued that FRAND patent licensing practices make the free software implementation of standards impossible due to various incompatibilities with free software licenses.[14]

Individual contributors started experimental technology platforms years before: Xiph's/Mozilla's Daala already published code in 2010, Google's experimental VP9 evolution project VP10 was announced on 12 September 2014,[15] and Cisco's Thor was published on 11 August 2015. Building on the codebase of VP9, AV1 incorporates additional techniques, several of which were developed in these experimental formats.[16][17] The first version 0.1.0 of the AV1 reference codec was published on 7 April 2016.

The bitstream format was projected to be frozen in January 2018;[18] however, this was delayed due to unresolved critical bugs as well as last changes to transformations, syntax, the prediction of motion vectors, and the completion of legal analysis.[19] The Alliance announced the release of the AV1 bitstream specification on 28 March 2018, along with a reference, software-based encoder and decoder.[20][21][22] On 25 June 2018, a validated version 1.0.0 of the specification was released.[23] On 8 January 2019 a validated version 1.0.0 with Errata 1 of the specification was released.[24]

Martin Smole from AOM member Bitmovin said that the computational efficiency of the reference encoder was the greatest remaining challenge after the bitstream format freeze.[25] While still working on the format, the encoder was not targeted for productive use and didn't receive any speed optimizations. Therefore, it worked orders of magnitude slower than e.g. existing HEVC encoders. Development was shifted its focus towards maturing the reference encoder after the freeze. In March 2019, it was reported that the speed of the reference encoder was much faster, close to or within the same order of magnitude as usual encoders for other common formats.[26]

TechnologyEdit

AV1 is a traditional block-based frequency transform format featuring new techniques. Based on Google's VP9,[27] AV1 incorporates additional techniques that mainly give encoders more coding options to enable better adaption to different types of input.

 
Processing stages of an AV1 encoder with relevant technologies associated with each stage.
libaom
 
Developer(s)Alliance for Open Media
Repository  
Written inC, assembly
LicenseFreeBSD (free)
Websiteaomedia.googlesource.com/aom

The Alliance published a reference implementation written in C and assembly language (aomenc, aomdec) as free software under the terms of the BSD 2-Clause License.[28] Development happens in public and is open for contributions, regardless of AOM membership.

The development process was such that coding tools were added to the reference codebase as experiments, controlled by flags that enable or disable them at build time, for review by other group members as well as specialized teams that helped with and ensured hardware friendliness and compliance with intellectual property rights (TAPAS). When the feature gained some support in the community, the experiment was enabled by default, and ultimately had its flag removed when all of the reviews were passed.[29] Experiment names were lowercased in the configure script and uppercased in conditional compilation flags.[30]

To better and more reliably support HDR and color spaces, corresponding metadata can now be integrated into the video bitstream instead of being signaled in the container.

PartitioningEdit

 
10 ways for subpartitioning coding units – into squares (recursively), rectangles, or mixtures thereof ("T-shaped").

Frame content is separated into adjacent same-sized blocks referred to as superblocks. Similar to the concept of a macroblock, superblocks are square-shaped and can either be of size 128×128 or 64×64 pixels. Superblocks can be divided in smaller blocks according to different partitioning patterns. The four-way split pattern is the only pattern whose partitions can be recursively subdivided. This allows superblocks to be divided into partitions as small as 4×4 pixels.

 
Diagram of the AV1 superblock partitioning. It shows how 128×128 superblocks can be split all the way down to 4×4 blocks. As special cases, 128×128 and 8×8 blocks can't use 1:4 and 4:1 splits, and 8×8 blocks can't use "T"-shaped splits.

"T-shaped" partitioning patterns are introduced, a feature developed for VP10, as well as horizontal or vertical splits into four stripes of 4:1 and 1:4 aspect ratio. The available partitioning patterns vary according to the block size, both 128×128 and 8×8 blocks can't use 4:1 and 1:4 splits. Moreover, 8×8 blocks can't use "T" shaped splits.

Two separate predictions can now be used on spatially different parts of a block using a smooth, oblique transition line (wedge-partitioned prediction).[31] This enables more accurate separation of objects without the traditional staircase lines along the boundaries of square blocks.

More encoder parallelism is possible thanks to configurable prediction dependency between tile rows (ext_tile).[32][33]

PredictionEdit

AV1 performs internal processing in higher precision (10 or 12 bits per sample), which leads to compression improvement due to smaller rounding errors in reference imagery.

Predictions can be combined in more advanced ways (than a uniform average) in a block (compound prediction), including smooth and sharp transition gradients in different directions (wedge-partitioned prediction) as well as implicit masks that are based on the difference between the two predictors. This allows combination of either two inter predictions or an inter and an intra prediction to be used in the same block.[34][31]

A frame can reference 6 instead of 3 of the 8 available frame buffers for temporal (inter) prediction while providing more flexibility on bi-prediction[35] (ext_refs[36]).

Warped motion as seen from the front of a train.

The Warped Motion (warped_motion[37])[33] and Global Motion (global_motion[38]) tools in AV1 aim to reduce redundant information in motion vectors by recognizing patterns arising from camera motion.[32][33] They implement ideas that were tried to be exploited in preceding formats like e.g. MPEG-4 ASP, albeit with a novel approach that works in three dimensions. There can be a set of warping parameters for a whole frame offered in the bitstream, or blocks can use a set of implicit local parameters that get computed based on surrounding blocks.

Switch frames (S-frame) are a new inter-frame type that can be predicted using already decoded reference frames from a higher-resolution version of the same video to allow switching to a lower resolution without the need for a full keyframe at the beginning of a video segment in the adaptive bitrate streaming use case.[39]

Intra PredictionEdit

Intra prediction consists of predicting the pixels of a given blocks only using information available in the current frame. Most often, intra predictions are built from the neighboring pixels above and to the left of the predicted block. The DC predictor builds a prediction by averaging the pixels above and to the left of block.

Directional predictors extrapolate these neighboring pixels according to a specified angle. In AV1, 8 main directional modes can be chosen. These modes start at an angle of 45 degrees and increase by a step size of 22.5 degrees up until 203 degrees. Furthermore, for each directional mode, six offsets of 3 degree can be signalled for bigger blocks, three above the main angle and three below it, resulting in a total of 56 angles (ext_intra).

The "TrueMotion" predictor got replaced with a Paeth predictor which looks at the difference from the known pixel in the above left corner to the pixel directly above and directly left of the new one and then chooses the one that lies in direction of the smaller gradient as predictor. A palette predictor is available for blocks with very few (up to 8, dominant) colors like in some computer screen content. Correlations between the luminosity and the color information can now be exploited with a predictor for chroma blocks that is based on samples from the luma plane (cfl).[33] In order to reduce discontinuities along borders of inter-predicted blocks, predictors can be overlapped and blended with those of neighbouring blocks (overlapped block motion compensation). [40]

Data transformationEdit

To transform the error remaining after prediction to the frequency domain, AV1 encoders can use square, 2:1/1:2, and 4:1/1:4 rectangular DCTs (rect_tx[41]),[42][35] as well as an asymmetric DST[43][44][45] for blocks where the top and/or left edge is expected to have lower error thanks to prediction from nearby pixels, or choose to do no transform (identity transform).

It can combine two one-dimensional transforms in order to use different transforms for the horizontal and the vertical dimension (ext_tx[46]).[33][35]

QuantizationEdit

AV1 has new optimized quantization matrices (aom_qm).[47] The eight sets of quantization parameters that can be selected and signaled for each frame now have individual parameters for the two chroma planes and can use spatial prediction. On every new superblock, the quantization parameters can be adjusted by signaling an offset.

FiltersEdit

For the in-loop filtering step, the integration of Thor's constrained low-pass filter and Daala's directional deringing filter has been fruitful: The combined Constrained Directional Enhancement Filter (cdef[48]) exceeds the results of using the original filters separately or together.[49][50] It is an edge-directed conditional replacement filter that smoothes blocks with configurable (signaled) strength roughly along the direction of the dominant edge to eliminate ringing artifacts.

There is also the loop restoration filter (loop_restoration) based on the Wiener filter and self-guided restoration filters to remove blur artifacts due to block processing.[33]

Film grain synthesis (film_grain) improves coding of noisy signals using a parametric video coding approach. Due to the randomness inherent to film grain noise, this signal component is traditionally either very expensive to code or prone to get damaged or lost, possibly leaving serious coding artefacts as residue. This tool circumvents these problems using analysis and synthesis, replacing parts of the signal with a visually similar synthetic texture, based solely on subjective visual impression instead of objective similarity. It removes the grain component from the signal, analyzes its non-random characteristics, and instead transmits only descriptive parameters to the decoder, which adds back a synthetic, pseudorandom noise signal that's shaped after the original component. It is the visual equivalent of the Perceptual Noise Substitution technique used in AC3, AAC, Vorbis, and Opus audio codecs.

Entropy codingEdit

Daala's entropy coder (daala_ec[51][52]), a non-binary arithmetic coder, was selected for replacing VP9's binary entropy coder. The use of non-binary arithmetic coding helps evade patents, but also adds bit-level parallelism to an otherwise serial process, reducing clock rate demands on hardware implementations.[53] This is to say that the effectiveness of modern binary arithmetic coding like CABAC is being approached using a greater alphabet than binary, hence greater speed, as in Huffman code (but not as simple and fast as Huffman code). AV1 also gained the ability to adapt the symbol probabilities in the arithmetic coder per coded symbol instead of per frame (ec_adapt[54]).[33][13]

Quality and efficiencyEdit

A first comparison from the beginning of June 2016[55] found AV1 roughly on par with HEVC, as did one using code from late January 2017.[56]

In April 2017, using the 8 enabled experimental features at the time (of 77 total), Bitmovin was able to demonstrate favorable objective metrics, as well as visual results, compared to HEVC on the Sintel and Tears of Steel animated films.[57] A follow-up comparison by Jan Ozer of Streaming Media Magazine confirmed this, and concluded that "AV1 is at least as good as HEVC now".[58]

Ozer noted that his and Bitmovin's results contradicted a comparison by Fraunhofer Institute for Telecommunications from late 2016[59] that had found AV1 38.4% less efficient than HEVC, underperforming even H.264/AVC, and justified this discrepancy by having used encoding parameters endorsed by each encoder vendor, as well as having more features in the newer AV1 encoder.

Tests from Netflix showed that, based on measurements with PSNR and VMAF at 720p, AV1 was about 25% more efficient than VP9 (libvpx).[60] Similar conclusions with respect to quality were drawn from a test conducted by Moscow State University researchers, where VP9 was found to require 31% and HEVC 22% more bitrate than AV1 for the same level of quality.[61] The researchers found that the used AV1 encoder was operating at a speed "2500–3500 times lower than competitors", while admitting that it has not been optimized yet.[62]

In a comparison of AV1 against H.264 (x264) and VP9 (libvpx), Facebook showed about 45–50% bitrate savings over H.264 and about 40% over VP9 when using a constant quality encoding mode.[63]

Decoding performance was at about half the speed of VP9 according to internal measurements from 2017.[39]

AOMedia provides a list of test results on their website.

Profiles and levelsEdit

ProfilesEdit

AV1 defines three profiles for decoders which are Main, High, and Professional. The Main profile allows for a bit depth of 8- or 10-bits per sample with 4:0:0 (greyscale) and 4:2:0 chroma sampling. The High profile further adds support for 4:4:4 chroma sampling. The Professional profile extends capabilities to full support for 4:0:0, 4:2:0, 4:2:2 and 4:4:4 chroma sub-sampling with 8, 10 and 12 bit color depths.[24]

Feature comparison between AV1 profiles
Main (0) High (1) Professional (2)
8 or 10-bit 8 or 10-bit 8, 10 & 12 bit
Chroma subsampling 4:0:0 Yes Yes Yes
4:2:0 Yes Yes Yes
4:2:2 No No Yes
4:4:4 No Yes Yes

LevelsEdit

AV1 defines levels for decoders with maximum variables for levels ranging from 2.0 to 7.3. Example resolutions would be 426×240@30 fps for level 2.0, 854×480@30 fps for level 3.0, 1920×1080@30 fps for level 4.0, 3840×2160@60 fps for level 5.1, 3840×2160@120 fps for level 5.2 and 5.3,[further explanation needed] and 7680×4320@120 fps for level 6.2.[24] Level 7 has not been defined yet.

Level MaxPicSize

(Samples)

MaxHSize

(Samples)

MaxVSize

(Samples)

MaxDisplayRate

(Samples/sec)

MaxDecodeRate

(Samples/sec)

MaxHeader

Rate (/sec)

MainMbps

(MBits/sec)

HighMbps

(MBits/sec)

Min Comp Basis Max Tiles Max Tile Cols Example
2.0 147456 2048 1152 4,423,680 5,529,600 150 1.5 - 2 8 4 426×240@30fps
2.1 278784 2816 1584 8,363,520 10,454,400 150 3.0 - 2 8 4 640×360@30fps
3.0 665856 4352 2448 19,975,680 24,969,600 150 6.0 - 2 16 6 854×480@30fps
3.1 1065024 5504 3096 31,950,720 39,938,400 150 10.0 - 2 16 6 1280×720@30fps
4.0 2359296 6144 3456 70,778,880 77,856,768 300 12.0 30.0 4 32 8 1920×1080@30fps
4.1 2359296 6144 3456 141,557,760 155,713,536 300 20.0 50.0 4 32 8 1920×1080@60fps
5.0 8912896 8192 4352 267,386,880 273,715,200 300 30.0 100.0 6 64 8 3840×2160@30fps
5.1 8912896 8192 4352 534,773,760 547,430,400 300 40.0 160.0 8 64 8 3840×2160@60fps
5.2 8912896 8192 4352 1,069,547,520 1,094,860,800 300 60.0 240.0 8 64 8 3840×2160@120fps
5.3 8912896 8192 4352 1,069,547,520 1,176,502,272 300 60.0 240.0 8 64 8 3840×2160@120fps
6.0 35651584 16384 8704 1,069,547,520 1,176,502,272 300 60.0 240.0 8 128 16 7680×4320@30fps
6.1 35651584 16384 8704 2,139,095,040 2,189,721,600 300 100.0 480.0 8 128 16 7680×4320@60fps
6.2 35651584 16384 8704 4,278,190,080 4,379,443,200 300 160.0 800.0 8 128 16 7680×4320@120fps
6.3 35651584 16384 8704 4,278,190,080 4,706,009,088 300 160.0 800.0 8 128 16 7680×4320@120fps

[64]

Supported container formatsEdit

Standardized
ISO Base Media File Format:[65] The ISOBMFF containerization spec by AOMedia was the first to be finalized and the first to gain adoption. This is the format used by YouTube.
Standards with unclear promise of finalization
Matroska: Version 1 of the Matroska containerization spec[66] was published in September 2018.[67] However, arguably breaking changes continued into October, and a new version, or finalization, is yet to be announced as of December.
Unfinished standards
MPEG Transport Stream: [68]
Not standardized
WebM: As a matter of formality, AV1 has not been sanctioned into the subset of Matroska known as WebM as of late 2018.[69]
On2 IVF: This format was inherited from the first public release of VP8, where it served as a simple development container.[70] rav1e also supports this format.[71]
Pre-standard WebM: Libaom featured early support for WebM, before Matroska containerization was specified, but has been changed to conform.[72]

AdoptionEdit

Content providersEdit

YouTube has begun rolling out AV1, starting with its AV1 Beta Launch Playlist. According to the description, the videos are (to begin with) encoded at high bitrate to test decoding performance, and YouTube has "ambitious goals" for rolling out AV1.

Vimeo's videos in the "Staff picks" channel are available in AV1.[73] Vimeo is using and contributing to Mozilla's Rav1e encoder, and expects, with further encoder improvements, to eventually provide AV1 support for all videos uploaded to Vimeo as well as the company's "Live" offering.[73]

Netflix "expects to be an early adopter of AV1".[74]

Following very positive own test results, Facebook said to gradually roll out AV1 as soon as browser support emerges, starting with their most popular videos.[63]

Twitch plans to roll out AV1 for its most popular content in 2022 or 2023, with universal support projected to arrive in 2024 or 2025.[75]

Software implementationsEdit

  • Libaom is the reference implementation. It includes an encoder (aomenc) and a decoder (aomdec). As the former research codec, it has the advantage of being made to justifiably demonstrate efficient use of every feature, but at the general cost of encoding speed. At feature freeze, the encoder had become problematically slow, but speed optimizations with negligible efficiency impact have continued to be made also after that.[76][26]
  • rav1e is an encoder written in Rust and assembly.[71] rav1e takes the opposite developmental approach to Aomenc: start out as the simplest (therefore fastest) conforming encoder, and then improve efficiency over time while remaining fast.[76]
  • SVT-AV1 includes an open-source encoder and decoder first released by Intel in February 2019 that is designed especially for usage on data center servers based on Intel Xeon processors. Netflix collaborates with Intel on SVT-AV1.[77][78]
  • dav1d is a decoder written in C99 and assembly focused on speed and portability.[79] The first official version (0.1) was released in December 2018.[80] Version 0.2 was released in March 2019, with users able to "safely use the decoder on all platforms, with excellent performance", according to the developers.[81] Version 0.3 was announced in May 2019 with further optimizations demonstrating performance 2 to 5 times faster than aomdec.[82] Firefox 67 switched from Libaom to dav1d as a default decoder.[83]
  • Cisco AV1 is a proprietary live encoder that Cisco developed for its Webex teleconference products. The encoder is optimized for latency[84] and the constraint of having a "usable CPU footprint", as with a "commodity laptop".[85] Cisco stressed that at their operating point – high speed, low latency – the large toolset of AV1 does not preclude a low encoding complexity.[84] Rather, the availability of tools for screen content and scalability in all profiles enabled them to find good compression-to-speed tradeoffs, better even than with HEVC.[85] Compared to their previously deployed H.264 encoder, a particular area of improvement was in high resolution screen sharing.[84]

Several other parties have announced to be working on encoders, including EVE for AV1 (in beta testing),[86] NGCodec[87], Socionext[88], Aurora[89] and MilliCast[90].

Software supportEdit

Operating system supportEdit

AV1 support by different operating systems
Microsoft Windows macOS BSD / Linux Chrome OS Android OS iOS
Codec support Beta TBA Yes Beta Beta TBA
Container support ISO base media file format (.mp4)
WebM (.webm)
Matroska (.mkv)
TBA ISO base media file format (.mp4)
WebM (.webm)
Matroska (.mkv)
TBA TBA
Notes - Support introduced in Windows 10 October 2018 Update (1809) with AV1 Video Extension beta add-on.[104]

- Supported on Universal Windows Platform apps like Microsoft Edge and Films & TV.

Unsupported as of macOS Mojave. supports decoding, from Chrome OS 70 onward Supported since Android Q beta.[105][106] Unsupported as of iOS 12.

HardwareEdit

Several Alliance members demonstrated AV1 enabled products at IBC 2018,[107] including Socionext's hardware accelerated encoder. According to Socionext, the encoding accelerator is FPGA based and can run on an Amazon EC2 F1 cloud instance, where it runs 10 times faster than existing software encoders.[108]

According to Mukund Srinivasan, chief business officer of AOM member Ittiam, early hardware support will be dominated by software running on non-CPU hardware (such as GPGPU, DSP or shader programs, as is the case with some VP9 hardware implementations), as fixed-function hardware will take 12–18 months after bitstream freeze until chips are available, plus 6 months for products based on those chips to hit the market.[29] The bitstream was finally frozen on 28 March 2018, meaning chips could be available sometime between March and August 2019.[109] According to the above forecast, products based on chips could then be on the market at the end of 2019 or the beginning of 2020.

On January 7, 2019, NGCodec announced AV1 support for NGCodec accelerated with Xilinx FPGAs.[87]

On April 18, 2019, Allegro DVT announced its AL-E210 multi-format video encoder hardware IP, the first publicly announced hardware AV1 encoder.[110][111] The AL-E210 supports, aside from VP9, H.265/HEVC, H.264/AVC and JPEG, the AV1 Main profile, with which it can encode 4:2:0 Chroma subsampling with 8 and 10 bit color depth. A single core can encode 4K with 30 fps, with multiple cores that should even be higher.

On May 9, 2019, Amphion announced their CS8000 Malone family video decoders with AV1 support of up to 8Kp60.[112]

On May 28, 2019, Realtek announced the RTD2893, its first integrated circuit with AV1 decoding, up to 8K.[113][114]

On June 17th 2019, Realtek announced the RTD1311 SoC for set-top boxes with an integrated AV1 decoder.[115]

Comparison of AV1 hardware
Product Function Profile Throughput

(single core)

Throughput

(max)

Ref
Allegro AL-E210 E Main (0) 4K 30fps ? [111]
Amphion CS8142 D 4K 60fps [116]
CS8150 D 4K 120fps [117]
CS8160 D 8K 60fps [117]
Dwango E 720p 30fps [118]
Realtek RTD1311 D 4K [115]
RTD2893 D 8K [113][114]

D = decode, E = Encode

Patent claimsEdit

In March 2019, Luxembourg-based Sisvel announced the formation of patent pools for AV1 and VP9. Members of the pools included JVCKENWOOD, NTT, Orange S.A., Philips, and Toshiba, all of whom were also licensing patents to the MPEG-LA for either the AVC, DASH, or the HEVC patent pools.[119][120] Sisvel announced it would demand €0.32 for display devices and €0.11 for non-display devices using AV1, but would not seek royalties for encoded content. At the time of the announcement, a list of patents owned by Sisvel was not publicly available. However, Sisvel's CEO stated in an interview that such a list would be posted on Sisvel's website before any licensing demands were sent out.[121][119]

As of 8 April 2019, the Alliance for Open Media has made a press release, which reiterated the commitment to their royalty-free patent license[122], and made mention of their "AOMedia patent defense program to help protect AV1 ecosystem participants in the event of patent claims", but did not mention the Sisvel claim by name.[123]

AV1 Image File Format (AVIF)Edit

The AV1 Image File Format (AVIF) is a specification for storing images or image sequences compressed with AV1 in the HEIF file format.[124] Version 1.0.0 of the specification was finalized in February 2019 and supports features like high dynamic range and wide color gamut.[124]

AVIF supportEdit

On 14 December 2018 Netflix published the first .avif sample images[125], and support was added in VLC. Microsoft also announced support with the Windows 10 "19h1" preview release, including File Explorer, Paint and multiple APIs, together with sample images.[126] Mozilla and Google are also working on support for the new image format in Firefox and Chrome.[127][128]

ReferencesEdit

  1. ^ "Release AV1 Bitstream & Decoding Process Specification (v1.0.0-errata1)". Github.com. 9 January 2019. Retrieved 31 March 2019.
  2. ^ "AV1 Bitstream & Decoding Process Specification" (PDF). The Alliance for Open Media.
  3. ^ Zimmerman, Steven (15 May 2017). "Google's Royalty-Free Answer to HEVC: A Look at AV1 and the Future of Video Codecs". XDA Developers. Archived from the original on 14 June 2017. Retrieved 10 June 2017.
  4. ^ a b c d e f How to use AV1 with open source tools, Videolan's Jean-Baptiste Kempf on using AV1 with open source tools, 2018-12-01.
  5. ^ a b c "Alliance for Open Media established to deliver next-generation open media formats" (Press release). Alliance for Open Media. 1 September 2015. Retrieved 5 September 2015.[self-published source]
  6. ^ Tsahi Levent-Levi (2 April 2018). "AV1 Specification Released: Can we kiss goodbye to HEVC and royalty bearing video codecs?". BlogGeek.me. Retrieved 19 December 2018. AV1 for video coding is what Opus is for audio coding.
  7. ^ Shankland, Stephen (19 January 2018). "Photo format from Google and Mozilla could leave JPEG in the dust". CNET. CBS Interactive. Retrieved 28 January 2018.
  8. ^ Neil McAllister, 1 September 2015: Web giants gang up to take on MPEG LA, HEVC Advance with royalty-free streaming codec – Joining forces for cheap, fast 4K video
  9. ^ a b Shankland, Stephen (1 September 2015). "Tech giants join forces to hasten high-quality online video". CNET. CBS Interactive Inc. Retrieved 15 April 2019.
  10. ^ a b Bright, Peter (1 September 2015). "Microsoft, Google, Amazon, others, aim for royalty-free video codecs". Ars Technica. Condé Nast. Retrieved 5 April 2019.
  11. ^ Rosenberg, Jonathan (28 March 2018). "Introducing the Industry's Next Video Codec: AV1". Cisco Blogs. Cisco Systems. Retrieved 15 April 2019.
  12. ^ "OpenH264 Now in Firefox". 14 October 2014. Retrieved 8 April 2019. Because H.264 implementations are subject to a royalty bearing patent license and Mozilla is an open source project, we are unable to ship H.264 in Firefox directly. We want anyone to be able to distribute Firefox without paying the MPEG LA.
  13. ^ a b Timothy B. Terriberry (18 January 2017). "Progress in the Alliance for Open Media" (video). linux.conf.au. Retrieved 1 March 2017.[self-published source]
  14. ^ "Why is FRAND bad for Free Software?". 20 June 2016. Retrieved 8 April 2019. As Free Software gives each user the freedom to redistribute the software itself, keeping track and collecting royalties based on distributed copies is also, in practice, impossible.
  15. ^ Stephen Shankland (12 September 2014). "Google's Web-video ambitions bump into hard reality". CNET. Retrieved 13 September 2014.
  16. ^ Romain Bouqueau (12 June 2016). "A view on VP9 and AV1 part 1: specifications". GPAC Project on Advanced Content. Retrieved 1 March 2017.
  17. ^ Steinar Midtskogen, Arild Fuldseth, Gisle Bjøntegaard, Thomas Davies (13 September 2017). "Integrating Thor tools into the emerging AV1 codec" (PDF). Retrieved 2 October 2017. What can Thor add to VP9/AV1? Since Thor aims for reasonable compression at only moderate complexity, we considered features of Thor that could increase the compression efficiency of VP9 and/or reduce the computational complexity.CS1 maint: Uses authors parameter (link)
  18. ^ Krishnan, Jai (22 November 2017). "Jai Krishnan from Google and AOMedia giving us an update on AV1". YouTube. Retrieved 22 December 2017.[self-published source]
  19. ^ Terriberry, Timothy B. (3 February 2018). "AV1 Codec Update". FOSDEM. Retrieved 8 February 2018.[self-published source]
  20. ^ Alliance for Open Media (28 March 2018). "The Alliance for Open Media Kickstarts Video Innovation Era with "AV1" Release" (Press release). Wakefield, Mass.[self-published source]
  21. ^ Shilov, Anton (30 March 2018). "Alliance for Open Media Releases Royalty-Free AV1 1.0 Codec Spec". AnandTech. Retrieved 2 April 2018.
  22. ^ Yoshida, Junko (28 March 2018). "Streaming Group to Pit AV1 Against H.265". EE Times. AspenCore, Inc. Retrieved 4 April 2019.
  23. ^ Larabel, Michael (25 June 2018). "AOMedia AV1 Codec v1.0.0 Appears Ready For Release". Phoronix. Retrieved 27 June 2018.
  24. ^ a b c "AV1 Bitstream and Decoding Process Specification" (PDF). Alliance for Open Media. Retrieved 1 April 2019. This version 1.0.0 with Errata 1 of the AV1 Bitstream Specification corresponds to the Git tag v1.0.0-errata1 in the AOMediaCodec/av1-spec project. Its content has been validated as consistent with the reference decoderprovided by libaom v1.0.0-errata1.
  25. ^ Hunter, Philip (15 February 2018). "Race on to bring AV1 open source codec to market, as code freezes". Videonet. Mediatel Limited-GB. Retrieved 19 March 2018.
  26. ^ a b Ozer, Jan (4 March 2019). "Good News: AV1 Encoding Times Drop to Near-Reasonable Levels". Retrieved 4 March 2019.
  27. ^ Jan Ozer, 26 May 2016: What Is VP9?
  28. ^ "LICENSE - aom - Git at Google". Aomedia.googlesource.com. Retrieved 26 September 2018.
  29. ^ a b Ozer, Jan (30 August 2017). "AV1: A status update". Streaming Media Magazine. Retrieved 14 September 2017.
  30. ^ Cho, Yushin (30 August 2017). "Delete daala_dist and cdef-dist experiments in configure". Retrieved 2 October 2017. Since those two experiments have been merged into the dist-8x8 experiment[self-published source]
  31. ^ a b Converse, Alex (16 November 2015). "New video coding techniques under consideration for VP10 – the successor to VP9". YouTube. Retrieved 3 December 2016.[self-published source]
  32. ^ a b "Decoding the Buzz over AV1 Codec". 9 June 2017. Retrieved 22 June 2017.[self-published source]
  33. ^ a b c d e f g "Analysis of the emerging AOMedia AV1 video coding format for OTT use-cases" (PDF). Archived from the original (PDF) on 20 September 2017. Retrieved 19 September 2017.
  34. ^ Mukherjee, Debargha; Su, Hui; Bankoski, Jim; Converse, Alex; Han, Jingning; Liu, Zoe; Xu (Google Inc.), Yaowu, "An overview of new video coding tools under consideration for VP10 – the successor to VP9", SPIE Optical Engineering+ Applications, International Society for Optics and Photonics, 9599, doi:10.1117/12.2191104
  35. ^ a b c Ian Trow (16 September 2018). Tech Talks: Codec wars (Recorded talk). IBC 2018 Conference. 28 minutes in. Retrieved 18 September 2018.
  36. ^ Alaiwan, Sebastien (16 October 2017). "Remove compile guards for CONFIG_EXT_REFS". Retrieved 29 October 2017. This experiment has been adopted[self-published source]
  37. ^ Alaiwan, Sebastien (31 October 2017). "Remove experimental flag of WARPED_MOTION". Retrieved 23 November 2017.[self-published source]
  38. ^ Alaiwan, Sebastien (30 October 2017). "Remove experimental flag of GLOBAL_MOTION". Retrieved 23 November 2017.[self-published source]
  39. ^ a b Jan Ozer (11 October 2017). "Demuxed: A Video Engineer's Nirvana". Streaming Media Magazine. Retrieved 10 February 2019.
  40. ^ Joshi, Urvang; Mukherjee, Debargha; Han, Jingning; Chen, Yue; Parker, Sarah; Su, Hui; Chiang, Angie; Xu, Yaowu; Liu, Zoe (19 September 2017). "Novel inter and intra prediction tools under consideration for the emerging AV1 video codec". Applications of Digital Image Processing XL. SPIE Optical Engineering + Applications 2017. 10396. International Society for Optics and Photonics. pp. 103960F. doi:10.1117/12.2274022.
  41. ^ Mukherjee, Debargha (29 October 2017). "Remove experimental flag for rect-tx". Retrieved 23 November 2017.[self-published source]
  42. ^ Mukherjee, Debargha (1 July 2016). "Rectangular transforms 4x8 & 8x4". Retrieved 14 September 2017.[self-published source]
  43. ^ Han, Jingning; Saxena, Ankur; Melkote, Vinay; Rose, Kenneth (29 September 2011). "Jointly Optimized Spatial Prediction and Block Transform for Video and Image Coding" (PDF). IEEE Transactions on Image Processing. Retrieved 12 February 2019.
  44. ^ "Mozilla shares how AV1, the new open source royalty-free video codec, works". 12 November 2018. Retrieved 21 December 2018.
  45. ^ "Into the Depths:The Technical Details Behind AV1" (PDF). 31 July 2018. Retrieved 21 December 2018.
  46. ^ Alaiwan, Sebastien (2 November 2017). "Remove experimental flag of EXT_TX". Retrieved 23 November 2017.[self-published source]
  47. ^ Davies, Thomas (9 August 2017). "AOM_QM: enable by default". Retrieved 19 September 2017.[self-published source]
  48. ^ Barbier, Frederic (10 November 2017). "Remove experimental flag of CDEF". Retrieved 23 October 2017.[self-published source]
  49. ^ "Constrained Directional Enhancement Filter". 28 March 2017. Retrieved 15 September 2017.[self-published source]
  50. ^ "Thor update". July 2017. Retrieved 2 October 2017.[self-published source]
  51. ^ Egge, Nathan (25 May 2017). "This patch forces DAALA_EC on by default and removes the dkbool coder". Retrieved 14 September 2017.[self-published source]
  52. ^ Egge, Nathan (14 February 2017). "Daala Entropy Coder in AV1" (PDF).[self-published source]
  53. ^ Timothy B. Terriberry (18 January 2017). "Progress in the Alliance for Open Media (slides)" (PDF). Retrieved 22 June 2017.[self-published source]
  54. ^ Egge, Nathan (18 June 2017). "Remove the EC_ADAPT experimental flags". Retrieved 23 September 2017.[self-published source]
  55. ^ Sebastian Grüner (9 June 2016). "Freie Videocodecs teilweise besser als H.265" (in German). golem.de. Retrieved 1 March 2017.
  56. ^ "Results of Elecard's latest benchmarks of AV1 compared to HEVC". 24 April 2017. Retrieved 14 June 2017. The most intriguing result obtained after analysis of the data lies in the fact that the developed codec AV1 is currently equal in its performance with HEVC. The given streams are encoded with AV1 update of 2017.01.31
  57. ^ "Bitmovin Supports AV1 Encoding for VoD and Live and Joins the Alliance for Open Media". 18 April 2017. Retrieved 20 May 2017.[self-published source]
  58. ^ Ozer, Jan. "HEVC: Rating the contenders" (PDF). Streaming Learning Center. Retrieved 22 May 2017.
  59. ^ Grois, D.; Nguyen, T.; Marpe, D. (2016). Coding efficiency comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC encoders (PDF). IEEE Picture Coding Symposium (PCS).
  60. ^ "Netflix on AV1". Streaming Learning Center. 30 November 2017. Retrieved 8 December 2017.
  61. ^ "MSU Codec Comparison 2017" (PDF). 17 January 2018. Retrieved 9 February 2018.
  62. ^ Ozer, Jan (30 January 2018). "AV1 Beats VP9 and HEVC on Quality, if You've Got Time, says Moscow State". Streaming Media Magazine. Retrieved 9 February 2018.
  63. ^ a b Baumgartner, Jeff (8 February 2019). "Facebook: Tests Show AV1 Streaming Performance Is Exceeding Expectations". Multichannel. Retrieved 10 February 2019.
  64. ^ "AOMediaCodec/av1-spec". GitHub. Retrieved 16 October 2018.[self-published source]
  65. ^ "AV1 Codec ISO Media File Format Binding". cdn.rawgit.com. Retrieved 14 September 2018.
  66. ^ "AOM AV1 codec mapping in Matroska/WebM". 3 December 2018. Retrieved 19 December 2018.
  67. ^ "Matroska AV1 support". 12 September 2018. Retrieved 19 December 2018.
  68. ^ "ts-carriage.md · master · VideoLAN / AV1 mapping specs". GitLab. Retrieved 19 May 2019.
  69. ^ "WebM Container Guidelines". 28 November 2017. Retrieved 19 December 2018.
  70. ^ "Simple Encoder". 18 May 2010. Retrieved 17 January 2019. IVF files will not generally be used by your application.
  71. ^ a b "The fastest and safest AV1 encoder". Retrieved 9 April 2018.
  72. ^ "WebM output in libaom". 1 November 2018. Retrieved 19 December 2018.
  73. ^ a b "Vimeo Streams in Support for AV1". 13 June 2019. Retrieved 15 June 2019.
  74. ^ Frost, Matt (31 July 2017). "VP9-AV1 Video Compression Update". Retrieved 21 November 2017. The mission of the Alliance for Open Media remains the same as the mission of the WebM project that we launched back in 2010. (…) Obviously, if we have an open source codec, we need to take very strong steps, and be very diligent in making sure that we are in fact producing something that's royalty free. So we have an extensive IP diligence process which involves diligence on both the contributor level – so when Google proposes a tool, we are doing our in-house IP diligence, using our in-house patent assets and outside advisors – that is then forwarded to the group, and is then again reviewed by an outside counsel that is engaged by the alliance. So that's a step that actually slows down innovation, but is obviously necessary to produce something that is open source and royalty free.
  75. ^ Ozer, Jan; Shen, Yueshi (2 May 2019). "NAB 2019: Twitch Talks VP9 and AV1 Roadmap". YouTube. Retrieved 30 May 2019. but we're hoping, towards 2024-2025 the AV1 ecosystem's ready, we wanna switch to AV1 a 100%. … this is our projection right now. But on the other hand, as I said, our AV1 release will be, for the head content will be a lot sooner. We are hoping 2022-2023 is we are going to release AV1 for the head content.
  76. ^ a b "Linux Conference Australia 2019: The AV1 Video Codec". 24 January 2019. Retrieved 5 February 2019. We have been focusing on freezing the bitstream and getting the quality, not necessarily making things fast. This is a graph of the [encoding] speed of AV1 over its development process. You can se that as we near the end of that process, we started making things faster again, and it's now two orders of magnitude faster than it was at its slowest point. So that's going to improve. And this is a corresponding graph of the quality. (…) So you can see that even as it has continued to get much faster, the quality hasn't really gone down. (…) We wanted to approach this from the other end, so we started an encoder of our own, called rav1e, and the idea is that we would start out always being fast, and then try to make it better over time.
  77. ^ Armasu, Lucian (4 February 2019). "Intel Releases Open Source Encoder for Next-Gen AV1 Codec". Tom's Hardware. Retrieved 13 February 2019.
  78. ^ Andrey Norkin; Joel Sole; Kyle Swanson; Mariana Afonso; Anush Moorthy; Anne Aaron (22 April 2019). "Introducing SVT-AV1: a scalable open-source AV1 framework". Medium. Netflix Technology Blog. Retrieved 7 August 2019.
  79. ^ "Introducing dav1d: a new AV1 decoder". 1 October 2018. Retrieved 6 January 2019.
  80. ^ Kempf, Jean-Baptiste (11 December 2018). "First release of dav1d, the AV1 decoder". personal website of Jean-Baptiste Kempf. Retrieved 3 February 2019.
  81. ^ Kempf, Jean-Baptiste (13 March 2019). "dav1d shifts up a gear : 0.2 is out!".
  82. ^ Kempf, Jean-Baptiste (3 May 2019). "dav1d 0.3.0 release: even faster!".
  83. ^ "Firefox 67.0, See All New Features, Updates and Fixes". Mozilla. Retrieved 22 May 2019.
  84. ^ a b c Davies, Thomas (26 June 2019). "Big Apple Video 2019 - AV1 in video collaboration". Retrieved 30 June 2019.
  85. ^ a b Davies, Thomas (26 June 2019). "Cisco Leap Frogs H.264 Video Collaboration with Real-Time AV1 Codec". Retrieved 30 June 2019.
  86. ^ "Two Orioles".
  87. ^ a b Gunasekara, Oliver (7 January 2019). "NGCodec Announces AV1 Support and a 2X Performance Improvement in Broadcast Quality Live Video Encoding".
  88. ^ "Socionext Implements AV1 Encoder on FPGA over Cloud Service". 6 June 2018.
  89. ^ "Visionular". www.visionular.com. Retrieved 11 August 2019.
  90. ^ Millicast (9 July 2019). "Millicast demonstrates real-time video broadcasting using AV1 at CommCon 2019". Medium. Retrieved 11 August 2019.
  91. ^ Egge, Nathan (23 May 2019). "Firefox brings you smooth video playback with the world's fastest AV1 decoder". Mozilla Hacks. Retrieved 30 May 2019.
  92. ^ "Chrome 70 Arrives With Option To Disable Linked Sign-Ins, PWAs On Windows, and AV1 Decoder". Slashdot. 16 October 2018. Retrieved 13 February 2019.
  93. ^ "AV1 Decoder". Chrome Platform Status. Retrieved 14 September 2018.[self-published source]
  94. ^ "How to Play AV1 Videos on YouTube in Chrome 70, Firefox, Vivaldi, Opera". Techdows. 19 October 2018. Retrieved 26 February 2019.
  95. ^ "Opera 57 with smarter news and Netflix recommendations". Opera Desktop. 28 November 2018. Retrieved 13 December 2018.
  96. ^ Tung, Liam (12 February 2018). "VideoLAN: VLC 3.0's huge update brings Chromecast support, 360-degree video". ZDNet. Retrieved 13 February 2019.
  97. ^ Larabel, Michael (20 March 2018). "GStreamer 1.14.0 Released With WebRTC Support, AV1 Video & Better Rust Bindings". Phoronix. Retrieved 13 February 2019.
  98. ^ "Time to Start Testing: FFmpeg Turns 4.0 and Adds AV1 Support". Streaming Media Magazine. 27 September 2018. Retrieved 13 February 2019.
  99. ^ "mpv v0.29.0". github.com/mpv-player/mpv. 22 July 2018. Retrieved 16 September 2018.[self-published source]
  100. ^ "MKVToolNix v28.0.0 release notes".[self-published source]
  101. ^ Bunkus, Moritz (1 April 2018). "MKVToolNix v22.0.0 released". mosu's Matroska stuff. Retrieved 3 May 2018.[self-published source]
  102. ^ Serea, Razvan (20 March 2018). "MediaInfo 18.03". Neowin. Retrieved 3 May 2018.
  103. ^ "Encoding Encoder Release 1.50.0". Bitmovin Documentation. Retrieved 9 November 2018.[self-published source]
  104. ^ a b "Microsoft Launches Free AV1 Video Codec For Windows 10". Slashdot. 10 November 2018. Retrieved 13 February 2019.
  105. ^ Building Modern Web Media Experiences: Picture-in-Picture and AV1 (Chrome Dev Summit 2018) - YouTube
  106. ^ "Introducing Android Q Beta". Android Developers Blog. Retrieved 15 March 2019.
  107. ^ "AOMedia Members Demo AV1 at IBC2018". 6 September 2018. Retrieved 6 January 2019.[self-published source]
  108. ^ "Socionext Implements AV1 Encoder on FPGA over Cloud Service". 6 June 2018. Retrieved 6 January 2019.[self-published source]
  109. ^ Jan Ozer (28 March 2018). "AV1 Is Finally Here, but Intellectual Property Questions Remain". Streaming Media Magazine. Retrieved 21 April 2018.
  110. ^ "Allegro DVT Introduces the Industry First Real-Time AV1 Video Encoder Hardware IP for 4K/UHD Video Encoding Applications". Allegro. 18 April 2019. Retrieved 10 May 2019.
  111. ^ a b "AL-E210". Allegro. Retrieved 10 May 2019.
  112. ^ "News: Amphion Semiconductor introduces 4K/UHD capable AV1 video decoder hardware IP extension to its Malone video decoder family". 9 May 2019. Retrieved 11 August 2019.
  113. ^ a b "Realtek 8K Video Decoder and Processing IC (RTD2893) Wins Best Choice of the Year at COMPUTEX TAIPEI 2019 - REALTEK". www.realtek.com. Retrieved 17 June 2019.
  114. ^ a b Shilov, Anton (19 June 2019). "Realtek Demonstrates RTD2893: A Platform for 8K Ultra HD TVs". AnandTech. Purch. Retrieved 19 June 2019.
  115. ^ a b "Realtek Launches Worldwide First 4K UHD Set-top Box SoC (RTD1311), Integrating AV1 Video Decoder and Multiple CAS Functions - REALTEK". www.realtek.com. Retrieved 17 June 2019.
  116. ^ "CS8142 Preliminary Product Brief" (PDF).
  117. ^ a b "CS8000 'Malone' Video Decoders – Amphion". Retrieved 11 August 2019.
  118. ^ "AV1リアルタイムハードウェアエンコーダを開発しました - dwango on GitHub". dwango.github.io (in Japanese). Retrieved 17 May 2019.
  119. ^ a b Ozer, Jan (28 March 2019). "Sisvel Announces Patent Pools for VP9 and AV1". Stream Learning Center. Retrieved 4 April 2019.
  120. ^ Cluff, Phil (28 March 2019). "Did Sisvel just catch AOM with their patents down?". Mux.com. Retrieved 4 April 2019.
  121. ^ Ozer, Jan (28 March 2019). "No Content Royalties in Sisvel VP9/AV1 Patent Pools". Streaming Media. Information Today Inc. Retrieved 4 April 2019.
  122. ^ "Alliance for Open Media Patent License 1.0". The Alliance for Open Media. Retrieved 15 April 2019.
  123. ^ "The Alliance for Open Media Statement". The Alliance for Open Media. Retrieved 12 April 2019.
  124. ^ a b "AV1 Image File Format (AVIF)". aomediacodec.github.io. Retrieved 25 November 2018.
  125. ^ "S3 Bucket Listing Generator". download.opencontent.netflix.com. Retrieved 17 December 2018.[self-published source]
  126. ^ AV1 Still Image File Format Specification: proposed ISO-BMFF/HEIF derivative - AOMediaCodec/av1-avif, AOMediaCodec, 11 June 2019, retrieved 12 June 2019
  127. ^ Abrams, Lawrence (28 December 2018). "Microsoft is Adding AVIF Image Support to Windows 10". BleepingComputer. Retrieved 13 February 2019.
  128. ^ "Support AVIF". Chromium bug tracker. 8 May 2019. Retrieved 3 August 2019.

External linksEdit