Size of this preview: 799 × 340 pixels. Other resolutions: 320 × 136 pixels | 640 × 272 pixels | 1,024 × 436 pixels | 2,129 × 906 pixels.
Original file (2,129 × 906 pixels, file size: 152 KB, MIME type: image/png)
 | This is a file from the Wikimedia Commons. Information from its description page there is shown below. Commons is a freely licensed media file repository. You can help. |
Summary
| Description |
English: calculation flow through a single attention head |
| Date | |
| Source | Own work |
| Author | Numiri |
Licensing
I, the copyright holder of this work, hereby publish it under the following license:
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
- You are free:
- to share – to copy, distribute and transmit the work
- to remix – to adapt the work
- Under the following conditions:
- attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
File history
Click on a date/time to view the file as it appeared at that time.
| Date/Time | Thumbnail | Dimensions | User | Comment | |
|---|---|---|---|---|---|
| current | 15:39, 10 April 2024 | | 2,129 × 906 (152 KB) | Numiri | changed Q_w to W_q. same for K and V. |
| 03:04, 10 May 2023 |  | 1,687 × 739 (64 KB) | Numiri | changed (b) to (*) since we only have one footnote item now. | |
| 02:41, 10 May 2023 |  | 1,708 × 758 (65 KB) | Numiri | grouped attention head, expanded softmax formula | |
| 03:17, 9 May 2023 |  | 1,506 × 712 (59 KB) | Numiri | changed legend labels _x_, a, b, c, d | |
| 11:16, 8 May 2023 |  | 1,517 × 705 (56 KB) | Numiri | Uploaded own work with UploadWizard |
File usage
The following pages on the English Wikipedia use this file (pages on other projects are not listed):
Global file usage
The following other wikis use this file:
- Usage on es.wikipedia.org
- Usage on he.wikipedia.org
- Usage on uk.wikipedia.org
