Jump to content

File:Multiple attention heads.png

Page contents not supported in other languages.
This is a file from the Wikimedia Commons
From Wikipedia, the free encyclopedia

Original file (870 × 1,280 pixels, file size: 269 KB, MIME type: image/png)

Summary

Description
English: An illustration of multiple attention heads, each having its own criteria of relevance of other tokens for one of the tokens within the scope of a context window. (For the purpose of illustration, the context window consists of only one sentence.)
Date
Source Own work
Author DancingPhilosopher
This image could be re-created using vector graphics as an SVG file. This has several advantages; see Commons:Media for cleanup for more information. If an SVG form of this image is available, please upload it and afterwards replace this template with {{vector version available|new image name}}.


It is recommended to name the SVG file “Multiple attention heads.svg”—then the template Vector version available (or Vva) does not need the new image name parameter.

Licensing

I, the copyright holder of this work, hereby publish it under the following license:
w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license.
You are free:
  • to share – to copy, distribute and transmit the work
  • to remix – to adapt the work
Under the following conditions:
  • attribution – You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike – If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.

Captions

An illustration of multiple attention heads

Items portrayed in this file

depicts

29 July 2023

image/png

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current13:23, 1 August 2023Thumbnail for version as of 13:23, 1 August 2023870 × 1,280 (269 KB)DancingPhilosopheromitted the (in-picture) caption
12:48, 1 August 2023Thumbnail for version as of 12:48, 1 August 2023870 × 1,280 (365 KB)DancingPhilosopher
22:35, 29 July 2023Thumbnail for version as of 22:35, 29 July 2023855 × 1,280 (510 KB)DancingPhilosopherUploaded own work with UploadWizard

The following page uses this file:

Global file usage

The following other wikis use this file:

Metadata