Wikipedia:Artificial intelligence
 | This is an information page. It is not an encyclopedic article, nor one of Wikipedia's policies or guidelines; rather, its purpose is to explain certain aspects of Wikipedia's norms, customs, technicalities, or practices. It may reflect differing levels of consensus and vetting. |
Artificial intelligence is used on a number of Wikipedia and Wikimedia projects. This may be directly involved with creation of text content, or in support roles related to evaluating article quality, adding metadata, or generating images. As with any machine-generated content, care must be used when employing AI at scale or in applying it where the community consensus is to exercise more caution.
When exploring AI techniques and systems, the community consensus is to prefer human decisions over machine-generated outcomes until the implications are better understood.
Applications
[edit]AI-related efforts on Wikipedia include but are not limited to:
Revision scoring
[edit]The Objective Revision Evaluation Service (ORES) was started in 2015 as a project of the Wikimedia Foundation, and provides a revision score against machine learning models that have been trained in order to report article quality or vandalism. This is used in tools such as ClueBot NG to help immediately revert vandalism, or in evaluation tools like the Program and Events Dashboard to measure the outcomes of classwork, edit-a-thons, or organized editing campaigns.
Text translation
[edit]Guidance can be found at Help:Translation#English Wikipedia policy requirements. There is a Content Translation Tool used across Wikimedia projects that can use the output of machine translation from one Wikipedia article to another, using services like Google Translate. However, on the English Wikipedia, it currently states that "machine translation is disabled for all users and this tool is limited to extended confirmed editors." As a result, only manual translation on the English Wikipedia is supported by the tool, though some users have used translation to Simple English as a workaround. Relatedly, there is a section of the Help:Translation page with the broad advice: "avoid machine translations." However, this guidance was last edited in 2016, and the state of the art for machine translation has advanced significantly since then, meriting a re-examination of that advice.
Article text generation
[edit]The explosion of interest in ChatGPT in 2022 has led to increased curiosity in using generative AI to help compose Wikipedia articles. The status of machine-generated text from tools such as ChatGPT is generally accepted to be public domain, so the copyright issues are not a blocker to using the generated text from a legal standpoint. These issues are generally governed by Help:Adding open license text to Wikipedia#Converting and adding open license text to Wikipedia, which advises to make sure content is adjusted for style and that reliable sources are used. Conversations on the Village Pump and in some test articles (i.e. Artwork title) have noted positive aspects of machine generated text, but a serious warning that content must be checked for facts and accuracy and never used straight from ChatGPT.
A good general page looking at the issues can be found at: Wikipedia:Using neural network language models on Wikipedia.
A major community discussion took place on Village Pump (policy) found at: Wikipedia:Village pump (policy)/Archive 179#Wikipedia response to chatbot-generated content
Some user experiences can be found here:
- Talk:Artwork title
- User:JPxG/LLM demonstration
- User:Fuzheado/ChatGPT - also: experiments with generating Wikidata Quickstatements from fuzzy date descriptions
- User:DraconicDark/ChatGPT
- User:BrokenSegue - Wikidata:Wwwyzzerdd and Psychiq Wikidata game that uses distilBERT and ML, analyzing Wikipedia categories.
Images and Commons
[edit]Image metadata – There have been efforts from GLAM institutions to help supplement image keyword data with machine learning efforts. Among them include:
- Computer aided tagging Started in 2019, "The computer-aided tagging tool is a feature in development by the Structured Data on Commons team to assist community members in identifying and labeling depicts statements for Commons files." See: c:Commons:Structured data/Computer-aided tagging
- Metropolitan Museum of Art Tagging - This project used Met Museum tagging info to train a machine learning system to help predict new "depiction" recommendations for Wikidata. This resulted in a new Wikidata Game that helped add more than 4,000 new depiction (P180) statements to Wikidata. See the Met Museum blog post by Andrew Lih: "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale," March 4, 2019, [1]
Image generation
- Wikimedia Commons and AI generated media
- AI images and German Wikipedia, results of a meeting
- A Battle for Reality, video essay on AI images and Wikipedia
See also
[edit]- Wikipedia:Large language models, an essay on using LLMs (textual generative AI) to produce or modify content on Wikipedia
- Wikipedia:Computer-generated content, a draft of a proposed policy on using computer-generated content in general on Wikipedia
- Wikipedia:WikiProject AI Cleanup, a group of editors focusing on the issue of non-policy-compliant LLM-originated content
- Wikipedia:Using neural network language models on Wikipedia, an essay about large language models specifically
- Artwork title, a surviving article initially developed from raw LLM output (before this page had been developed)
- m:Research:Implications of ChatGPT for knowledge integrity on Wikipedia, an ongoing (as of July 2023) Wikimedia research project
- m:Wikilegal/Copyright Analysis of ChatGPT
- Initial version of Artwork title, a surviving article developed from raw LLM output
- Should ChatGPT Be Used to Write Wikipedia Articles?, a Slate article which largely deals with the history and implications of 'Artwork title'
- Artificial intelligence in Wikimedia projects
General
[edit]- Lih, Andrew (March 4, 2019). "Combining AI and Human Judgment to Build Knowledge about Art on a Global Scale". Metropolitan Museum of Art.
Wikimedia
[edit]- Morgan, Jonathan T. (18 July 2019). "Designing ethically with AI: How Wikimedia can harness machine learning in a responsible and human-centered way". WIkimedia Foundation.
- Redi, Miriam (14 March 2018). "How we're using machine learning to visually enrich Wikidata". Wikimedia Foundation.
- meta:Research:Ethical and human-centered AI
Demonstrations of generative AI using LLMs
[edit]- User:JPxG/LLM demonstration (wikitext markup, table rotation, reference analysis, article improvement suggestions, plot summarization, reference- and infobox-based expansion, proseline repair, uncited text tagging, table formatting and color schemes)
- User:JPxG/LLM demonstration 2 (suggestions for article improvement, explanations of unclear maintenance templates based on article text)
- User:Fuzheado/ChatGPT (PyWikiBot code, writing from scratch, Wikidata parsing, CSV parsing)
- User:DraconicDark/ChatGPT (lead expansion)
- Wikipedia:Using neural network language models on Wikipedia/Transcripts (showcases several actual mainspace LLM-assisted copyedits)
- User:WeatherWriter/LLM Experiment 1 (identifying sourced and unsourced information)
- User:WeatherWriter/LLM Experiment 2 (identifying sourced and unsourced information, including a non-English source)
- User:WeatherWriter/LLM Experiment 3 (identifying sourced and unsourced information, only six of seven tests successful)
- Wikipedia:Articles for deletion/ChatGPT and Wikipedia:Articles for deletion/Planet of the Apes (humorous April Fools' nominations generated almost entirely by large language models).