User:JPxG/LLM demonstration 2

For the proposed guidelines based on this demonstration, see WP:LLM.

The following is the result of my experiments with OpenAI ChatGPT (GPT-3.5, based off InstructGPT) in December 2022 (as well as some experiments with GPT-3-davinci-003). These are both large language models (LLMs) trained on a large corpus of web text; they do not have the capability to "look things up", search the Web, or examine sources. Telling these models to "write an article" about something will produce large volumes of bullshit in the vage style of a Wikipedia article. Do not do this and then put it on Wikipedia.

The models use transformers with multi-head attention to complete sequences, replying to prompt sequences with their best idea of what would be most likely to come after them. This can be hacked very easily: if you say "The following is a list of reasons why it is good to eat crushed glass", it will give you one. Do not do this and then put it on Wikipedia.

That being said, there are obvious situations in which their detailed understanding of virtually all publicly accessible Internet text (i.e. HTML tutorials, codebases from GitHub, the full text of Wikipedia including our policies and guidelines, etc) means that they are able to contribute greatly to the process of editing and writing, if they are used by an intelligent editor who does not blindly paste LLM output into the edit window and press "save".

Much like human beings, they will occasionally make errors, or say things that are not completely true. This means that they should be used only by an intelligent editor who does not blindly paste LLM output into the edit window and press "save".

Asking them to do tasks which they are not suited to (i.e. tasks which require extensive knowledge or analysis of something that you don't type into the prompt window) makes these errors much more likely. This is why a LLM should only be used by an intelligent editor who does not blindly paste LLM output into the edit window and press "save".

Hopefully, you are starting to pick up on a leitmotif. In case I was too subtle, I will say it again: Large language model output should only be used in the process of editing Wikipedia if you are an intelligent editor who does not blindly paste LLM output into the edit window and press "save".

To demonstrate this, I present several examples of these models assisting in routine tasks.

I have included the full text of my own prompts below, as well as the model's responses (which I present unedited).

Note that, while I have not cherry-picked these results, I have worked rather extensively with GPT-series models in the past, and my results are likely to be much better than what a random inexperienced user would be capable of getting. Professional driver, closed course...

Article improvement suggestions (Juni Chakma)

Full prompt

The following is a Wikipedia stub article titled "Juni Chakma".

{{short description|Bangladeshi kabaddi player}}
{{MedalTableTop}}
{{MedalCountry | {{BAN}} }}
{{MedalSport | Women's [[Kabaddi]]}}
{{MedalCompetition | [[Asian Games]]}}
{{MedalBronze | [[Kabaddi at the 2010 Asian Games|2010 Guangzhou]]| Team }}
{{MedalBronze | [[Kabaddi at the 2014 Asian Games|2014 Incheon]]| Team }}
{{MedalBottom}}

'''Juni Chakma''' ({{lang-bn|জুনি চাকমা}}) is a Bangladeshi national women [[Kabaddi]] player who was part of the team that won the bronze medal at the [[Kabaddi at the 2010 Asian Games|2010 Asian Games]] and [[Kabaddi at the 2014 Asian Games|2014 Asian Games]].<ref>{{cite web|title=Athletes|url=http://www.incheon2014ag.org/Sports/Biographies/Athletes?lang=en#|publisher=The 17th Incheon Asian Games Organizing Committee|accessdate=22 September 2014}}</ref><ref>{{cite web|url=http://www.kalerkantho.com/print_edition/?view=details&type=gold&data=Politics&pub_no=239&cat_id=1&menu_id=18&news_type_id=1&index=23&archiev=yes&arch_date=30-07-2010#.Uv0kemKSw8o|script-title=bn:মহিলা কাবাডি দলও এশিয়ান গেমসে :: খেলা :: কালের কণ্ঠ|work=Kaler Kantho |language=bn}}</ref><ref>{{cite web|url=http://www.dailysangram.com/news_details.php?news_id=65739 |script-title=bn:এশিয়ান বিচ গেমস আজ শুরু |work=The Daily Sangram |language=bn |url-status=dead |archiveurl=https://web.archive.org/web/20140226042902/http://www.dailysangram.com/news_details.php?news_id=65739 |archivedate=2014-02-26 }}</ref><ref>{{cite web|url=http://www.jugantor.com/sports/2014/02/12/68303|script-title=bn:মালেকা ও আকাশীর স্বপ্নপূরণের দিন আজ|work=Jugantor.|language=bn}}</ref><ref>{{cite web|url=http://archive.thedailystar.net/newDesign/news-details.php?nid=149028|title=Women's kabaddi team confirmed|work=The Daily Star}}</ref><ref>{{cite web|url=http://zeenews.india.com/news/sports/women-s-kabaddi-to-debut-in-2010-asian-games_413129.html|title=Women`s Kabaddi to debut in 2010 Asian Games|work=Zee News}}</ref>

==References==
{{Reflist}}

== External links==
* [http://archive.thedailystar.net/forum/2012/March/women.htm Women's sports in Bangladesh]

{{DEFAULTSORT:Chakma, Juni}}
[[Category:Living people]]
[[Category:Place of birth missing (living people)]]
[[Category:Asian Games medalists in kabaddi]]
[[Category:Kabaddi players at the 2010 Asian Games]]
[[Category:Bangladeshi kabaddi players]]
[[Category:Kabaddi players at the 2014 Asian Games]]
[[Category:Female kabaddi players]]
[[Category:Asian Games bronze medalists for Bangladesh]]
[[Category:Medalists at the 2010 Asian Games]]
[[Category:Year of birth missing (living people)]]
[[Category:Medalists at the 2014 Asian Games]]

{{bangladesh-sport-bio-stub}}

Could you think of some ways that this article could be improved on?

Yes, here are a few ways the article could be improved:

1. Personal information: Adding information such as the year of birth, place of birth, and current status would give a more comprehensive overview of the player.

2. Career highlights: Providing information about Juni Chakma's career highlights and achievements, other than her participation in the Asian Games, would give readers a better understanding of her abilities.

3. Images: Adding an image of Juni Chakma would make the article more visually appealing and help readers put a face to the name.

4. Details about Kabaddi: Providing a brief explanation of Kabaddi and its rules would help readers who are not familiar with the sport understand the context of Juni Chakma's achievements.

5. External links: Adding additional external links to reliable sources that provide more information about Juni Chakma and Kabaddi would be helpful.

Article improvement suggestions (Carlton Township, Michigan)

Full prompt, "Could you think of some ways that this article could be improved on?"

The following is a Wikipedia stub article titled "Carlton Township, Michigan".

Carlton Township is a civil township of Barry County in the U.S. state of Michigan. The population was 2,368 at the 2020 census.[3] Contents

   1 History
   2 Communities
   3 Geography
   4 Demographics
   5 References
       5.1 Sources

History

The name of Carlton Township was given it by George Fuller and his family, the first settlers here in 1836.[4] It was organized as a township in 1842. Communities

Gerkey was an unincorporated location in Carlton Township. It had a post office from 1884 until 1902.[5] The village of Freeport is within the boundaries of Carlton. Freeport also possesses a library. The township is serviced by the fire departments of Woodland as well.[6] Geography

According to the United States Census Bureau, the township has a total area of 35.7 square miles (92.4 km2), of which 35.1 square miles (91.0 km2) is land and 0.54 square miles (1.4 km2), or 1.55%, is water.[3] Demographics

As of the census[1] of 2020, there were 2,368 people and 993 households in the township. The population density was 66.3 inhabitants per square mile (25.6/km2). There were 994 housing units. The median income for a household in the township is $66,680.

As of the census for 2010 United States census, The racial makeup of the township was 97.25% White, 0.26% African American, 0.73% Native American, 0.09% Asian, 0.64% from other races, and 1.03% from two or more races. Hispanic or Latino of any race were 1.72% of the population. There were 836 households, out of which 38.5% had children under the age of 18 living with them, 66.5% were married couples living together, 8.3% had a female householder with no husband present, and 21.3% were non-families. 16.9% of all households were made up of individuals, and 6.8% had someone living alone who was 65 years of age or older. The average household size was 2.79 and the average family size was 3.12. In the township the population was spread out, with 29.0% under the age of 18, 7.6% from 18 to 24, 28.1% from 25 to 44, 24.1% from 45 to 64, and 11.2% who were 65 years of age or older. The median age was 36 years. For every 100 females, there were 99.9 males. For every 100 females age 18 and over, there were 101.2 males. References

"United States Census Bureau". Census.gov. United States Census Bureau. Retrieved 1 July 2022. U.S. Geological Survey Geographic Names Information System: Carlton Township, Michigan "Geographic Identifiers: 2010 Demographic Profile Data (G001): Carlton township, Barry County, Michigan". U.S. Census Bureau, American Factfinder. Archived from the original on February 12, 2020. Retrieved December 24, 2013. Romig 1986, p. 99. Romig 1986, p. 221.

   "Fire Department | Burn Permits | 269.205.3208 | Carlton Township". www.carltontownship.org. 17 January 2019. Retrieved 1 July 2022.

Sources Romig, Walter (October 1, 1986) [1973]. Michigan Place Names: The History of the Founding and the Naming of More Than Five Thousand Past and Present Michigan Communities. Great Lakes Books Series (Paperback). Detroit, Michigan: Wayne State University Press. ISBN 081431838X.

Could you think of some ways that this article could be improved on?

1. Expanding the history section to include more details and information about the history of Carlton Township and its early settlers.

2. Adding more information about the communities within Carlton Township, such as the history and development of Freeport and Gerkey.

3. Including a section about the local economy and important industries in the area.

4. Adding more details about the demographics of Carlton Township, such as the age and education levels of its residents.

5. Adding a section about local government, including the names and responsibilities of elected officials.

6. Adding more information about notable landmarks, attractions, and events in the area.

7. Including photos and images of Carlton Township to give readers a visual representation of the area.

8. Adding more information about the geography of Carlton Township, including its climate, topography, and natural features.

9. Including a section about the transportation options in the area, such as roads, airports, and public transportation.

10. Adding a list of nearby cities and towns and their proximity to Carlton Township.

Full prompt, "Could you think of some ways that this article could be improved on (either by adding or removing content)?"

The following is a Wikipedia stub article titled "Carlton Township, Michigan".

Carlton Township is a civil township of Barry County in the U.S. state of Michigan. The population was 2,368 at the 2020 census.[3] Contents

   1 History
   2 Communities
   3 Geography
   4 Demographics
   5 References
       5.1 Sources

History

The name of Carlton Township was given it by George Fuller and his family, the first settlers here in 1836.[4] It was organized as a township in 1842. Communities

Gerkey was an unincorporated location in Carlton Township. It had a post office from 1884 until 1902.[5] The village of Freeport is within the boundaries of Carlton. Freeport also possesses a library. The township is serviced by the fire departments of Woodland as well.[6] Geography

According to the United States Census Bureau, the township has a total area of 35.7 square miles (92.4 km2), of which 35.1 square miles (91.0 km2) is land and 0.54 square miles (1.4 km2), or 1.55%, is water.[3] Demographics

As of the census[1] of 2020, there were 2,368 people and 993 households in the township. The population density was 66.3 inhabitants per square mile (25.6/km2). There were 994 housing units. The median income for a household in the township is $66,680.

As of the census for 2010 United States census, The racial makeup of the township was 97.25% White, 0.26% African American, 0.73% Native American, 0.09% Asian, 0.64% from other races, and 1.03% from two or more races. Hispanic or Latino of any race were 1.72% of the population. There were 836 households, out of which 38.5% had children under the age of 18 living with them, 66.5% were married couples living together, 8.3% had a female householder with no husband present, and 21.3% were non-families. 16.9% of all households were made up of individuals, and 6.8% had someone living alone who was 65 years of age or older. The average household size was 2.79 and the average family size was 3.12. In the township the population was spread out, with 29.0% under the age of 18, 7.6% from 18 to 24, 28.1% from 25 to 44, 24.1% from 45 to 64, and 11.2% who were 65 years of age or older. The median age was 36 years. For every 100 females, there were 99.9 males. For every 100 females age 18 and over, there were 101.2 males. References

"United States Census Bureau". Census.gov. United States Census Bureau. Retrieved 1 July 2022. U.S. Geological Survey Geographic Names Information System: Carlton Township, Michigan "Geographic Identifiers: 2010 Demographic Profile Data (G001): Carlton township, Barry County, Michigan". U.S. Census Bureau, American Factfinder. Archived from the original on February 12, 2020. Retrieved December 24, 2013. Romig 1986, p. 99. Romig 1986, p. 221.

   "Fire Department | Burn Permits | 269.205.3208 | Carlton Township". www.carltontownship.org. 17 January 2019. Retrieved 1 July 2022.

Sources Romig, Walter (October 1, 1986) [1973]. Michigan Place Names: The History of the Founding and the Naming of More Than Five Thousand Past and Present Michigan Communities. Great Lakes Books Series (Paperback). Detroit, Michigan: Wayne State University Press. ISBN 081431838X.

Could you think of some ways that this article could be improved on (either by adding or removing content)?

Adding information about the history and origin of Gerkey and Freeport
Mentioning notable landmarks or attractions in Carlton Township
Adding information about local schools and education
Mentioning the township's government and officials
Adding information about local economy and businesses
Including a map or a picture of Carlton Township
Providing more details about the demographics, such as the median age, income, and education level of residents
Adding a section on events and community activities in Carlton Township
Mentioning the recreational opportunities in the area, such as parks, lakes, and trails
Providing more details on the geography, such as the topography and climate
Adding a section on the township's cultural and ethnic diversity.

Article improvement suggestions (Avoly)

Full prompt ("Could you go over this and point out which content is unreferenced or potentially unencyclopedic?"))

The following is a Wikipedia stub article titled "Avoly".

Avoly is a panchayath located in Ernakulam district of the Indian state of Kerala. The panchayath is a part of Muvattupuzha taluk and consists of 14 wards which include Anikkad, Kavana, Kizhakkekara, Kottapuram, Nadukkara, and Pareeka Peedika.[2][3]

Avoly comes under the Muvattupuzha assembly constituency which is coming under Idukki parliamentary constituency.[4] A major educational institution in Kerala, Nirmala College situated at Avoly panchayath.[5] Contents

   1 History
   2 Demographics
   3 Wards
   4 Economy
   5 Places in and around Avoly
   6 See also
   7 References
   8 External links

History

Avoly panchayath was formed in 1953. The first meeting of the Panchayat was held on August 15, 1953 and K. V. Emmanuel Karuppamadam became the first president. It has an area of 18.6 km2 and shares the borders with Ayavana Panchayath and Muvattupuzha Municipality in the North, Manjalloor panchayath and Manakkad Panchayath in the South, Manjallor panchayath and Ayavana panchayath in the East and Arakuzha panchayath and Muvattupuzha Municipality in the West.[6] Demographics

In 2001 Avoly had a population of 15760 with 7935 males and 7825 females with a literacy rate of 93.9%.[7] The town is mainly made up of Syrian Catholic Christians, Hindus and Muslims.[8] Wards

   Kizhakkekkara
   Randar
   Kottappuram
   Thiruvumplavu Kshetram
   St.sebastian.h.s
   Pareekkapeedika
   Kavana
   Kavana Gov. LPS
   Nadukkara
   Panchayath Office
   Anicadu
   P.h.c
   Companippady
   Nirmala College

Economy

Rubber, pineapple, and coconut are the main cultivation of this village. Places in and around Avoly

   Vazhakulam
   Ayavana
   Muvattupuzha
   Mullappuzhachal

"What did they mean by this maintenance tag?" (Scale-free ideal gas)

Full prompt: "Which of these categories isn't backed up by the article text?"

The following is a Wikipedia stub article titled "Scale-free ideal gas".

This article contains uncited categories. Please help improve this article by adding citations to reliable sources. Unsourced categories may be challenged and removed.

The scale-free ideal gas (SFIG) is a physical model assuming a collection of non-interacting elements with a stochastic proportional growth. It is the scale-invariant version of an ideal gas. Some cases of city-population, electoral results and cites to scientific journals can be approximately considered scale-free ideal gases.[1]

In a one-dimensional discrete model with size-parameter k, where k1 and kM are the minimum and maximum allowed sizes respectively, and v = dk/dt is the growth, the bulk probability density function F(k, v) of a scale-free ideal gas follows

   F ( k , v ) = N Ω k 2 exp ⁡ [ − ( v / k − w ¯ ) 2 / 2 σ w 2 ] 2 π σ w , {\displaystyle F(k,v)={\frac {N}{\Omega k^{2}}}{\frac {\exp \left[-(v/k-{\overline {w}})^{2}/2\sigma _{w}^{2}\right]}{{\sqrt {2\pi }}\sigma _{w}}},} {\displaystyle F(k,v)={\frac {N}{\Omega k^{2}}}{\frac {\exp \left[-(v/k-{\overline {w}})^{2}/2\sigma _{w}^{2}\right]}{{\sqrt {2\pi }}\sigma _{w}}},}

where N is the total number of elements, Ω = ln k1/kM is the logaritmic "volume" of the system, w ¯ = ⟨ v / k ⟩ {\displaystyle {\overline {w}}=\langle v/k\rangle } {\displaystyle {\overline {w}}=\langle v/k\rangle } is the mean relative growth and σ w {\displaystyle \sigma _{w}} {\displaystyle \sigma _{w}} is the standard deviation of the relative growth. The entropy equation of state is

   S = N κ { ln ⁡ Ω N 2 π σ w H ′ + 3 2 } , {\displaystyle S=N\kappa \left\{\ln {\frac {\Omega }{N}}{\frac {{\sqrt {2\pi }}\sigma _{w}}{H'}}+{\frac {3}{2}}\right\},} {\displaystyle S=N\kappa \left\{\ln {\frac {\Omega }{N}}{\frac {{\sqrt {2\pi }}\sigma _{w}}{H'}}+{\frac {3}{2}}\right\},}

where κ {\displaystyle \kappa } \kappa is a constant that accounts for dimensionality and H ′ = 1 / M Δ τ {\displaystyle H'=1/M\Delta \tau } {\displaystyle H'=1/M\Delta \tau } is the elementary volume in phase space, with Δ τ {\displaystyle \Delta \tau } \Delta \tau the elementary time and M the total number of allowed discrete sizes. This expression has the same form as the one-dimensional ideal gas, changing the thermodynamical variables (N, V, T) by (N, Ω,σw).

Zipf's law may emerge in the external limits of the density since it is a special regime of scale-free ideal gases.[2] References

Hernando, A.; Vesperinas, C.; Plastino, A. (2010). "Fisher information and the thermodynamics of scale-invariant systems". Physica A: Statistical Mechanics and Its Applications. 389 (3): 490–498. arXiv:0908.0504. Bibcode:2010PhyA..389..490H. doi:10.1016/j.physa.2009.09.054. S2CID 14862680. Hernando, A.; Puigdomènech, D.; Villuendas, D.; Vesperinas, C.; Plastino, A. (2009). "Zipf's law from a Fisher variational-principle". Physics Letters A. 374 (1): 18–21. arXiv:0908.0501. Bibcode:2009PhLA..374...18H. doi:10.1016/j.physleta.2009.10.027. S2CID 6643256.

The categories are "Information theory", "Thermodynamics", and "Scale-invariant systems".

Which of these categories isn't backed up by the article text?

The category "Information theory" isn't backed up by the article text.

Uh, can you explain that a little more?

Sure! The category "Information theory" is not supported by the references or the content of the article. While the article mentions Fisher information and the Fisher variational-principle, it does not explain how they relate to information theory. The article focuses on the thermodynamics and scale-invariant systems of the scale-free ideal gas model, but does not discuss information theory in detail. Therefore, the category "Information theory" should be considered uncited and may need to be removed or replaced with a more accurate category.

Do you think it makes sense to tag the article with an "uncited categories" template just because it doesn't explain broader mathematical concepts?

As a language model AI, I do not have personal opinions. But based on the general Wikipedia guidelines, it is appropriate to tag an article with an "uncited categories" template if the categories do not have any references that support their inclusion in the article. The purpose of the template is to encourage editors to provide reliable sources to support the categories. In this case, since the article mentions Fisher information and the Fisher variational-principle but does not explain how they relate to information theory, it may be appropriate to tag the article with an "uncited categories" template. However, if the category is not deemed important or relevant to the topic of the article, it may be removed without the need for additional references.

"What did they mean by this maintenance tag?" (Ömer Küyük)

Full prompt: "Of these categories, which aren't backed up by cited article text?"

The following is a Wikipedia stub article titled "Ömer Küyük".

Ömer Küyük (1900 – 12 January 2006) was one of the last Turkish veterans of the Turkish War of Independence (1919–1923).

Called Turkish: Nişancı Er Ömer, he fought in the Independence War as a marksman private.

He lived in the small town of Iskilip in Çorum Province,[1] and died on January 12, 2006, at the age of 106.

His memories from the War of Independence and his daily life along with those of two other veterans, Veysel Turan and Yakup Satar, are depicted in the documentary film Son Buluşma (2007) (English: The Last Meeting) by Nesli Çölgeçen.[2] References

ABC News-I'm Still Alive, Declares 'dead' Turkish War Veteran 2004-05-06

The categories are "1900 births", "2006 deaths", "People from İskilip", "Turkish military personnel of the Turkish War of Independence", "Members of Kuva-yi Milliye", "Turkish centenarians", and "Men centenarians".

Of these categories, which aren't backed up by cited article text?

The categories "Members of Kuva-yi Milliye" and "Men centenarians" are not backed up by the cited article text.