Jump to content

ChatGPT in education

From Wikipedia, the free encyclopedia

Output from ChatGPT generating an essay draft

Since the public release of ChatGPT by OpenAI in November 2022, the integration of chatbots in education has sparked considerable debate and exploration. Educators' opinions vary widely; while some are skeptical about the benefits of large language models, many see them as valuable tools.[1]

ChatGPT serves multiple educational purposes, including providing topic overviews, generating ideas, and assisting in drafting.[2] A 2023 study highlighted its greater acceptance among professors compared to students.[1] Moreover, chatbots show promise in personalized tutoring.[3]

Efforts to ban chatbots like ChatGPT in schools focus on preventing cheating, but enforcement faces challenges due to AI detection inaccuracies and widespread accessibility of chatbot technology. Banning could also hinder students' opportunities to learn effective technology usage, while straining teacher-student relationships.[2]

Background

[edit]

ChatGPT is a virtual assistant developed by OpenAI and launched in November 2022. It uses advanced artificial intelligence (AI) models called generative pre-trained transformers (GPT), such as GPT-4o, to generate text. GPT models are large language models that are pre-trained to predict the next token in large amounts of text (a token usually corresponds to a word, subword or punctuation). This pre-training enables them to generate human-like text, by repeatedly predicting the next likely token. After pre-training, these GPT models were fine-tuned to adopt an assistant role, improve response accuracy and reduce harmful content; using supervised learning and reinforcement learning from human feedback (RLHF).[4]

Effectiveness and applications

[edit]

In a January 2023 assessment, ChatGPT demonstrated performance comparable to graduate-level standards at institutions such as the University of Minnesota and Wharton School.[5] A blind study conducted at the University of Wollongong Law School compared GPT-3.5 and GPT-4 with 225 students in an end-of-semester criminal law exam. The findings revealed that the average score of the students was considerably higher than the GenAI models.[6]

Its application in fields like computer programming and numerical methods has been explored and validated.[7] Assessment psychologist Eka Roivainen's study suggested ChatGPT's verbal IQ approximates the top 0.1% of test-takers.[8] One notable drawback of ChatGPT is occasional inaccuracies detected in academic assignments, particularly in technical subjects such as mathematics, as noted by educators like Ethan Mollick from the Wharton School.[9]

A survey conducted between March and April 2023 revealed 58% of American students acknowledged using ChatGPT, with 38% admitting use without teacher consent, highlighting challenges in enforcing bans.[10][11]

In response to educational demand, OpenAI launched "ChatGPT Edu" in May 2024, aiming to offer universities affordable access to this technology.[12]

AI tools like ChatGPT have shown promise in enhancing literacy skills among adolescents and adults. They provide instant feedback on writing, aid in idea generation, and help improve grammar and vocabulary.[13] These tools can also support students with disabilities, such as dyslexia, by assisting with spelling and grammar. Additionally, AI can facilitate higher-order thinking by automating lower-order tasks, allowing students to focus on complex conceptual work.[14] AI tools like GitHub Copilot, similar to ChatGPT, have significantly impacted programming by enhancing productivity and influencing developers' perceptions of AI in technical fields.[15]

The education technology company Chegg, which was a website dedicated to helping students with assignments using a database of collected worksheets and assignments, became one of the most prominent business victims to ChatGPT, with its stock price nearly being cut in half after a quarterly earnings call in May 2023.[16][17]

A study critically examined in 2023 the role of ChatGPT in education. The authors had ChatGPT generate a SWOT analysis of itself in an educational setting, identifying several key issues and potential uses. They highlighted that while ChatGPT can generate human-like responses and assist with personalized learning, it also has limitations. For instance, the AI may produce inaccurate information, known as "hallucinations", which can be difficult for students to distinguish from accurate responses. This underscores the importance of teaching digital literacy and critical thinking skills. The study also noted that ChatGPT's responses often lacked depth in understanding broader educational goals and processes, focusing primarily on providing immediate answers to queries. The potential biases in ChatGPT's training data and the ethical implications of its use were also discussed, particularly concerning the control exerted by its developers over the content it generates.[18]

Academic misconduct and challenges

[edit]

ChatGPT's capability to generate assignments has prompted concerns about academic integrity, particularly in essay writing, with critics foreseeing potential misuse and devaluation of traditional writing skills.[19][20][21]

One instance, as reported by Rolling Stone, resulted in a professor at Texas A&M University misusing ChatGPT to check student assignments for verifying whether an assignment utilized the large language model. ChatGPT returned a result of all students using it, and so the professor promptly returned a failing grade to all of his students. Rolling Stone noted however that ChatGPT is unable to reliably verify whether it was used to write student assignments, and a post to a Reddit community dedicated to ChatGPT received widespread attention with many attacking the professor for a lack of familiarity towards the chatbot.[22][23] More recently, a 2024 study found that increased academic workload and time constraints lead students to use ChatGPT more frequently. However, this reliance is associated with negative outcomes like procrastination, memory loss, and decreased academic performance.[24][25]

Support and opposition

[edit]

The impact of ChatGPT on education, especially in English studies, is a topic of significant discussion. Daniel Herman's perspective reflects concerns about the potential devaluation of writing skills if AI can generate text as easily as humans.[26] Similarly, Naomi S. Baron wrote that "If AI text generation does our writing for us, we diminish opportunities to think out problems for ourselves". She also mentioned the risk of a slippery slope, where students start letting generative AI control the content and style of their writing, leading to a diminished sense of ownership.[27] On the other hand, Chris Stokel-Walker and Emma Bowman highlight the need for educators to adapt their methods to focus more on critical thinking and reasoning, as AI tools like ChatGPT could potentially be used for plagiarism or produce biased content. It's a complex issue with various viewpoints and implications for how education may evolve in the future. The theory that ChatGPT will destroy education is disputed almost as widely as it is believed. Kevin Brown of Christianity Today wrote that the human brain remains consistently better able to create material than ChatGPT. Brown further argued that education in its spirit will continue to live on and that ChatGPT could only revolutionize teaching methods.[20] The New York Times' Kevin Roose also reported that ChatGPT's prohibition would never be able to be practiced effectively, noting it would be impossible to police. Roose noted that students can access the internet outside of schools, effectively rendering a ban obsolete; Roose suggested instead that teachers allow it openly for some assignments similar to calculators, and that teaching with the AI is the best approach.[28] The oral exam has also been used as an example of an instruction method which could circumvent the assignment and test students' knowledge more effectively on a 1:1 basis.[29]

This technological evolution prompts educators to rethink pedagogical approaches, emphasizing critical thinking and ethical AI usage. Proponents argue for integrating ChatGPT into educational frameworks responsibly, leveraging its potential to enhance learning outcomes through personalized approaches.[30][31]

Bans

[edit]

Some educational institutions have chosen to ban access to ChatGPT. The reasons behind these decisions likely vary, but concerns about potential misuse, such as plagiarism or reliance on AI for writing tasks, could be driving factors. ChatGPT has been met with various bans from certain educational institutions. One of the earliest districts to ban the tool was the Los Angeles Unified School District, which blocked access to the tool less than a month after its official release.[32] The New York City Department of Education reportedly blocked access to ChatGPT in December 2022[33] and officially announced a ban around January 4, 2023.[34][35]

In February 2023, the University of Hong Kong sent a campus-wide email to instructors and students stating that the use of ChatGPT or other AI tools is prohibited in all classes, assignments and assessments at the university. Any violations would be treated as plagiarism by the university unless the student obtains the prior written consent from the course instructor.[36][37]

Shift in the perception of ChatGPT in education

[edit]

Some schools in the United States for the 2023–24 school year announced a repeal of their bans for ChatGPT. New York City repealed its ban in May 2023 while replacing it with a statement which encourages students to learn how to use generative AI, and in rural Washington, Walla Walla Public Schools announced it would repeal its ban of ChatGPT in student assignments.[32][38][39] A professor at the University of California, Los Angeles, has permitted the incorporation of ChatGPT into his students' writing process instead of banning the use of this new technology.[40] He argued that educators should teach students to use ChatGPT ethically and productively, and that it is not feasible or practical to ban students from using it.[40] He also discussed the benefits of learning to write well with AI assistance, and stressed on the importance of being responsible users of AI.[40]

Adoption into assignments

[edit]

Some professors have created separate college courses designed specifically to train generative AI. For example, Arizona State University professor Andrew Maynard and Vanderbilt professor Jules White both developed a new course specifically for prompt engineering generative AI chatbots.[41] Other instructors, such as Ethan Mollick at Wharton, have, in the face of inevitable use by students regardless of prohibition, not only accepted usage of generative AI but required all students to use ChatGPT in their assignments. Mollick reported to NPR that the usage of ChatGPT generally improved his students' work, using AI to further assist in the generation of ideas.[9] Some professors have focused on creating learning material and have highlighted the opportunities of using ChatGPT to personalize assignments to a student's background.[42] In 2024, the Los Angeles Unified School District introduced Ed, a chatbot developed in response to ChatGPT's use in classrooms.[43][44] The use of AI in education has vast potential. It can provide personalized learning experiences and adaptive teaching methods.[45]

Detection software

[edit]
Main article: Artificial intelligence content detection

Some companies have responded to the influx of ChatGPT and generative AI among students by developing detection software which flags down essays likely written by AI. Among the first companies to develop solutions like this was Turnitin, which developed a tool to detect AI-based academic dishonesty. A corporate blog post from the company stated that the company's database of numerous student essays was used to train its own detection system. When tested by The Washington Post, though, noted that Turnitin's detector flagged an innocent student for using ChatGPT to generate the conclusion of her essay.[46] The company itself reported that its detector was not always accurate as well.[47][48]

Numerous tools such as GPTZero were created as tools to detect AI-generated text, and numerous other startups have released tools on detecting AI-written work, including OpenAI itself. However, research reports have stated that detection software often fails to detect content generated by AI, and that these tools are easy to fool.[49][50][51] OpenAI's official tool, Classifier, launched in January 2023, was later taken down in August 2023 due to low usage and accuracy issues.[52][53][54]

References

[edit]
  1. ^ a b Toppo, Greg (April 8, 2023). "Teachers are embracing ChatGPT—even more than students". Fast Company.
  2. ^ a b Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times.
  3. ^ Trumbore, Anne (February 22, 2023). "ChatGPT could be an effective and affordable tutor". The Conversation. Retrieved June 12, 2024.
  4. ^ Gerjets, Peter; Warschauer, Mark; Tate, Tamara; Chen, Xiaobin; Alekseeva, Anastasiia; Fischer, Christian; Fütterer, Tim (2023). "ChatGPT in education: global reactions to AI innovations". Scientific Reports. 13 (1): 15310. Bibcode:2023NatSR..1315310F. doi:10.1038/s41598-023-42227-6. PMC 10504368. PMID 37714915.
  5. ^ Kelly, Samantha Murphy (January 26, 2023). "ChatGPT passes exams from law and business schools". CNN. Retrieved February 3, 2023.
  6. ^ Alimardani, Armin (September 23, 2024). "Generative artificial intelligence vs. law students: an empirical study on criminal law exam performance". Law, Innovation and Technology: 1–43. doi:10.1080/17579961.2024.2392932. ISSN 1757-9961.
  7. ^ Kashefi, Ali; Mukerji, Tapan (2023). "ChatGPT for Programming Numerical Methods". arXiv:2303.12093 [cs.LG].
  8. ^ Roivainen, Eka (March 28, 2023). "I Gave ChatGPT an IQ Test. Here's What I Discovered". Scientific American. Retrieved April 3, 2023.
  9. ^ a b Kelly, Mary Louise (January 26, 2023). "'Everybody is cheating': Why this teacher has adopted an open ChatGPT policy". NPR. Retrieved October 10, 2023.
  10. ^ Klar, Rebecca (May 10, 2023). "Teens use, hear of ChatGPT more than parents: poll". The Hill. Retrieved June 15, 2023.
  11. ^ Impact Research. "Parents and students are optimistic about AI, but parents have a lot to learn to catch up to their kids – and want rules and ratings to help them" (PDF). Common Sense Media. Retrieved June 15, 2023.
  12. ^ "OpenAI unveils ChatGPT Edu to bring AI responsibly to university campuses". The Indian Express. May 31, 2024. Retrieved June 16, 2024.
  13. ^ Mahapatra, Santosh (February 13, 2024). "Impact of ChatGPT on ESL students' academic writing skills: a mixed methods intervention study". Smart Learning Environments. 11 (1): 9. doi:10.1186/s40561-024-00295-9. ISSN 2196-7091.
  14. ^ Bronstein, Briana; Wolfe, Zora M.; Ciampa, Katia (September 26, 2023). "Transforming digital literacy practices". ChatGPT in Education. 67 (3): 186–195. doi:10.1002/jaal.1310.
  15. ^ Eshraghian, Farjam; Hafezieh, Najmeh; Farivar, Farveh; de Cesare, Sergio (April 2, 2024). "AI in software programming: understanding emotional responses to GitHub Copilot". Information Technology & People. ahead-of-print (ahead-of-print). doi:10.1108/ITP-01-2023-0084. ISSN 0959-3845.
  16. ^ Dave, Paresh (June 5, 2023). "Chegg Embraced AI. ChatGPT Ate Its Lunch Anyway". Wired. ISSN 1059-1028. Retrieved October 18, 2023.
  17. ^ Shin, Rachel (July 12, 2023). "A.I. can kill your business in an instant. Just ask the CEO of Chegg". Fortune. Retrieved October 18, 2023.
  18. ^ Loos, Eugène; Gröpler, Johanna; Goudeau, Marie-Louise Sophie (August 21, 2023). "Using ChatGPT in Education: Human Reflection on ChatGPT's Self-Reflection". Societies. 13 (8): 196. doi:10.3390/soc13080196.
  19. ^ Marche, Stephen (December 6, 2022). "The College Essay Is Dead". The Atlantic. Retrieved October 10, 2023.
  20. ^ a b Brown, Kevin (December 23, 2022). "Why Educators Shouldn't Be Worried About AI". ChristianityToday.com. Retrieved October 10, 2023.
  21. ^ Bowman, Emma (December 19, 2022). "A new AI chatbot might do your homework for you. But it's still not an A+ student". NPR. Retrieved October 10, 2023.
  22. ^ Klee, Miles (May 17, 2023). "Professor Flunks All His Students After ChatGPT Falsely Claims It Wrote Their Papers". Rolling Stone. Retrieved October 10, 2023.
  23. ^ "College instructor put on blast for accusing students of using ChatGPT". NBC News. May 18, 2023. Retrieved October 10, 2023.
  24. ^ Dolan, Eric W. (March 25, 2024). "ChatGPT linked to declining academic performance and memory loss in new study". PsyPost - Psychology News. Retrieved March 30, 2024.
  25. ^ ABBAS, Muhammad (February 16, 2024). "Is it harmful or helpful? Examining the causes and consequences of generative AI usage among university students". International Journal of Educational Technology in Higher Education. 21 (10). doi:10.1186/s41239-024-00444-7.
  26. ^ Herman, Daniel (December 9, 2022). "The End of High-School English". The Atlantic. Retrieved September 16, 2024.
  27. ^ Baron, Naomi S. (January 19, 2023). "How ChatGPT robs students of motivation to write and think for themselves". The Conversation. Retrieved September 16, 2024.
  28. ^ Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times. ISSN 0362-4331. Retrieved October 10, 2023.
  29. ^ Belkin, Douglas (June 1, 2023). "As AI-Enabled Cheating Roils Colleges, Professors Turn to an Ancient Testing Method". Wall Street Journal. ISSN 0099-9660. Retrieved October 10, 2023.
  30. ^ Roose, Kevin (January 12, 2023). "Don't Ban ChatGPT in Schools. Teach With It". The New York Times. ISSN 0362-4331. Retrieved October 10, 2023.
  31. ^ Belkin, Douglas (June 1, 2023). "As AI-Enabled Cheating Roils Colleges, Professors Turn to an Ancient Testing Method". Wall Street Journal. ISSN 0099-9660. Retrieved October 10, 2023.
  32. ^ a b Singer, Natasha (August 24, 2023). "Despite Cheating Fears, Schools Repeal ChatGPT Bans". The New York Times. ISSN 0362-4331. Retrieved October 10, 2023.
  33. ^ "New York City Department of Education Bans ChatGPT". GovTech. January 10, 2023. Archived from the original on February 16, 2023. Retrieved February 16, 2023.
  34. ^ Cole, Samantha (January 4, 2023). "NYC Bans Students and Teachers from Using ChatGPT". www.vice.com. Archived from the original on January 5, 2023. Retrieved January 5, 2023.
  35. ^ Ropek, Lucas (January 4, 2023). "New York City Schools Ban ChatGPT to Head Off a Cheating Epidemic". Gizmodo. Archived from the original on January 6, 2023. Retrieved January 6, 2023.
  36. ^ "港大禁用ChatGPT等AI工具，为全港大学首例". The Paper. China News Service. February 18, 2023. Archived from the original on March 6, 2023. Retrieved February 19, 2023.
  37. ^ Yau, Cannix; Chan, Kahon (February 17, 2023). "University of Hong Kong temporarily bans students from using ChatGPT". South China Morning Post. Archived from the original on February 19, 2023. Retrieved February 19, 2023.
  38. ^ Faguy, Ana. "New York City Public Schools Reverses ChatGPT Ban". Forbes. Archived from the original on May 21, 2023. Retrieved May 21, 2023.
  39. ^ Serrano, Jody (May 19, 2023). "New York City Schools Lift Ban on ChatGPT, Say Initial Fear 'Overlooked the Potential' of AI". Gizmodo. Archived from the original on May 21, 2023. Retrieved May 21, 2023.
  40. ^ a b c Villasenor, John (February 10, 2023). "How ChatGPT Can Improve Education, Not Threaten It". Scientific American. Retrieved December 7, 2023.
  41. ^ Coffey, Lauren. "Professors Craft Courses on ChatGPT With ChatGPT". Inside Higher Ed. Retrieved October 10, 2023.
  42. ^ Einarsson, Hafsteinn (December 13, 2023). "Application of ChatGPT for automated problem reframing across academic domains". Computers and Education: Artificial Intelligence. 6. doi:10.1016/j.caeai.2023.100194. hdl:20.500.11815/4807.
  43. ^ Langreo, Lauraine (March 21, 2024). "Los Angeles Unified Bets Big on 'Ed,' an AI Tool for Students". Education Week.
  44. ^ Ward, Micah (August 8, 2023). "Meet 'Ed,' L.A. Unified's new artificially intelligent student advisor". District Administration.
  45. ^ Popescu, Anca (January 9, 2024). "AI's Secret Weapon in Education. ChatGPT – The Future of Personalized Learning". Bulletin of the Transilvania University of Brasov. Series V: Economic Sciences: 45–52. doi:10.31926/but.es.2023.16.65.2.5. ISSN 2065-2208.
  46. ^ Fowler, Geoffrey A. (April 14, 2023). "Analysis | We tested a new ChatGPT-detector for teachers. It flagged an innocent student". Washington Post. ISSN 0190-8286. Retrieved October 10, 2023.
  47. ^ Delouya, Samantha. "Turnitin is the go-to software to catch students cheating. Now it's focused on a potential cat-and-mouse game with OpenAI's new ChatGPT chatbot". Business Insider. Retrieved October 10, 2023.
  48. ^ "Sneak preview of Turnitin's AI writing and ChatGPT detection capability". www.turnitin.com. January 13, 2023. Retrieved October 10, 2023.
  49. ^ "ChatGPT Detectors Are Biased and Easy to Fool, Research Shows". CNET. Retrieved October 10, 2023.
  50. ^ Barshay, Jill (September 4, 2023). "PROOF POINTS: It's easy to fool ChatGPT detectors". The Hechinger Report. Retrieved October 10, 2023.
  51. ^ Alimardani, Armin; Jane, Emma A. (February 19, 2023). "We pitted ChatGPT against tools for detecting AI-written text, and the results are troubling". The Conversation. Retrieved October 16, 2024.
  52. ^ Goodwin, Danny (July 26, 2023). "OpenAI's AI Text Classifier no longer available due to 'low rate of accuracy'". Search Engine Land. Retrieved October 10, 2023.
  53. ^ David, Emilia (July 25, 2023). "OpenAI can't tell if something was written by AI after all". The Verge. Retrieved October 10, 2023.
  54. ^ Elkhatat, Ahmed M. (January 1, 2023). "Evaluating the efficacy of AI content detection tools in differentiating between human and AI-generated text". EBSCO.
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=ChatGPT_in_education&oldid=1253014265"