Jump to content

Scott Deerwester

From Wikipedia, the free encyclopedia

Scott Craig Deerwester is an American computer scientist and Computer engineer who created the mathematical and natural language processing (NLP) technique known as latent semantic analysis (LSA).[1][2]

Early life

[edit]

Deerwester was born in Rossville, Indiana, United States. He is the son of Kenneth F. Deerwester (July 8, 1927 – March 3, 2013) and Donna Stone.[citation needed]

Scientific career

[edit]

Deerwester began his academic career in the United States, contributing to the development of LSA during his tenure at Colgate University and the University of Chicago.[citation needed] Deerwester published his first research paper, The Retrieval Expert Model of Information Retrieval, at Purdue University in 1984.[3]

Publications and research work

[edit]

Deerwester co-authored a research paper on LSA in 1988.[citation needed] This paper transformed how information retrieval systems process textual information by finding latent associations between keywords in documents even when they lack common words. This method addressed many problems related to polysemy (words containing multiple meanings) and synonymy (different words with similar meanings).[4]

According to Deerwester's seminal 1988 work, Latent Semantic Analysis, LSA enabled search engines to retrieve relevant documents even when they did not contain the exact keywords, which lead to a more user-friendly and contextual retrieval mechanism.[1] His work impacted the advancement of subsequent technologies, such as Latent Dirichlet Allocation (LDA), probabilistic models, and its uses in topic modeling and semantic similarity in texts.[2]

LSA is a tool for AI applications that ranges from chatbots to automatic translation services, and has the ability to emulate some human traits such as word sorting and category assessment.[citation needed] Deerwester's work has found applications in data mining, recommender systems, and business intelligence tools.[citation needed]

References

[edit]
  1. ^ a b Deerwester, Scott; Dumais, Susan T.; Furnas, George W.; Landauer, Thomas K.; Harshman, Richard (September 1990). "Indexing by latent semantic analysis". Journal of the American Society for Information Science. 41 (6): 391–407. doi:10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9. ISSN 0002-8231.
  2. ^ a b Dumais, S. T.; Furnas, G. W.; Landauer, T. K.; Deerwester, S.; Harshman, R. (1988-05-01). "Using latent semantic analysis to improve access to textual information". Proceedings of the SIGCHI conference on Human factors in computing systems – CHI '88. New York, NY, USA: Association for Computing Machinery. pp. 281–285. doi:10.1145/57167.57214. ISBN 978-0-201-14237-2.
  3. ^ Deerwester, Scott (1984). "The retrieval expert model of information retrieval". Google Scholar. Retrieved 18 October 2024.
  4. ^ Hurtado, Jose L.; Agarwal, Ankur; Zhu, Xingquan (14 April 2016). "Topic discovery and future trend forecasting for texts". Journal of Big Data. 3. doi:10.1186/s40537-016-0039-2.
[edit]