Jump to content

Project Iris

From Wikipedia, the free encyclopedia

Project Iris is the codename for an unreleased augmented reality (AR) headset designed and developed by Google. It was intended to resemble ordinary eyeglasses and expected to be released in 2024, until its cancellation in early 2023.

Following the highly publicized failure of Google Glass smartglasses in 2013, Google executives were initially disinclined to re-enter the field of wearable AR technology. However, work had begun on a new AR headset by 2021 under the leadership of Mark Lucovsky, codenamed Project Iris. The project underwent a turbulent development stage, with Google executives constantly shifting their vision for Iris. To facilitate its efforts, the company also acquired North and Raxium.

After going through numerous iterations, a version of Iris was unveiled at the 2022 Google I/O keynote before undergoing public testing later that year. In June 2023, after Apple beat Google to the punch and unveiled the Vision Pro mixed reality headset, Google abandoned the project in the midst of company-wide layoffs and internal turmoil, with Project Moohan and Betty intended to serve as Iris' spiritual successors.

History

[edit]

Background

[edit]

Google first experimented with the prospect of smartglasses with the introduction of Google Glass in 2013.[1] The product was panned by critics due to privacy and ethical concerns,[2] leading Google to discontinue the consumer-facing model and focus on the enterprise model.[3][4] In May 2019, Google VR/AR head Clay Bavor told CNET that the company was heavily invested in R&D regarding AR devices,[5] while a February 2020 report from The Information revealed that Google had no plans to develop a new pair of augmented reality (AR) smartglasses as of mid-2019, in part due to the highly publicized failure of Glass.[6] In June 2020, Google acquired North, a manufacturer of smartglasses, to assist in its hardware division's vision of ambient computing.[7] Shortly after the acquisition, the company began work on a new pair of AR smartglasses based on North designs,[8] which The New York Times confirmed in December 2021.[9]

In August 2021, following the announcement that the Pixel 6 and Pixel 6 Pro smartphones would feature the custom-developed Tensor system-on-chip (SoC), Google hardware chief Rick Osterloh told Business Insider that he believed that Tensor had long-term potential for AR-powered smartglasses,[10] and was echoed by CEO Sundar Pichai in October.[11] In November, a "Google Labs" division led by Bavor was created to oversee Google's AR and virtual reality (VR) ventures, unrelated to the defunct service of the same name,[12] while development on an AR operating system began the next month for an unknown "innovative AR device", an effort spearheaded by Mark Lucovsky.[13] Meanwhile, Google began work on two custom system-on-chips akin to Tensor, codenamed Alius and Alexandrite, which would power its smartglasses.[8]

Development

[edit]

In January 2022, The Verge reported that Google was building an AR headset that used "outward-facing cameras to blend computer graphics with a video feed of the real world", internally codenamed Project Iris and being developed in a highly secretive and secure facility located in the San Francisco Bay Area. Overseen by Bavor, the headset was to be powered by the Android operating system as well as a custom system-on-chip, expected to launch in 2024 alongside the experimental Project Starline. Other key people named as part of the project include Shahram Izadi, Eddie Chung, Scott Huffman, Kurt Akeley, Paul Greco, and Lucovsky.[14][8] Over the next two years, Google executives constantly changed strategies regarding Project Iris, frustrating employees.[15][8]

During this time, longtime Google rival Apple was concurrently developing its own mixed reality (MR) headset,[16] eventually announced as the Vision Pro.[17] When reports began to surface in early 2022 that Apple was making significant progress on the Vision Pro and nearing an official launch, Google executives panicked and formed a partnership with Android collaborator Samsung, who also wished to build an MR headset. As part of "Project Moohan", Google agreed to provide Samsung with the software for a headset designed by Samsung. Moohan resembled ski goggles and had a targeted release date of 2024. However, tensions soon arose between the two companies, with Samsung consolidating its control over the project to prevent Google from building a rival product.[8][15][18]

In March 2022, The Information reported that Google would acquire Raxium, an AR hardware startup, for approximately $1 billion, and would continue to make further acquisitions to assist in their AR and MR work.[19] The acquisition was completed a month later.[20] During the 2022 Google I/O keynote in May, Google unveiled a version of Iris resembling eyeglasses with live translation capabilities.[15][21][22] The company began publicly testing these prototypes across the U.S. in August,[23] before expanding into Canada in October.[24] In December 2022, 9to5Google reported that the company was considering using rings or bracelets to control Iris.[25] Google discontinued Glass Enterprise in March 2023.[26]

Cancellation

[edit]

In June 2023, Apple unveiled the Vision Pro, frustrating many Google employees.[8] Three weeks later, Business Insider reported that Google had shelved Project Iris as part of its company-wide cost-cutting measures earlier in the year, which saw mass layoffs and the departure of Bavor. The final product would have resembled ordinary eyeglasses.[15][27] The Verge observed that Akeley was now listed as retired on LinkedIn, while Lucovsky, many North employees, and several other engineers remained involved in Google's AR ventures;[27] Chung had departed the company in February. Lucovsky left the following month, and Izadi assumed leadership of the AR division, now focused mainly on Project Moohan and reporting to Google senior vice president Hiroshi Lockheimer.[8] Employees did not rule out the possibility of Iris being resurrected in the future.[15] 9to5Google unearthed evidence in November that pointed to a possible revival of the project, locating a new string of code on the Google app on Android referencing Iris and the ability to activate the Google Assistant virtual assistant by touching one's right temple.[28] Google laid off much of its AR hardware team in January 2024.[29]

Meanwhile, Google shifted its attention from hardware to AR and MR software, which they hoped to license to third-party manufacturers à la Android.[15][27] A new team under Izadi began incorporating Iris' code into a new project codenamed Betty, intended to be part of a "Micro XR" platform that would be pitched to manufacturers. The former Raxium team continued to explore potential AR hardware projects under Greco's supervision, but was reportedly "firewalled" from the Moohan and Betty crews. A Google employee described the situation as "a weird bureaucratic mess".[8][18] The Information reported in December 2023 that Google was also looking to integrate a new virtual assistant codenamed "Pixie", powered by its recently announced Gemini large language model, into glasses.[30][31]

Critical commentary

[edit]

Writing for 9to5Google, Abner Li opined in February 2021 that Google should begin work on AR glasses technology as soon as possible to counter similar efforts from Apple if it wished not to be left behind in the future.[32] Following The Verge's report on Project Iris, Nicholas Sutrich of Android Central and analyst Anshel Sag of Moor Insights & Strategy agreed that it would be a daunting task for Google to reinstill the public's trust in its commitment to supporting its products in the long term, as well as demonstrate its investment in extended reality (XR), citing the failure of the Stadia cloud gaming service as a cautionary tale.[33] Tom Pritchard of Tom's Guide believed that Google's acquisition of Raxium technologies gave it an edge over other potential competitors.[34]

On the AR translation glasses Google demoed at I/O in 2022, The Verge's Antonio G. Di Benedetto and Mitchell Clark felt that Google's apparent goal to break down the language barrier was ambitious and difficult to accomplish,[35] while their colleague Sean Hollister wrote that Google would have to develop AR experiences "more compelling or convenient than what phones already offer".[36] After news broke that the project had been scrapped, Li expressed concern for Google's hardware division, deeming the cancellation a missed opportunity,[37] while Charlie Sorrel of Lifewire speculated that Google may have been intimidated by the Vision Pro. Lorne Fade, the co-founder of the VR Vision training company, reasoned that Google would likely "follow Apple and come out with an XR device in the coming years".[38]

See also

[edit]

References

[edit]
  1. ^ Goldman, David (April 4, 2012). "Google unveils 'Project Glass' virtual-reality glasses". CNN Money. Archived from the original on April 7, 2012. Retrieved December 31, 2021.
  2. ^ Arthur, Charles (March 3, 2013). "Google Glass: is it a threat to our privacy?". The Guardian. Archived from the original on September 21, 2013. Retrieved December 31, 2021.
  3. ^ Luckerson, Victor (January 15, 2015). "Google Will Stop Selling Glass Next Week". Time. Archived from the original on January 15, 2015. Retrieved December 31, 2021.
  4. ^ Savov, Vlad (July 18, 2017). "Google Glass gets a second chance in factories, where it's likely to remain". The Verge. Archived from the original on July 18, 2017. Retrieved December 31, 2021.
  5. ^ Stein, Scott (May 7, 2019). "Google won't release an Oculus Quest VR competitor anytime soon". CNET. Archived from the original on August 28, 2021. Retrieved December 31, 2021.
  6. ^ Bastone, Nick (February 14, 2020). "As Apple and Facebook Embrace AR Fully, Google Takes It Slow". The Information. Archived from the original on February 15, 2020. Retrieved December 31, 2021.
  7. ^ Bursztynsky, Jessica (June 30, 2021). "Google acquires North, which makes smart glasses similar to Google Glass". CNBC. Archived from the original on July 1, 2020. Retrieved December 31, 2021.
  8. ^ a b c d e f g h Langley, Hugh (August 22, 2023). "Google's augmented-reality dream turned into chaos. Insiders say constant pivots are delaying its master plan to chase Apple". Business Insider. Archived from the original on August 22, 2023. Retrieved August 30, 2023.
  9. ^ Metz, Cade (December 30, 2021). "Everybody Into the Metaverse! Virtual Reality Beckons Big Tech". The New York Times. Archived from the original on December 30, 2021. Retrieved December 31, 2021.
  10. ^ Eadicicco, Lisa (August 2, 2021). "Google wants its new chip to totally transform the smartphone. Its hardware chief tells us how". Business Insider. Archived from the original on August 2, 2021. Retrieved December 31, 2021.
  11. ^ Li, Abner (October 26, 2021). "Sundar Pichai says Google hardware & platform teams are 'thinking through' AR". 9to5Google. Archived from the original on October 27, 2021. Retrieved December 31, 2021.
  12. ^ Perez, Sarah (November 11, 2021). "Google reorg moves AR, VR, Starline and Area 120 into new 'Labs' team". TechCrunch. Archived from the original on November 11, 2021. Retrieved December 31, 2021.
  13. ^ Porter, Jon (December 14, 2021). "Google staffs up to build OS for unknown 'innovative AR device'". The Verge. Archived from the original on December 14, 2021. Retrieved December 31, 2021.
  14. ^ Heath, Alex (January 20, 2022). "Google is building an AR headset". The Verge. Archived from the original on January 20, 2022. Retrieved March 19, 2022.
  15. ^ a b c d e f Langley, Hugh (June 26, 2023). "Google killed its Iris augmented-reality smart glasses as it shifts attention to building AR software". Business Insider. Archived from the original on June 27, 2023. Retrieved July 5, 2023.
  16. ^ Mickle, Tripp; Chen, Brian (June 4, 2022). "Apple Starts Connecting the Dots for Its Next Big Thing". The New York Times. ISSN 0362-4331. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  17. ^ Fowler, Geoffrey (June 5, 2023). "Apple unveils Vision Pro, its $3,499 augmented-reality headset". The Washington Post. ISSN 0190-8286. Archived from the original on June 5, 2023. Retrieved June 5, 2023.
  18. ^ a b Amadeo, Ron (August 23, 2023). ""Project Moohan" is Google and Samsung's inevitable Apple Vision Pro clone". Ars Technica. Archived from the original on August 23, 2023. Retrieved August 30, 2023.
  19. ^ Sisco, Josh; Nellis, Stephen; Olson, Mathew; Krouse, Sarah (March 16, 2022). "Google Buys Hardware Startup Raxium to Fuel AR Ambitions". The Information. Archived from the original on March 16, 2022. Retrieved March 19, 2022.
  20. ^ Trueman, Charlotte (May 5, 2022). "Google acquires Raxium in augmented reality push". Computerworld. Archived from the original on May 5, 2022. Retrieved May 10, 2022.
  21. ^ Howley, David (May 11, 2022). "Google reveals AR glasses that can translate speech in real time". Yahoo! Finance. Archived from the original on May 11, 2022. Retrieved May 12, 2022.
  22. ^ Stein, Scott (May 12, 2022). "Unlike Google Glass, These New AR Glasses Unveiled at I/O Might Actually Be Practical". CNET. Archived from the original on May 12, 2022. Retrieved May 15, 2022.
  23. ^ Peters, Jay (July 19, 2022). "Google's prototype augmented reality glasses are going outside". The Verge. Archived from the original on July 19, 2022. Retrieved August 6, 2022.
  24. ^ Li, Abner (October 23, 2022). "Google is expanding its AR prototype testing to Canada". 9to5Google. Archived from the original on October 24, 2022. Retrieved December 14, 2022.
  25. ^ Li, Abner; Bradshaw, Kyle (December 12, 2022). "How Google's AR smart glasses could be controlled: rings and bracelets". 9to5Google. Archived from the original on December 12, 2022. Retrieved March 1, 2023.
  26. ^ Leswing, Kif (March 15, 2023). "Google ends enterprise sales of Google Glass, its augmented reality smartglasses". CNBC. Archived from the original on March 15, 2023. Retrieved March 16, 2023.
  27. ^ a b c Hollister, Sean (June 27, 2023). "Google has reportedly killed its Project Iris augmented reality glasses". The Verge. Archived from the original on June 27, 2023. Retrieved July 5, 2023.
  28. ^ Bradshaw, Kyle (October 17, 2023). "Google app shows renewed work on 'Iris' smart glasses with Assistant support". 9to5Google. Archived from the original on October 17, 2023. Retrieved November 8, 2023.
  29. ^ Li, Abner (January 10, 2024). "Google reorganizing Pixel hardware: Fitbit's James Park leaving, layoffs hit AR team". 9to5Google. Archived from the original on January 11, 2024. Retrieved February 4, 2024.
  30. ^ Victor, Jon (December 14, 2023). "How Google Got Back on Its Feet in AI Race". The Information. Archived from the original on December 14, 2023. Retrieved December 31, 2023.
  31. ^ Amadeo, Ron (December 15, 2023). "The Pixel 9 might come with exclusive "Pixie" AI assistant". Ars Technica. Archived from the original on December 15, 2023. Retrieved December 31, 2023.
  32. ^ Li, Abner (February 15, 2021). "What is Google's plan for AR glasses?". 9to5Google. Archived from the original on February 15, 2021. Retrieved July 5, 2023.
  33. ^ Sutrich, Nicholas (January 31, 2022). "Project Iris could be amazing, but Google's rocky past could ruin it". Android Central. Archived from the original on January 31, 2022. Retrieved July 5, 2023.
  34. ^ Pritchard, Tom (May 6, 2022). "Google AR glasses could have a clear advantage — here's why". Tom's Guide. Archived from the original on October 7, 2022. Retrieved July 5, 2023.
  35. ^ Di Benedetto, Antonio G.; Clark, Mitchell (May 13, 2022). "Google's AR translation glasses: it's really not that simple". The Verge. Archived from the original on May 13, 2022. Retrieved August 6, 2022.
  36. ^ Hollister, Sean (July 25, 2022). "Ready or not, the Glassholes are coming back". The Verge. Archived from the original on July 25, 2022. Retrieved August 6, 2022.
  37. ^ Li, Abner (June 30, 2023). "Without hardware, is Google truly all-in on smart glasses". 9to5Google. Archived from the original on June 30, 2023. Retrieved July 5, 2023.
  38. ^ Sorrel, Charlie (July 4, 2023). "Why Google's AR Glasses Just Can't Compete With Apple's Vision Pro". Lifewire. Archived from the original on July 4, 2023. Retrieved February 4, 2024.