Draft:May-Li Khoe

May-Li Khoe
Born	1977 Netherlands
Nationality	Dutch-Canadian
Education	SB 6-2 1999, M.Eng 2000
Alma mater	Massachusetts Institute of Technology (MIT)
Spouse	Federico Ardila
Scientific career
Fields	Human-computer interaction, educational technology, user experience design
Institutions	Vice President of Design at Khan Academy, former designer at Apple Inc.
Website	https://www.maylikhoe.com/

May-Li Khoe (born 1977) is a Dutch-Canadian artist, writer, researcher, designer, and inventor, who combines technology, design, and cultural exploration. She has a background in technology, user experience (UX) design, and creative software development.

She has played important roles in the product development at major tech companies, such as Apple and Khan Academy.

Khoe is married to Federico Ardila, a Colombian mathematician specializing in combinatorics and matroid theory.

Early Life and Education

May-Li Khoe was born in the Netherlands to Chinese-Indonesian parents and later grew up in Vancouver, Canada. She began designing as a child, due to access to a Mac computer that allowed her to create digital content using tools like MacPaint, KidPix, and Hypercard. By the time she reached high school, Khoe was experimenting with advanced design software like Photoshop, often collaborating with a friend on creative projects that combined art and technology.

May-Li Khoe completed a Bachelor of Science (SB) in Electrical Engineering and Computer Science at Massachusetts Institute of Technology (MIT) in 1999 and she then went on to obtain a Master of Engineering degree from MIT in 2000. During her time at MIT, she was involved in research at the MIT Media Lab under the direction of Pattie Maes, focusing on human-computer interaction and innovative design methodologies. This experience influenced her subsequent work in developing user interfaces that enhance human interaction with technology. She is currently pursuing a Master of Fine Arts (MFA) degree at San Francisco State University.

Career

She first began programming in HyperTalk, using HyperCard, to create small adventure games and instructional scientific simulations.

May-Li Khoe’s extensive experience in the tech industry includes a significant tenure as Vice President of Design at the nonprofit educational platform, Khan Academy, where she played a pivotal role in the development and implementation of critical user research methodologies and the establishment of comprehensive design systems. In her efforts to align the platform’s design with the needs of its diverse user base, Khoe recognized the importance of building a team that reflected that diversity. Understanding that a diverse and inclusive team is essential for fostering innovative solutions, she introduced a weekly survey designed to assess whether the team was operating within an environment that supported optimal collaboration and creativity. Inspired by the four-quadrant model, the survey featured five key statements aimed at measuring the team’s ability to work together effectively and perform at their best. This initiative underscored Khoe’s commitment to creating a work culture where diversity and collaboration were not only valued but actively cultivated, ensuring that the team could contribute to Khan Academy’s overarching mission of providing world-class education to anyone, anywhere.

Khoe’s leadership and design expertise were shaped by her earlier work at Apple Inc., where she made substantial contributions to the development of multi-touch interface technology, a key advancement in user interactions on modern devices. Khoe made substantial contributions to the development of multi-touch interface technology, which was instrumental in advancing user interactions on modern devices. Khoe worked on the first version of Find My iPhone. Khoe has also served as a mentor and consultant to various startups and creative organizations, advising over 40 individuals in design and technology.

Following her work at Apple, in 2018, Khoe co-founded Scribble Together, a collaborative whiteboard application widely used for remote work, education, and creative projects. She also created "Boogie Loops," a music and dance-themed game for the Playdate console, demonstrating her ability to integrate design and playful interaction.

Khoe’s work has been published in various journals, including The Ana, Umber Magazine, Transfer Magazine, Fourteen Hills, and the inaugural issue of HTML Review. She previously held positions at Microsoft, IBM Research, and Leapfrog. Her journey in the tech and design industries has been characterized by a commitment to excellence and creativity. She has shared her expertise through talks and design courses at prestigious institutions such as Carnegie Mellon University, Harvard University, and her alma mater, MIT. At San Francisco State University, she instructed a course that explored the intersection of design and mathematics alongside her husband, delving into new possibilities in this intriguing field.

She served as Jury Chair for the 2021 Interaction Awards, where she guided the direction of design excellence and solidified her reputation as a key figure in the industry.

Khoe is an advocate for diversity, equity, and inclusion in the technology and design industries. She has worked with Khan Academy to help create an inclusive workplace culture and has contributed to projects aimed at increasing access to education for underserved communities.

Projects

May-Li Khoe engaged in some projects which reflect a blend of design, technology, and user-centered innovation. At Apple, she focused on the development of consumer electronics, user interface and product design, illustrating the rigorous nature of design. She concentrated on game development and music technology through her co-creation Boogie Loops, but also on collaborative tools, educational technology and remote working solutions through Scribble Together. And, contributing to Dynamicland, she worked on spatial computing, tangible experience and accessibility across platforms.

Project - Apple

Khoe contributed to the development of Find My iPhone, working on the initial version of the app. Then, she later moved to the Human Interface Device Prototyping team, in which she helped developing new technologies for Apple's application screen animation, including features such as Force Touch and Taptic Engine, for the first iPhone, the first iPad Mini and the Apple Pencil.

She learned about the time and effort required for each phase of the design process, including conducting pressure tests and ensuring that the materials selected by the designer met the desired specifications. Khoe collaborated closely with Engineering Program Managers (EPMs) and other key designers, including Evan Hankey, Anthony Michael Fadell, and Jonathan Paul Ive, who was the Chief Design Officer at Apple at the time. She also came to understand that a significant portion of a designer's work is often rejected before reaching a final approved design, highlighting the iterative nature of the creative process.

Project - Boogie Loops

Khoe has been involved with developing Boogie Loops which is a music and dance creation that was released 25 April 2022 as part of the playdate console first season. The game merges interactive music composition and dance choreography in a user-friendly interface designed to make the creative process accessible and engaging. The project includes Khoe's diversified approach by combining art, music and technology.

Boogie Loops allows users to produce layered musical loops and choreograph dance routines in a playful and intuitive format. Khoe designed the game to make use of the Playdate's unique hardware, including its iconic lever. By turning the lever, users can control specific aspects of the music and movement, adding an interactive element that enhances creative exploration.

Game Features

• Music Composition: Boogie Loops offers a library of pre-set musical loops that players can layer and arrange in which order they prefer to build complex musical compositions.
• Dance Choreography: The game includes a dance-creation component, where the users can choreograph routines that sync with the music they have created.
• Interactive Lever Control: Taking advantage of the Playdate's lever, Boogie Loops allows players to adjust musical elements and dance sequences in real-time, creating an immersive physical interaction for the user.

Since its release, Boogie Loops has received positive feedback for its innovative approach to music creation on a handheld gaming platform. The game's playful user-interface and accessibility appeal to a wide audience, including both casual players and creative players.

Project - Scribble Together

In 2018, May-Li Khoe together with Bridger Maxwell founded Scribble Together, an online collaborative whiteboard application that enables real-time drawing, brainstorming, and collaboration. Initially designed with educational and creative uses in mind, Scribble Together gained popularity among remote teams, teachers, and artists as a versatile tool for virtual collaboration. Khoe’s background in design and human-computer interaction influenced the development of the platform’s user-friendly interface, making it suitable for both professional and educational settings.

Since its launch, Scribble Together has been highlighted by technology and educational media for its adaptability and innovative features, such as multi-user drawing and screen sharing capabilities. The application has been particularly noted for fostering interaction and creativity in remote learning and team environments, especially during the rise of remote work in the early 2020s.

Project - Dynamicland

Khoe has been involved with Dynamicland, an experimental project based in Oakland, it was focused on transforming the way people interact with digital information in physical spaces. Dynamicland explores spatial computing by creating immersive, room-sized environments that replace traditional screens with interactive surfaces. This setup allows users to interact with digital information using tangible objects and natural gestures, fostering a hands-on approach to computing. The project represents a shift in technology’s role in supporting collaborative learning and creative problem-solving, prioritizing physical interaction and communal exploration over individual screen-based experiences.

May-Li Khoe played a consultative role in ensuring the continuity of the research group behind Dynamicland, particularly during a period of significant change. Despite the departure of many original members, who left due to differing visions and doubts about the project's direction, Khoe’s involvement was crucial in maintaining the group's progress. The shift towards developing the Dynamicland platform, with its emphasis on spatial computing, was central to this transition. The project, which replaced traditional screens with immersive, room-sized interactive surfaces, explored new ways for users to interact with digital information using tangible objects and natural gestures. Khoe, along with other contributors like Dave Cerf, played a pivotal role in the development of this platform, which became a core focus for the reformed team.

Patents

Khoe has specialized in a wide range of patents, designing and inventing new technological tools. Those patents include creations of new electronic devices and interfaces which changed the methods used to communicate and represent digital contents (messages, calculations, images, languages, multimedia, etc.) throughout technology. Khoe worked on the majority of these patents when she was working with Apple.

Patent number	Name	Area of Application	Abstract and Application
US 9,267,540	Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface	Touchscreen, Devices, User Interfaces	This innovation allows a touch-screen device to provide tactile feedback, for example vibration, to make the user experience more engaging. The feedback start operating when a user interacts with certain interface elements, like adjusting a setting. The tactile response helps users to identify these boundaries without needing to depends on visual cues. Apple implemented this innovation in its devices to improve the accessibility and usability of touch interfaces, particularly in scenarios where visual attention is limited.
US 9,158,522	Device, method, and graphical user interface for displaying content associated with a corresponding affordance	Touchscreen, Devices, User Interfaces	This invention allows a touch-screen device to change the size of an icon (affordance) based on the pressure of a user's touch, and if pressed hard enough, replace the icon with related content, while lighter touches simply return the icon to its original size without displaying the content. This concept was implemented in Apple's 3D Touch feature, introduced in earlier iPhone models.
US 9,587,052	Device, method, and graphical user interface for moving and dropping a user interface object	Touchscreen, Devices, User Interfaces	It outlines how an electronic device responds to touch gestures to move items on the screen. The device tracks the intensity of touch to determine if both selector and the object should move together or if only the selector should move. If the touch meets certain pressure criteria, both the focus area and the item move together, if not, only the focus area moves. Apple implemented this invention in its operating systems for features such as drag-and-drop on iPhones and iPads.
US 9,245,960	Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics	Touchscreen, Devices, User Interfaces	This invention allows Touch-screen gadgets to mimic depth perception and offer more user-friendly control icon interaction thanks to this innovation. A 3D-style icon's appearance is dynamically changed by the device to imitate depth as the user applies pressure, producing a realistic visual effect. The gadget simultaneously adjusts the focus point or pointer laterally to match the icon's visual change. Users can easily engage with the interface thanks to the mix of visual feedback and cursor adjustment, especially when doing precise operations like text editing or fine-tuning settings. This technique enhances usability in applications such as text editing tools, gaming interfaces, and professional design software when users require both tactile precision and visual clues. Apple incorporated these features into its operating systems to enhance user experience across various apps and workflows.
US 9,270,839	Systems and methods for resizing applications in a multitasking view on an electronic device with a touch-sensitive display	Multitasking, Touchscreen Devices	When an electronic device with a touch-sensitive display detects a user gesture at the border between two concurrently displayed applications, it resizes the second application to a predefined fixed area and adjusts the first application to fill the remaining screen space. Apple has applied this invention in iPadOS through multitasking features such as Split View and Slide Over.
US 9,317,009	Dynamic User Interface Adaptable to Multiple Input Tools	Input Methods, Touchscreen Devices	This invention allows a computing device with a touch-sensitive display to detect different stylus inputs, such as movement, rotation or a combination of both, and responds by performing specific functions in the user interface that adapt to each unique input method. Apple implemented this invention in devices such as the iPad, specifically to enhance functionality with the Apple Pencil.
US 9,403,452	Complex Handling of Conditional Messages	Messaging, Notifications	It provides systems and methods for displaying a notification about a conditional message based on specific requirements. Either the receiver's device or a connected server, equipped with applications, controls the notification output. A filter checks if the message has conditions, such as needing certain device properties. When conditions are met, a selector triggers the notification. Apple uses conditional message handling to control notifications based on factors such as location, device activity and user context. Features such as Focus mode filter notifications depending on the user's current mode (e.g. work or sleep), allowing only relevant alerts. Location-based notifications trigger alerts when users arrive at specific places. While Apple watch uses health data to deliver notifications based on metrics, especially heart rate.
US 9,573,078	Dynamic Context-Based Language Determination	Language, Input Methods	this invention allows a device to analyze user input and contextual attributes to automatically determine the appropriate language for message composition, adjust the keyboard layout accordingly, and enable language-specific functionalities, including generating text from voice input based on the detected language. Apple has implemented this functionality in its operating systems.
US 9,249,422	Smart Auto-Completion	Text Input, Multimedia, Calculations	It enables a system to analyze user input and context to provide advanced suggestions. It can identify relevant multimedia objects based on the input and offer them as auto-complete suggestions, replacing the input with an accessible multimedia link upon selection.
US 9,176,038	User detection by a computing device	User Interaction, Device Access	This invention enables an electronic device to analyze user presence and context to perform specific actions. The device can identify a user face or find their location in relation of the user interface. For example, a device can unlock itself or modify content in the display based on the user using it. This technology enhances device functionality by offering personalised and context-aware interactions, which have been incorporated into Apple’s ecosystem to improve security and user experience, such as in Face ID and location-aware features.
US 9,238,522	Graphical user interface for a display screen	User Interfaces, Display Technology	This invention improves the graphical user interface of a device’s display screen by introducing dynamic adjustments based on user interaction. It permits the interface to adapt quicker and upgrading the size and the arrangement of the screen elements to enhance accessibility and usability for people. For example, elements can expand or contract depending on the user’s input, allowing for an intuitive and efficient interaction experience. Apple used this invention to refine user interfaces across devices, including iOS system, making it more useable and multi-use.
US 9,456,501	Newsreader for mobile device	Mobile Devices, Content Consumption	It allows a mobile device to access and display information in supported format. When a user requests content using resource locator (such as a URL), the device retrieves the data from a local cache if available, or directly from the source if not. The data is then translated into a compatible format and sent to the device. Apple applied this invention in apps such as Apple News.
US 9,195,204	Intelligent digital assistant in a desktop environment	AI, Digital Assistants, Desktop Devices	This invention describes how a digital assistant can interact with users in a desktop setting. The assistant can be activated through specific gestures on a touch-sensitive surface or by voice input. It can switch between modes, such as dictation for text input or command mode for tasks, depending on where the user is focusing.
US 9,295,753	Virtual noticeboard user interaction	User Interfaces, Notifications	This invention enhances the functionality of virtual noticeboards by introducing dynamic and context-sensitive notification systems. It allows users to interact with notifications or pinned items on a digital display, such as those on a smartphone home screen, tablet, or desktop interface. The noticeboard adapts to user preferences, prioritizing and displaying the most relevant information based on time, location, and user activity. For example, a user might see reminders for upcoming meetings or location-based notifications when entering a specific area. The interface supports gestures for interacting with notices, such as swiping to dismiss or prioritize notifications or pressing to expand details. This patent improves productivity by organizing information in a user-friendly and visually engaging format, with applications ranging from personal organization to professional task management.
US 9,688,464	Automatic cropping of video content	Video Editing, Media Consumption	It addresses the issues of poorly composed video content captured by amateur users. And it provides a method for automatically cropping video content to enhance its aesthetic quality and ensure better presentation on electronic device displays. Apple has utilized this for automatic video content cropping primarily in applications such as Photos app, iMovie and Final Cut Pro.
US 9,410,257	Location-based features for commute assistant	Location Services, Navigation	This patent implement navigation and travel efficiency by offering multiple assistance features that focuses on location-based services. Customers may get context-sensitive information such as estimated arrival times, traffic updates, and alternate routes in addition to real-time location data. The system employs predictive intelligence to foresee user needs, such alerting users about delays or locating nearby services. Apple incorporated this technology into apps like Maps and Siri to simplify regular travel by offering personalized navigation insights and insightful recommendations.

Personal life

Khoe's partner is Federico Ardila, a Colombian mathematician who specializes in combinatorics and matroid theory and who shares Khoe's interest in music, with both being DJs and musicians. They first crossed paths at a Cuban venue in Boston, where they bonded over their shared love of salsa dancing, a connection that has been central to their relationship ever since. Their relationship influences their lives and careers, allowing them to work and collaborate together.

In 2019, before the Covid-19 pandemic, Khoe traveled to cities such as Paris, Bologna, and Bogotá with her partner during his sabbatical. This experience served as a regenerating period of renewal and allowed her to reflect and recharge.

Khoe started a small travel newsletter, as well, to share with friends and family, from which she received positive feedback on her perspective and this encouraged her to formally pursue her interests by enrolling at San Francisco State University (SFSU). She is interested in many forms of writing, from nonfiction to genre narratives, trying to bring together personal and global perspectives, and currently pursuing an MFA in Creative Writing at San Francisco State University.

Khoe is passionate about dance and music. Initially she started playing music for various college parties, then in 2008 she attended the "Music Festival Petronio Alvarez", in Colombia, and inspired by the atmosphere and energy of that event, May-Li Khoe, Federico Ardila and other friends decided to found the DJ crew called “La Pelanga Collective”. The collective focuses on international party music, primarily from tropical regions, it promotes cultural exchange through music, exhibiting how different traditions influence and transcend boundaries. Khoe and her husband, both perform with the bands " Vallenato Gozaimasu" and " Neblinas del Pacífico", blending Colombian and Japanese music and expressing their diverse cultural influences. They have worked with "People's Kitchen Collective" and "The Wall Project" to organize events and returned half of the donations they received to community initiatives on the Colombian Pacific Coast, particularly in Puerto Buenaventura.

She has also always loved singing, in fact she began singing in high school, receiving classical training as a soprano and coloratura. After college, she took a break from singing but then she resumed, focusing on music from the Colombian Pacific region. In the future, she will aim to take on the role of a mariachi band front woman.

See also

User Experience (UX) Design

External links

• May-Li Khoe on X
• May-Li Khoe on Linkedin
• May-Li Khoe on Medium
• May-Li Khoe official website