Twitch streamer uses facial recognition to make video games more accessible

Developer Valentin Squirelo creates PlayAbility, software that allows disabled gamers to control games through facial expressions.

Key points:

• PlayAbility uses facial recognition to let disabled players control games without specialized hardware.
• The software is free in its basic version and only requires a webcam.
• A more affordable alternative compared to adaptive controllers on the market.
• Developed collaboratively with the Twitch community.
• Primarily benefits motor disabilities but still has limitations for some specific conditions.

Technology for Gaming Accessibility

Streamer and developer Valentin Squirelo has always sought ways to make video games more accessible for people with disabilities. Alongside his Twitch community, he developed PlayAbility, a software that uses facial recognition to enable game control through facial expressions. The solution aims to bridge the gaps left by devices like the Xbox Adaptive Controller and PlayStation Access Controller, which do not meet all needs and can be financially prohibitive for some gamers.

"We created PlayAbility not to replace everything, but to connect everything," Squirelo explains. "We chose to focus on facial gestures because they allow control over elements like triggers and analog sticks, which are not always possible with other software."

Accessibility at a lower cost

Existing adaptive devices are expensive and often limited to a specific set of needs. A complete Xbox Adaptive Controller setup can cost over $300, while the PlayStation Access Controller is around $250, excluding additional peripherals. In contrast, PlayAbility offers a free basic plan and a premium version for a one-time payment of €129 (about $132), requiring only a standard webcam to function.

For gamers like Eduard Poch, who struggle to use standard controllers due to progressive motor limitations, PlayAbility has provided a flexible solution. "I've always had trouble reaching certain keys on the keyboard. With PlayAbility, I can map multiple functions to simple facial movements," says Poch.

Benefits and challenges

Despite its advancements, PlayAbility still faces challenges. Marijin Rongen, editor of the site "Can I Play That?", points out that the software may struggle to recognize asymmetrical faces, affecting command accuracy. "My face is slightly asymmetrical, and because of this, certain gestures are triggered even when my expression is neutral," Rongen explains.

These limitations highlight a common challenge in gaming accessibility: there is no universal solution. Many players rely on a combination of hardware and software to play comfortably.

The future of accessibility in gaming

Squirelo hopes PlayAbility will continue evolving to reach an even wider audience. "We're working with autistic children, and real-time feedback has been incredibly beneficial for them," says the developer. "My goal is simple: for everyone to be able to play together on a Sunday afternoon."

Ultimately, PlayAbility does not aim to be the definitive solution but rather another option that expands gaming accessibility. For experts like Erik Johnson, occupational therapist and chief medical officer at Warfighter Engaged, providing choices is the most important factor: "The gaming industry is committed to making games accessible. In the end, the goal is for everyone to be able to play and enjoy themselves."