Skip to main content

Apple is bringing keyboard and mouse gaming to the iPad

Apple is adding pointer capture to iPad gaming, which means that users will be able to play complex video games on the device for the first time.

“Level up your iPad games and add in keyboard, mouse, and trackpad controls,” the company told developers when describing a WWDC 2020 session about the new controller scheme. “Discover how to use the Game Controller framework to augment your existing titles, bring over games from other platforms, or dream up entirely new interaction experiences.”

iPads have allowed pairing with Xbox and PlayStation controllers for a while now, but this would be the first time developers will be able to make use of pointer capture with mouse and keyboard controls, widely considered the bench standard for PC gaming.

“Learn how to integrate keyboard and ‘delta’ mouse coordinate events for player motion, and disable system gestures like the Dock or Control Center to take full advantage of full-screen gameplay,” Apple said.

The news is being lauded by developers mainly because Apple and its products have been slow to delve into the world of video games.

The Apple app store is packed with games, but none of them have the cachet of a traditional big release on something like a PlayStation 4 or PC. However, Apple has been making moves to change this, and the past year has seen serious inroads into the more mainstream video game ecosphere.

In September of last year, Apple launched Apple Arcade, a $5 monthly subscription service touting more than 100 ad-free games, and users can play games with a DualShock 4 or Xbox One controller. Apple does not yet have its own controller.

Playing games on an iPad or iPhone is fairly simple with a game that requires simple touch controls but becomes complicated when trying to play games with more complicated control schemes, like Grand Theft Auto III. While adding controller support helped, games like Fortnite on PC have ravenous followings and are played with a mouse and keyboard. Adding support for pointer capture means that Apple could potentially offer players the same experience on the iPad that they’re getting from a full PC or laptop rig.

Steve Troughton-Smith, a developer that builds apps and games, tweeted that the move was a “huge deal for gaming on iPad.”

Jon Silman
Former Digital Trends Contributor
The method to Apple Arcade’s madness? ‘Bring us an incredible game’
Apple Arcade characters stand on a chess board.

Whenever Apple rolls out a lofty new idea, it invites as many skeptics as it does fans. Devices like the Vision Pro birthed naysayers from the moment it was announced, but armchair criticism has rarely, if ever, put a dent in the tech giant’s plans. It has a way of committing to its products and initiatives, even when outsiders might think no one is using them.

That’s been the story of Apple Arcade since it launched in 2019. The service came at a time when the biggest tech companies were hungry for a piece of the lucrative video game industry. While Google and Amazon tried to break in with cloud platforms, Apple laid out an entirely different vision: a mobile subscription service full of games that featured no ads or microtransactions. It sounded too good to be true – and some people at that time weren't convinced. Look back at the comments on its original tweet announcing the service and you’ll find a mess of replies ripping it apart.

Read more
Fortnite is coming back to iOS, but Epic Games still isn’t happy about it
Solid Snake aiming a pistol out of a box in Fortnite.

Fortnite is set to come back to iOS in Europe sometime in 2024. This will mark the first time a natively running version of Fortnite will be available on iOS since Apple removed the game from the App Store in 2020.

Apple did so at the time because Epic tried to use its own third-party payment system, kicking off a series of legal battles in an attempt to get Apple to open up its platform more. Although those legal battles have yielded mixed results for Epic, a newly passed Digital Markets Act in the European Union is forcing Apple to do things like "allow third parties to inter-operate with the gatekeeper’s own services in certain specific situations" and "allow their business users to promote their offer and conclude contracts with their customers outside the gatekeeper’s platform."

Read more
Resident Evil 4, Death Stranding barely miss a step on iPhone and iPad
El Gigante raises its foot over Leon in Resident Evil 4.

Just two months ago, I had my mind blown when I saw Resident Evil Village running on an iPad. While I expected a very compromised experience, I was shocked when I saw how the horror game barely lost a step on the device. I pushed its settings to their limits and still came out with a fairly smooth experience capable of hitting high frame rates. Suddenly, the idea of playing a console quality game entirely on a mobile device didn’t seem like a far-fetched idea.

That was an impressive feat, but Resident Evil Village was built for the PS4 generation. The bigger test would come from more technically ambitious games that are either exclusive to new consoles or rebuilt with them in mind. I wouldn’t have to wait long to see that in action. At a recent Apple gaming showcase, I went hands-on with both Death Stranding: Director’s Cut and Resident Evil 4 running on a bevy of Apple devices, from the iPhone 15 Pro to a Mac Mini.

Read more