Skip to main content

Apple patents a crazy stylus that senses texture to make 3D files

FiftyThree Pencil and Paper sketch
Image used with permission by copyright holder
Steve Jobs may have hated the stylus, but Apple sure has a lot of patents for awesome styli floating around the U.S. Patent and Trademark Office (USPTO). Two recent patents detail an amazing futuristic stylus with the ability to analyze and react to different textures, create 3D images, and provide haptic feedback.

The first patent explains how an Apple stylus could use haptic feedback to mimic the experience of drawing with a real writing implement on whatever surface the user has chosen on the tablet screen. Apple came up with several different ways to achieve accurate haptic feedback, all of which are detailed in the patent.

One possible method involves a stylus with contact sensors that can tell when the stylus touches the screen. Another proposal suggests using capacitive sensors, pressure sensors, and cameras to determine the texture of the digital surface and provide the corresponding haptic feedback. For example, photodiodes could be used to tell the stylus what texture is shown onscreen, whether it’s wood, paper, glass, and fabric. The stylus could also learn what texture is being used via Bluetooth or Wi-Fi.

As soon as the stylus recognizes the texture in use, it will vibrate accordingly. So if you’re drawing on a smooth, glass-like surface, you won’t feel any vibration, but if you’re drawing on a rough texture like a sharp stone, rugged fabric, or wood, you’ll feel a stronger vibration.

The second patent explains how the stylus could be used to capture and transmit the texture of physical objects to the iPad or iPhone, as well as how the stylus could be used to create 3D CAD files. In this patent the stylus would be equipped with a camera module in its tip, which could detect and record the physical texture of almost any object or surface. Once the stylus records the texture, it will send it to the iPad or iPhone, and the person drawing would experience that specific texture onscreen.

Apple suggested a few ways for the stylus to capture and transmit texture. In many examples, light bounced off a textured object would move through the stylus’ clear tip or lens to a photo sensor. The stylus would then send the texture data from the object to the iPad or iPhone to recreate 3D renderings of the texture, color, and even the shape of the object.

Designers, 3D modelers, and other digital artists could use the data from the stylus to create projects and even 3D CAD files, which are used in animation and other artistic ventures.

Obviously, there’s no telling if Apple will ever make this stylus a reality, but it would be pretty amazing to say the least. Most pundits and sources agree that Apple’s 12.9-inch iPad Pro will come with a stylus, though there’s no word on what its abilities will be.

Editors' Recommendations

Malarie Gokey
Former Digital Trends Contributor
As DT's Mobile Editor, Malarie runs the Mobile and Wearables sections, which cover smartphones, tablets, smartwatches, and…
Apple’s 2024 iPad plans leaked — and they sound bad
A person's arm holding an Apple iPad Air 2020.

As 2023 is about to wrap up, we can definitely say it's been a peculiar one for Apple’s iPad lineup. Why? Because there were zero new iPad releases this year, which is a bit … odd. This is the first time that Apple has not released a new product in the iPad lineup since it was introduced.

But a new report from Mark Gurman’s Power On newsletter over the weekend seems to give us a look at what Apple’s iPad plans are for 2024. A few weeks ago, I talked about how the iPad lineup as a whole has gotten messy and convoluted. This new report takes both a step forward toward simplifying things while also featuring an interesting addition that I’m not sure who asked for.
Much-needed simplification

Read more
Apple has an iPad shocker planned for early 2024
A 2021 iPad Pro is attached to a keyboard on a desk.

The promised one is barely a few months away. We’ve been hearing rumors of an OLED iPad Pro for the past few years, but early in 2024, Apple will give finally its premium tablet the screen upgrade we’ve all been waiting anxiously for.

According to Bloomberg, the iPad Pro 2024 will offer an OLED screen and the natural silicon upgrade to the M3 generation. Currently under development under the code names J717, J718, J720, and J721, these new iPads will have 13-inch or 11-inch form factors.
Plenty of iPad Pro upgrades

Read more
Apple needs to fix the iPad
iPad Air 4

While there were rumors that Apple would reveal a new iPad mini during the “Scary Fast” M3 Mac event on October 30, that never came to fruition. In fact, we have yet to see any new iPad models come out this year, which is rather peculiar.

While we’re having a break between iPad releases, I think it’s time to reflect on how much of a mess the lineup is and how Apple should reconsider simplifying the portfolio. While iPads are still among the best tablets you can buy, there's also a lot that should change in 2024.
The problem with iPads today

Read more