Skip to main content

Apple patents a crazy stylus that senses texture to make 3D files

FiftyThree Pencil and Paper sketch
Image used with permission by copyright holder
Steve Jobs may have hated the stylus, but Apple sure has a lot of patents for awesome styli floating around the U.S. Patent and Trademark Office (USPTO). Two recent patents detail an amazing futuristic stylus with the ability to analyze and react to different textures, create 3D images, and provide haptic feedback.

The first patent explains how an Apple stylus could use haptic feedback to mimic the experience of drawing with a real writing implement on whatever surface the user has chosen on the tablet screen. Apple came up with several different ways to achieve accurate haptic feedback, all of which are detailed in the patent.

Recommended Videos

One possible method involves a stylus with contact sensors that can tell when the stylus touches the screen. Another proposal suggests using capacitive sensors, pressure sensors, and cameras to determine the texture of the digital surface and provide the corresponding haptic feedback. For example, photodiodes could be used to tell the stylus what texture is shown onscreen, whether it’s wood, paper, glass, and fabric. The stylus could also learn what texture is being used via Bluetooth or Wi-Fi.

As soon as the stylus recognizes the texture in use, it will vibrate accordingly. So if you’re drawing on a smooth, glass-like surface, you won’t feel any vibration, but if you’re drawing on a rough texture like a sharp stone, rugged fabric, or wood, you’ll feel a stronger vibration.

Please enable Javascript to view this content

The second patent explains how the stylus could be used to capture and transmit the texture of physical objects to the iPad or iPhone, as well as how the stylus could be used to create 3D CAD files. In this patent the stylus would be equipped with a camera module in its tip, which could detect and record the physical texture of almost any object or surface. Once the stylus records the texture, it will send it to the iPad or iPhone, and the person drawing would experience that specific texture onscreen.

Apple suggested a few ways for the stylus to capture and transmit texture. In many examples, light bounced off a textured object would move through the stylus’ clear tip or lens to a photo sensor. The stylus would then send the texture data from the object to the iPad or iPhone to recreate 3D renderings of the texture, color, and even the shape of the object.

Designers, 3D modelers, and other digital artists could use the data from the stylus to create projects and even 3D CAD files, which are used in animation and other artistic ventures.

Obviously, there’s no telling if Apple will ever make this stylus a reality, but it would be pretty amazing to say the least. Most pundits and sources agree that Apple’s 12.9-inch iPad Pro will come with a stylus, though there’s no word on what its abilities will be.

Malarie Gokey
Former Digital Trends Contributor
As DT's Mobile Editor, Malarie runs the Mobile and Wearables sections, which cover smartphones, tablets, smartwatches, and…
An Apple insider just gave us a hint about the M5 iPad Pro release date
Home Screen of the M4 iPad Pro.

Apple's line of iPad Pro tablets are almost powerful enough to work as complete laptop replacements, depending on your use case. When a new iPad is announced, it's big news — almost as big as when Apple confirms a release date.

While that hasn't happened just yet for the M5 iPad Pro, an analyst with a solid track record says to expect mass production in the second half of next year. Ming-Chi Kuo reported that time frame on Medium, and assuming this is accurate, it's safe to assume we can expect the M5 iPad Pro to be released sometime in late 2025.

Read more
I got an Apple Pencil Pro for my new iPad and found a big problem
An Apple Pencil Pro being held in a person's left hand with squeeze controls showing on an iPad mini 7 on top of a MacBook Pro keyboard.

Apple has brought some impressive improvements to this year’s iPad lineup. From an “impossibly thin” and powerful M4 iPad Pro to the Apple Intelligence-equipped iPad mini 7, there’s something here for everyone.

However, one of the unsung heroes of the lineup is the new Apple Pencil Pro, an advanced stylus with several new gestures that work hand in hand with Apple’s tablets to make drawing, sketching, and even just scribbling notes more intuitive than ever.

Read more
Apple Intelligence is coming to these languages in April
Apple Intelligence on the Apple iPhone 16 Plus.

Public access to certain features of Apple Intelligence is rolling out to users with the iOS 18.1, iPadOS 18.1, and macOS 15.1 updates. However, even if you are fortunate enough to gain early access, the service is currently only available in U.S. English in select countries. That is expected to change in the coming weeks and months.

According to GSMArena, Apple plans to add local English variants in Australia, Canada, Ireland, New Zealand, South Africa, and the U.K. in December. Most recently, it was confirmed that starting in April and continuing throughout 2025, Apple Intelligence will gain support for Chinese, English (India), English (Singapore), French, German, Italian, Japanese, Korean, Portuguese, Spanish, and Vietnamese. April is also when the EU will see its first Apple Intelligence release.

Read more