Prototype Windows 10 app eliminates the napkin by turning sketches into code

Quickly capturing an idea on a paper napkin can lead to lucrative results, but what if those doodles could turn into lines of code? That is what a group of Microsoft Garage Project interns set out to create: A Windows 10 app that enables app designers to draw wireframe sketches and export them into Visual Studio. Simply called Ink to Code, Xamarin funded the project and joined by five additional interns from the Massachusetts Institute of Technology to join and help develop the first prototype app. 

The sponsoring team and interns were both motivated by a desire to modernize the brainstorming and prototyping process from using napkin and whiteboard sketches, to an experience that is more automated and cohesive with the Visual Studio suite,” Microsoft ‎Product Marketing Manager Lainie Huston said. 

The app is based on Windows 10’s Smart Ink feature injected into the Universal Windows Platform for Microsoft’s Creators Update, which relies on artificial intelligence to improve ink recognition. Of course, that means you need a Windows 10 device that supports Windows Ink and touch-based input, but with this setup, you won’t need to sift through 30 sketches to compile your final code-based design. 

But Ink to Code isn’t meant to completely generate your app from scratch. It merely accelerates the initial layout process by recognizing common design symbols to get you started. According to Huston, the app currently supports buttons, images, labels, text fields, and text paragraphs. It’s a digital canvas where designers and programmers can merge to hammer out ideas and speed up the overall development process. 

Windows 10 Ink to Code app

“Ink to Code can be used as a more productive canvas in brainstorm meetings, or even more significantly, as a tool that can bridge the gap between collaborators with different levels of design or technical knowledge,” Huston adds. 

As stated, Ink to Code is just a prototype for now, and presumably only visible to Windows 10 devices with touch-based screens; the Microsoft Store didn’t display the linked app on our non-touch laptop. But as the demo video shows, you can use a supported stylus to roughly draw specific elements of the app, such as its rectangular border, an image placement box, a text input field, and so on. The app turns all hand-drawn shapes into perfect lines and circles for a clean look without any manual coding involved. 

Microsoft first introduced Smart Ink in May 2017. Part of the platform is Ink Analysis that recognizes shapes and understands composition, such as text residing inside a roughly drawn rectangle. Ink Presenter collects all the strokes, and Direct Ink deals with rendering the strokes with digital ink. 

“Our goal is to understand user intent and empower developers to turn it into rich digital constructs, as well as to leverage understanding from all parts of the system,” the company says. 

Microsoft introduced similar technology to Sticky Notes with the release of Anniversary Update (Redstone 1) in August 2016. 

Product Review

If the Surface Studio 2 can't win over Mac fans, nothing can

Most creative professionals are staunchly planted in the Apple camp, but with the Surface Studio 2, Microsoft is making a serious attempt to win them over. Despite its niche appeal, you’ll wish you had a few grand to drop on this beauty.

Microsoft’s Windows 10 Mail client goes freemium with the introduction of ads

Microsoft Windows Insiders are finding a nasty surprise inside the Mail app on the latest Windows 10 preview build in the form of banner ads. These ads will appear in the Mail app regardless of the webmail service you use.

Latest SMS breach could allow hackers access to your online accounts

A new security breach that exposed more than 26 million text messages could be a huge nightmare for users relying on two-factor authentication. Many of the SMS on the database contained security codes and account reset links.

Microsoft’s Always-Connected PCs gets more powerful with 64-bit app support

Microsoft announced that developers can start creating 64-bit apps for Always-Connected PCs powered by Snapdragon processors. The Windows Store will also begin to accept 64-bit app submissions for Microsoft's Windows on ARM.

Want to game on your Chromebook? Here's where to start

Chromebooks aren't great for gaming, but there are a few titles that most machines can run. There's a surprisingly diverse crowd that includes role-playing games, action side-scrollers, and puzzlers.

All the best Apple MacBook deals for Black Friday 2018

Shoppers looking for a new Apple laptop could find huge savings on a new MacBook come Black Friday. Retailers are offering discounts as much as $650 on select MacBook, MacBook Air, and MacBook Pro models this holiday season.

Playing ‘Battlefield V’ on an $800 Nvidia card is stunning. And disappointing

‘Battlefield V’ is the first game to use Nvidia’s ray tracing support, now available with the RTX 2080 and 2080 Ti graphics cards. The feature can, in an ideal scenario, make the game look better, but the performance hit may not be…
Smart Home

All the best Amazon Black Friday deals for 2018

Amazon may be an online-only retailer, but that doesn’t mean its Black Friday sales are anything to sniff at. In fact, due to its online status, Amazon has huge flexibility with the range of products and deals it can offer. Here's our…

Save a heap with these Black Friday 2018 graphics card deals

The Black Friday 2018 sales period is finally here and it's brought with it a tonne of great component deals. We've been scouring websites and catalogs for days to find you the best graphics cards deals for Black Friday 2018.

HP takes $100 off of leather-clad Spectre Folio 13 bundle for Black Friday

HP is offering a discount to Black Friday shoppers for a bundle that includes its leather-wrapped answer to Apple's MacBook Air. HP is offering a $100 discount on the Spectre Folio 13 when bundled with a mouse and leather sleeve.

The best Target Black Friday deals for 2018

The mega-retailer opens its doors to the most competitive shoppers at 6 p.m. on Thursday, November 22, and signs indicate that the retailer means business this year. We've sifted through all of the deals, from consumer electronics to small…

Still miss Windows 7? Here's how to make Windows 10 look more like it

There's no simple way of switching on a Windows 7 mode in Windows 10. Instead, you can install third-party software, manually tweak settings, and edit the registry. We provide instructions for using these tweaks and tools.

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…

Ditch the passwords and buy Xbox games with just your face

Passwords are the past. The latest version of Windows 10 allows you to sign in with your Microsoft account on the web through Microsoft Edge using Windows Hello or a FIDO 2 Yubikey.