Microsoft’s Sketch2Code Turns Whiteboard Sketches Into Code

Share

I’m not a coder so I’m not entirely in-the-know when it comes to coder workflows but what I do know is that a significant portion of guys and girls who code value their whiteboard. That’s where a portion of the magic happens apparently.

According to Microsoft what happens on the whiteboard needs to get translated and that takes too much time and effort:

Once a design is drawn, it is usually captured within a photograph and manually translated into some working HTML wireframe to play within a web browser. This takes efforts and delays the design process.

advertisement

This is why Microsoft has come up with Sketch2Code -“a web-based solution that uses AI to transform a handwritten user interface design from a picture to a valid HTML markup code.”

How does Sketch2Code work?

  1. First, the user uploads an image through the website.
  2. A custom vision model predicts what HTML elements are present in the image and their location.
  3. A handwritten text recognition service reads the text inside the predicted elements.
  4. A layout algorithm uses the spatial information from all the bounding boxes of the predicted elements to generate a grid structure that accommodates all.
  5. An HTML generation engine uses all these pieces of information to generate an HTML markup code reflecting the result

If you interested in testing out Sketch2Code you can access the website here.

You can find the code, solution development process, and all other details for Sketch2Code on GitHub.


Quick NetOne, Telecel, Africom, And Econet Airtime Recharge

If anything goes wrong, click here to enter your query.

Leave a Reply

Your email address will not be published.

Published by
Farai Mudzingwa

Recent Posts

Is Twitter The Best Crowdfunding Platform For Zimbabweans Right Now?

I think it's fair to say crowdfunding in Zimbabwe is pretty difficult if not actually…

June 6, 2020

Covid 19 Update

The Ministry of Information Publicity and Broadcasting Services has released updated Covid 19 Statistics.

June 6, 2020

Hotbox Is A New WhatsApp Bot Aiming To Replace Duta & Offers A Lot More

Most of us who use WhatsApp might have had a run-in with Duta. The chatbot…

June 5, 2020

Facebook Transfer Tool Goes Global

Facebook has announced a global roll out of their Transfer Tool. This feature had been…

June 5, 2020

“Chapters” From YouTube Lets You Scroll to Specific Points in a Video

YouTube Chapters is a feature that lets the viewer skip to specific points in a…

June 5, 2020

Zoom Locks Encryption Behind Paywall Since Most Harmful Behaviour Comes From Free Users

Zoom Meetings recently announced that end-to-end encryption would be coming to their video conferencing software…

June 5, 2020