Build a Free Handwriting Recognition Bot using UiPath - Step by Step!

Updated: May 20

The fastest way to digitize your handwritten notes!

We've all been there. It could be a note that you wrote down while listening to someone or a story that you had been writing since you were hardly 13. You got busy with your life like everyone else and forgot about that inspired story that you were writing. Suddenly one day it all comes rushing back to you and nostalgia hits you so hard that you want to finish that story as soon as possible. So you open that small wooden drawer that was shut since 2012 and you dust off the cobwebs and you crack a real smile after a very long time.

Now the challenge that you face is that you can't continue writing in a notebook since it's not a feasible solution anymore so you want it to be on your laptop and you want it digitized for free which makes sense since you wrote the story.

That is where I come in.

You can easily create a bot that shifts your handwritten notes to a digital document and the best part is that it wont cost you a dime!

Let me quickly explain about Uipath and CloudVision for the uninitiated.

  1. Uipath: This is an RPA solution that is used to build automated solutions or "Bots".

  2. CloudVision: This is a solution provided by Google and we will be using its API for analyzing the handwritten notes.

If you would like to test the Activity out, I recently published it on the Marketplace with additional features like Autocorrect and Bag of Words!

Step 1 - Prerequisites

Download and Install Uipath Studio and Register on Google for CloudVision API.

You can download Studio from here:

If you are completely new to UIPath, I will suggest you do a basic level of certification from Uipath Academy. It's free and easy.

You can register for Cloudvision here:

Follow the "Get Started for free" registration and register. It's free for 1 year which should be enough for you to set up your bot and get your work done assuming you are working on a personal project. If it's an enterprise-level solution that you want to build, 1 year is enough for you to prove a POC and get funding!

Moving forward, once you have registered you will land up on this page,

Next, go to IAM and Admin and click on Service Accounts and click on Create Service Account.

Next, give a name to your service account. It will automatically create a service account ID. Click on Create. Your service account will be created!

Cloudvision Registration

Next, click on + Create Key, select JSON and click create. This will create a JSON file download it and save it on your workstation.

Also, save the Key ID in a text document.

These are important and will be used later on.

Step 2 - Building the BOT!

Now with the prerequisites taken care of let's build the bot!

Firstly, in the project folder, you need to download certain packages. Go to Manage Packages and add the following. They are:

  1. Microsoft.Activities.Extensions

  2. UiPath.GoogleVision.Activities

Bot Creation - Step 1 (Adding the File to be Read)

1. Add the activity:" Google Vision Scope". Set the following properties:

AuthenticationType : ServiceAccountKey

KeyPath : Give the Path to ServiceKey.json that you would have stored on the cloudvision page.

KeyType : json

2. Add the Activity "Handwriting Detection". Set the following properties: