Set up image recognition for WhatsApp
In this guide, we'll show you how you can use Flow Builder to set up image recognition for WhatsApp. This will allow you to categorize inbound images from customers, based on Google's Vision AI IR algorithm.
We'll be looking at an example of a conversational flow that automatically categorizes images in messages that are sent on WhatsApp.
Requirements
Step one: Sign up to MessageBird and WhatsApp Business
Before we build the flow, you'll need to complete the following steps. If you've already completed these, you can skip ahead to step two.
Sign up for a MessageBird account
Sign up for a WhatsApp Business account
Step two: Set up Google Cloud Platform
Once you've signed up for both MessageBird and WhatsApp Business, follow these steps to set up Google Cloud Platform.
Go to Google Cloud Platform and sign up for a free account
Create a new Google Cloud Platform project
Create an API key in GCP
Enable the Cloud Vision API
Step three: Connect everything in the MessageBird Dashboard
Once you've set up Google Cloud Platform, follow these steps to connect everything together.
Download this Vision AI flow
Log in to the MessageBird Dashboard
Navigate to Flow Builder
Click on Import Flow and upload the Vision AI flow
The first step of your flow is the Omni-channel step. Click on this step, go to the step setting and check the box next to your WhatsApp Business channel to select it
Click on the second step, which is named Replace 1 of 1 - GCP API Key, and add the Google Cloud Platform API key into the Value field
To trigger the flow, initiate a message with the WhatsApp channel. You'll receive a WhatsApp message asking you to reply with an image
Reply with an image. Once you've done this, Flow Builder will make a call to Vision AI's API endpoint, with the image as the payload. The uploaded image will be processed and, based on probability, the top two category types will be returned within the conversation. That's it, you're done!
Last updated
