Custom Vision, Xamarin.Forms and Simpsons – The Community AI Show

This week I had the honor of being the first guest on the Community AI Show with Henk Boelman, Cloud Advocate at Microsoft. In this first episode we look at how we can use Azure Custom Vision in a Xamarin.Forms app.

Custom Vision Simpsons Recognition

Our demo app can recognize Simpson themed LEGO figures. The model is trained through Azure Custom Vision. From there, you can either communicate with the available REST APIs, or export the model to CoreML, TensorFlow or ONNX.

These models can then be loaded into iOS, Android or UWP respectively. Because these models reside on your device locally, you do not need an internet connection and the results return super fast!

Watch Henk and me have some fun while building this solution in the video below. You will learn how to train your model, the global structure of a Xamarin.Forms app and what routes you can take to use this platform-specific feature in a Forms app.

Spoiler alert: use this amazing plugin by Jim Bennett to make your life a lot easier.

Custom Vision, Xamarin and Simpsons - The Community AI Show

All the source code for this app can be found on my GitHub page. If you want to get started with Custom Vision yourself, go and check out customvision.ai.

More Resources

If you can’t get enough of all the AI goodness, I have also recorded a video course on the Azure Cognitive Services and how to use those. You can find that here.

On my YouTube channel you can also find a session where I incorporate the Cognitive Services in a Xamarin.Forms app. While you are there, don’t forget to like and subscribe!

In Closing

Please let me know what you think of my appearance in the AI show or all the other resources mentioned in this post. If you need any clarification on anything mentioned in this post, I’m planning to write some more extensive posts about using the CoreML and TensorFlow models in your Xamarin app. Reach out if there are specific things you want to read in there.

ARM Template Deployment from PowerShell on Mac

ARM Template Deployment from PowerShell on Mac

Besides creating apps, I’m also loving cross-platform as a whole and of course everything Azure. I’ve known Azure Resource Manager (ARM) templates for a long time now, but only recently I started working with them again. My daily development machine is a Mac, so I had to find out how to deploy an ARM Template … Read more ARM Template Deployment from PowerShell on Mac

SQL Operations Studio: First look at a great tool

SQL Operations Studio First Look

My main development work happens on a Mac using Mac OS because I develop apps. And frankly, I try to make a challenge out of it to not leave Mac OS for other development work as well. This works very well because of tools like Visual Studio for Mac and Visual Studio Code. There is … Read more SQL Operations Studio: First look at a great tool

Sending Push Notifications from a Azure Function

Sending Push Notifications from a Azure Function

For a recent project I needed to implement a prototype for sending push notifications. Of course the backend will be the source of these push messages, but we wanted to show something to the customer today. For this, I have put together a small but simple Azure Function that allows me to send a custom … Read more Sending Push Notifications from a Azure Function

Continuous integration/continuous delivery for your Xamarin app with VSTS and HockeyApp – Part 1

VSTS loves HockeyApp

Continuous delivery is the new agile This is a quote a saw on Twitter by Sander Hoogendoorn and it seems that he is kind of right. Continuous Integration (CI) and Continuous Delivery (DI) are rapidly becoming more and more popular and together with that there are a lot of tools to support you with that, including … Read more Continuous integration/continuous delivery for your Xamarin app with VSTS and HockeyApp – Part 1

Push notifications with Xamarin – Server

Azure Notification hub

Now that we have three apps which implement push notifications, we also want to send some messages to the user! Until now we have done this by using the Azure portal but this is very limited and you’re not going to want to check your database for updates and sent out the right push notifications … Read more Push notifications with Xamarin – Server

Push notifications with Xamarin – Windows Phone

Windows Phone Push Notification

To conclude my ‘push notifications’ series I will now tell you how to implement push notifications on Windows Phone. Be sure to read my previous two posts on the notifications for iOS and setting up Azure and also implementing on Android. If you did read and/or follow them, this will be a piece of cake (hmm cake.). I … Read more Push notifications with Xamarin – Windows Phone

Push notifications with Xamarin – Android

Android Notification drawer

After my introduction, configuring Azure and implementing the iOS code it is now time for the Android side of things. Updating the Azures First things first. We need to do some more configuration in Azure. Don’t worry, it’s not nearly as much as last time. If you’re only creating a Android app and missed the initial … Read more Push notifications with Xamarin – Android

Push notifications with Xamarin – iOS

iOS Push notifications

As promised in my previous post I will continue this series with implementing the app code, in this case iOS. Fortunately, this is the hardest one so it only gets easier from here! Be prepared… Before we do anything there is a little preparation we need to do. On the server side a little Azure magic … Read more Push notifications with Xamarin – iOS