• Marcel Haas

Meet my Virtual Assistants

Conversational AI is top of mind for me. In the last two years, I built several bots based on the Microsoft Bot Framework to learn about it's capabilities.

 

Let me share some of my fun experiences and give you a overview what I've built and which cognitive skills the bots have.

 

First, lets have a look at the Conversation AI landscape available in Azure:

Meet my virtual helpers, equipped with a variety of cognitive skills:

Rusty v2 / Intelligent News Proposal

Rusty is listening to audio recording in Microsoft Teams and extracts the conversation transcript via video analyzer.

 

Based on text analytics and intention detection, the bot recommends to create an intranet news in SharePoint based on the voice conversation.

 

If the message contains sales win or new customer information, then the bot talks interactively to the user in a personal Microsoft Teams conversation.

  • Interactive rich notifications in Microsoft Teams

  • Adaptive Cards

  • Video Analyzer

  • Person Detection

  • Natural Language Understanding (LUIS)

  • Sentiment Analysis

  • SharePoint REST API

  • Microsoft Flow

  • Bot Framework 4

  • Node.js

Alfred the Butler / User Adoption Driver

 

Alfred ensures an smooth on- boarding to the corporate intranet for new employees. Thanks to his cognitive skills, he can detect bad mood in photos posted in Microsoft Teams and offer interactive help to the user.

 

Based on the users intention, a range of online training and resources is suggested.

  • Interactive rich notifications in Microsoft Teams

  • Webhooks

  • Message Cards / Carousel

  • Natural Language Understanding (LUIS)

  • Face API

  • Emotion Detection

  • Sentiment Analysis

  • Microsoft Flow

  • Bot Framework 3

  • Node.js

 

 

 

 

 

 

"Vesa Juvonen" Bot / Site Creator

 

Vesa is specialized in creating SharePoint Teamsites and Commsites based on the PnP framework.

 

Site options can be chosen in rich carousel in Microsoft Teams, options are sent to an Azure Function running PnP Powershell, then the site gets created and Vesa provides a success feedback with the new site url to the user.

  • Interactive rich notifications in Microsoft Teams

  • Webhooks

  • Message Cards / Carousel

  • Natural Language Understanding (LUIS)

  • Azure Functions

  • Azure Queue Storage

  • PnP Powershell

  • Microsoft Flow

  • Bot Framework 3

  • Node.js

Rusty / The Time Sheet Manager

Rusty is supporting the internal time sheet approval process with interactive reminders and helpful information to process documentation.

  • Interactive rich notifications in Microsoft Teams

  • Adaptive Cards

  • Bot Framework 4

  • Node.js

EDUCATO / Swiss Army Knife

From kitchen clothing orders to showing timetables or detect chicken breeds based on a custom vision model, this bot covers them all.

 

Created as demo for a keynote, which I did together with the Microsoft Education Team Switzerland to showcase intelligent capabilities in bots for the education sector.

  • Interactive rich notifications in Microsoft Teams

  • Adaptive Cards / Carousel

  • Custom Vision Integration

  • Bot Framework 4

  • C#