building chatbots in large scale - Czechbots · Common logging & reporting. [email protected]...

22
building chatbots in large scale chatbots orchestration

Transcript of building chatbots in large scale - Czechbots · Common logging & reporting. [email protected]...

Page 1: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

building chatbots in large scalechatbots orchestration

Page 2: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Every company has a chatbot

Question?

Page 3: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

But, what if…

Page 4: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

what if...

● you need a bot for a bunch of topics

(>300 intents)

● it’s a lot of work for a one team

● your bot should be available

on all messaging channels

● you need the human as a backup

Page 5: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Our challenges?

Page 6: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

NLP limitationsfirst challenge

Page 7: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Scaling the production of conversations teams

second challenge

Page 8: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Splitting the conversation to more bots

Cards?

Bank accounts?

Loans?

Investments?

Insurance?

Page 9: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Human agent handoverthird challenge

Page 10: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Provide ability to pass a thread to human

Page 11: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Orchestrating multiple botsfourth challenge

Page 12: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Adding a routing component & master bot

Master Skills

Router

Page 13: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Same experience on all channelsfifth challenge

Page 14: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

All channels on same protocol

web

mobile

messaging

voice

Page 15: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Uni Channel protocolsixth challenge

Page 16: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Common messaging templates

Page 17: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Handover protocol - from master bot

Page 18: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Handover protocol - and back

Page 19: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

What we’re going to release

Page 20: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Masterbot architecture in ČS

Page 21: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

Masterbot architecture pitfalls

● Automating the mastebot training data

maintenance

● Automating the testing

● Sharing conversation state between bots

● Keeping user in the right conversation context

● Common logging & reporting

Page 22: building chatbots in large scale - Czechbots · Common logging & reporting. david.menger@wingbot.ai chatbots orchestration. NJ IJEL wE9CHAT RTE R MASTER NL? BOT CADS GRITC1..1Ar BtAljcus

[email protected] orchestration