How to answer phone calls with AI

Want to harness the power of artificial intelligence to enhance phone call handling? This guide will walk you through the steps to set up a fully functional AI-driven phone assistant using Ozeki AI Server. Whether you want to save time, improve efficiency, or provide seamless customer service, this solution is for you. In just a couple of hours, you’ll have a robust system that utilizes Speech to Text, Text to Speech, and cutting-edge AI technologies. The step-by-step instructions ensure that even beginners can follow along with ease. Ready to revolutionize your communication? Let’s get started!

What is Speech to Text?

Speech to Text is a technology that allows spoken words to be converted into written text. It is used because it enables real-time transcription, enhancing communication efficiency.

What is Text to Speech?

Text to Speech is a technology that converts written text into spoken words. It is used to provide a natural, audible response for interactive systems.

Download an AI model for speech to text

You can use the following Speech to Text model

https://huggingface.co/ggerganov/whisper.cpp

Dowload Speech to Text model

Download model file
Figure 1 - Download model file

Copy model file to C:\\AIModels folder
Figure 2 - Copy model file to C:\\AIModels folder

Setup AI models and chat bot

Open AI studio
Figure 3 - Open AI studio

Create new Speech to text model
Figure 4 - Create new Speech to Text model

Select model file
Figure 5 - Select model file

Create new Text to Speech model
Figure 6 - Create new Text to Speech model

Select voice
Figure 7 - Select voice

Create chat GPT model
Figure 8 - Create chat GPT model

Insert API key
Figure 9 - Insert API key

Create new AI Chat bot
Figure 10 - Create new AI Chat bot

Disable welcome message
Figure 11 - Disable welcome message

Disable reset message
Figure 12 - Disable reset message

Create VoIP phone line

Figure 13 - Open AI Studio

Figure 14 - Open AI Gateway

Add new AI agent
Figure 15 - Add new AI agent

Install VoIP phone connection
Figure 16 - Install VoIP phone connection

Configure SIP settings
Figure 17 - Configure SIP settings

Set AI models
Figure 18 - Set AI models

Create new incoming route
Figure 19 - Create new incoming route

Create new outgoing route
Figure 20 - Create new outgoing route

Make a test phone calls

Incoming phone call received
Figure 21 - Incoming phone call received

Voice question and answer
Figure 22 - Voice question and answer

Setup the phone assistant properly

Figure 23 - Make sure the text to speech and speech to text are setup properly

Figure 24 - Write a nice greeting message

Figure 25 - Write a nice system prompt

Here is a good system prompt: 

You are a telephone assistant of a company called Ozeki selling SMS gateway software 
for Windows. You are helping a customer. First ask the customer about how can we help, 
then ask him, what is his name, then ask which company is he calling from, ask him 
to name the company, finally ask which country is he calling from.  Ask him to 
explain in detail why he has called about the SMS gateway. Ask if he would like to 
receive a call back from a human. If yes ask for his phone number. Tell
him that we will contact him shortly. Ask one question at a time. Keep your responses short.

More information