Introduction

Bot Management in Vtiger CRM is a centralized hub for managing bot interactions. You can find all GPT-related queries from Live Chat, Cases, Websense, and NLQ in one place.

It is available as a part of the Calculus AI Add-on. Install the Calculus AI Add-on from the Extension Store to access the Bot Management module in the CRM. You can find Bot Management under Help Desk > Customer Service Analytics. 

You can use Bot Management to train the Chatbot on documentation like FAQs and articles. The FAQs and article queries from users from various sources consist of the Bot data. You can modify and improve the answers to train the bot. This is done to improve the Bot response gradually. 

Note: Only Admin users can use the Train option to train the Bot on FAQs and articles. The Train option under Bot Setup will be unavailable for other users. 

Bot Management Features

The Bot Management page includes three tabs:

• Bot Analytics
• Bot Queries
• Bot Setup

Bot Analytics

Bot Analytics gives you an overview of the Bot data. The Bot Analytics is represented by a Sankey Diagram that displays the query count of FAQs. It also displays the numbers based on the following FAQ statuses: 

• Accepted: When you click the thumbs-up icon for an FAQ, the status will show as accepted.
• Rejected: When you click the thumbs-down icon for an FAQ, the status will show as rejected.
• Imperfect: When an agent makes changes to an FAQ, the changed responses fall under the Imperfect category.
• Not rated: When an FAQ is neither given a thumbs-up nor a thumbs-down, the status will show as not rated.
• No answer: When the FAQ does not reply with an answer and shows a Sorry message, the status will be No answer.
• New FAQ: When a new FAQ is added, the status will appear as New FAQ.

You can filter the date range to view the diagram specific to a particular date.

You also have the option to view the diagram in full screen, print the chart, or download it as a PNG, JPEG, or SVG vector image. You can also download it as a PDF document.

Input Type Analysis

Bot Management supports queries that come through the following Query channels:

• KB Query: When there are queries in the Live Chat or Cases related to FAQs and articles from the Knowledge Base, they are categorized as KB queries. 
• Data Query: A query that uses Ask Calculus AI prefixes will be categorized as a Data query. For example, summarizing, showing a list of deals, or creating a task are categorized as Data Queries.
• Record Creation: When a new record is created using Ask Calculus AI, the number will be updated in the record creation type.
• Record Query: A query specific to a record of any module is called the Record Query type.
• GPT Query: A query generated through Ask GPT in Ask Calculus AI is categorized as a GPT query. Click here to learn more about Ask Calculus AI.

Accepted by Date

You can view the number of queries accepted by date. The number of FAQs accepted will also be displayed for these dates. 

You have the option to view the FAQ queries Accepted by Date. You can view the diagram on the full screen. Print the chart or download it as a PNG, JPEG, SVC vector image, or PDF document.

Bot Queries

Bot Queries are requests or interactions initiated by your customers with the bots deployed in the CRM.  

You will see rectangle boxes with FAQ status and numbers when you click the Bot Queries tab. The numbers are updated based on the status of FAQs. When an FAQ is Accepted, the number will be updated in the related tab. Similarly, if a FAQ is rejected, the Rejected tab will be updated, and so on. 

The Total tab will give you the sum of Accepted, Rejected, Imperfect, Not Rated, and No answers.

When you click on an FAQ record from Bot Queries, a Query details window will open.

The Query details window will display the following:

• Query: This is the question asked by the user.
• Bot answer: This is the answer given by the Bot.
• Source Record: This is the origin of the bot query that was created.
• Requested By: This refers to the user who had asked this query.
• Requested time: This refers to the time the query was asked by the user.
• Source: This refers to the source from which the bot picked up the answer.
• Status: This refers to the status of the record - if accepted, rejected, not rated, and so on.
• Reviewed by: This is the name of the reviewer who reviewed the FAQ.
• Reviewed status: This refers to the status - if reviewed or To be reviewed.

You can choose the source of the query from where it originated and review those specific queries. You can find queries from the following sources:

• Live Chat
• Cases
• Websense
• NLQ and 
• Test_Query

When you select Live Chat, all queries that the Live Chat agent receives will be reviewed by the reviewer.

The Bot queries are reviewed internally, and the status is marked accordingly as - Accept answer, Invalid question, Update source FAQ, or  +Add FAQ.

When the reviewer finds that the Bot has replied with the correct answer, they can accept the answer. If the Bot cannot answer correctly, they can update the FAQ or add a new one.

The new ones added can be trained and tested to see if the Bot gives the correct answer.

Bot setup

The Bot setup consists of FAQs, articles, and documents. The Bot undergoes training in the Bot setup section. It will provide answers based on the training on FAQs, articles, and other documents. It will fetch answers from FAQs, articles, and documents.

You can train the Bot on FAQs and articles only if they are in the published and public state. Documents can be selected from the Document module and added to the Documents folder for training. 

To understand if the Bot is giving the right answer, you have to use the Test query. You can type your question in the Question field and click enter. It will provide you with the answer and the source from which the answer was given. If the bot answer is unsatisfactory, you can modify the answer again, train, and retest the answer. 

Training the Bot on FAQs and Articles

Specific roles are enabled in the User Management Settings page to train the bot on FAQs and articles. Only the roles assigned or enabled can train the FAQs. You have a Train button that allows you to train the Bot on FAQs and articles.

The Train option in Bot Management will be frozen for the other users in the CRM.

You will see the status of the Training data - if scheduled, in progress, or failed. The scheduled time - Start Time and End Time and the Train button.

When you click the Train button, the Bot will be trained on FAQs and articles.

Prompt Builder

Key Terminology

Accessing Bot Management

1. Log in to the CRM.

​​​​

2. Go to the Help Desk app.
3. Go to the Customer Service Analytics section.
4. Click Bot Management. The Bot Management module opens.

Reviewing FAQ queries

Once you land on the Bot Management module, click the Bot Query tab. Bot Queries are requests or interactions initiated by your customers with the bots deployed in the CRM.  

Follow these steps to review the FAQ queries:

1. Log in to the CRM.
2. Go to the Help Desk app.
3. Go to Customer Service Analytics.
4. Select Bot Management. The Bot Management module opens.

5. Click the Bot Queries tab.
6. Go to the Bot queries section.
7. Click the Filter icon beside the search bar.
8. Select the source from the drop-down. A List of queries will be displayed.
9. Click Apply.

 

​​​​​​

10. Click on an FAQ. The Query details will be displayed on the right side.
11. Review the Question and Answer.
12. Enter or select one of the following options
    1. Click Accept Answer if you are satisfied with the Bot response.
    2. Click Invalid question if you feel the question is irrelevant.
    3. Click Update source FAQ to modify the Question and Answer. An FAQ record window opens.

1. Update the Question.
2. Update the Answer.
3. Click Save and Test. You will see the Training the Model data message. Once done, Retraining has completed message is displayed along with the Bot response.

1. ​Click Accept answer to accept or
2. Click Update Source FAQ.

1. Click +Add FAQ if you want to add a new FAQ. An Add FAQ window opens.

1. Question: Add the Question.
2. Answer: Add the Answer.
3. Question Variants: Add Question Variants.
4. FAQ Label:  Add FAQ label.
5. Status: Select the status from the drop-down.
6. Category: Add the Category.
7. Feature: Add the feature.
8. Version: Select the Version.
9. FAQ Visibility: Select the FAQ visibility from the drop-down.
10. Click Save.​​​​​​

13. Click Train and Test. The Updating training model with a revised FAQ message will be displayed. Then, Retraining has completed message is displayed. You will now see the new changes reflected in the response.

Creating a Data Template in Prompt Builder

You must go to the Bot Management module to access Prompt Builder. 

Follow these steps to create a Data Template in Prompt Builder:

1. Log in to the CRM. 
2. Go to the Help Desk app.
3. Go to the Customer Service Analytics section.
4. Click Bot Management. The Bot Management module opens.

5. Click the Bot Setup tab.
6. Click Prompt Builder.

7. Click Data Templates.
8. Click +Add Data Template. A Create window opens.

9. Add the Data Template Name.
10. Select the Status from the drop-down.
11. Select the Modules from the drop-down.
12. Type your query in the Template Content field.
13. Select the Merge Fields from the Record Fields drop-down. It will be added as Merge tags in the Template Content field.
14. Click Save.

The Data Template in Prompt Builder is saved. Once saved, it will appear in the Data Template List View with module and Status details.

Creating a Prompt Template in Prompt Builder

You must go to the Bot Management module to access Prompt Builder. 

Let us create a Data Template for the Contacts module and see how Record and List modes work.

Follow these steps to create a Prompt Template in Prompt Builder:

1. Log in to the CRM. 
2. Go to the Help Desk app.
3. Go to the Customer Service Analytics section.
4. Click Bot Management. The Bot Management module opens.

5. Click the Bot Setup tab.
6. Click Prompt Builder.

7. Click Prompt Templates.
8. Click +Add Prompt. A Create  Prompt template window opens.

9. Add a Prompt Name.
10. Select the Status from the drop-down.
11. Select the Module from the drop-down.
12. Type your query in the Prompt Template field.
13. Select the Data Template from the Insert Data Templates drop-down. The content from the Data template will auto-fill the Prompt Text field.

Note: Save the Prompt template using either one of the modes - Record or List. Follow the steps below to verify each of these modes.

14. Enter or select the following Mode:
    1. Record - If you select record mode, follow the below steps:

1. Go to Contacts.
2. Select a record from the List View. The Summar View of the record opens.
3. Click the Show Prompts icon on the right side. The Calculus AI window opens.
4. Select a Prompt template from the pre-built prompt drop-down in the Calculus AI window.
5. Select the saved template from the drop-down. The response will be loaded and shown based on the selected template. 

1. List - If you select List mode, follow the below steps:
   1. Go to Contacts.
   2. Select records within this range(0-20). The mass action icons will be displayed above.
   3. Select the horizontal three dots.
   4. Select Calculus AI. The Calculus AI window opens on the right side with the Enter you Prompt field at the bottom.
   5. Select the Prompt template from the drop-down.

You will see the response on the screen based on the selected Prompt template.