GR8 Tech x AWS AI Chatbot Successfully Closed 50% of Requests

Then It All Started

Imagine you need information about a project and start searching several databases or looking for somebody who can help you find it. This is a classic situation when businesses grow and their databases become more complex: sometimes, operational queries take just minutes, but some take hours.

This is how the idea of an AI chatbot was born—to help teammates and clients save time. AI chatbots reduce the time spent searching and improve accuracy. For clients, this means quicker responses and more relevant information. For employees, it is about helping them focus more on strategic tasks rather than searching for information in Confluence.

The Problem

To get started, we teamed up with our colleagues at Amazon, who offered us a ready-made solution.

However, it didn’t fully address our needs. We needed more data customization and a more precise security layer. Finally, our bot is supposed to integrate seamlessly with our databases, including Confluence, Knowledge Hub, and Jira. 

Also, the AWS solution did not provide an option to collect feedback for further advancements and references that the bot used to answer. Additionally, it was essential to make our chatbot easy for our clients to use.

The Solution

To customize the AWS solution, we decided to replace the Confluence data source with the S3 data source. We also filled the S3 repository with documents and developed a custom application based on the Slack_bot framework to replace AWS Chatbots.

In collaboration with AWS, we developed an efficient setup using AWS Chatbots, Bedrock Agents, and a Bedrock Knowledge Base. We also integrated multiple Confluence spaces with the chatbot to assess the project's potential. This implementation was effective from the outset, and we achieved successful results within a few days. Additionally, the source for the Knowledge Base can encompass any content that can be uploaded to Amazon S3.

Based on the feedback, the bot needed enhancements. Specifically, we required the capability for private messaging concerning sensitive topics, and there was a universal request for source links. Additionally, we needed a mechanism for collecting feedback. Consequently, we opted for a more customizable solution: the native Slack App integrated with the slack_bolt library.

The integration process was notably straightforward. The library's user-friendly interface, alongside the simplicity of the Bedrock SDK, facilitated a smooth implementation. Although employing Python's asyncio presented some challenges, the utilization of libraries such as aiobotocore and aioboto3 proved beneficial. 

This approach effectively addressed most of our concerns; the bot now accommodates private messaging and enables the inclusion of source links. Furthermore, we implemented a security layer that restricts access to certain Confluence spaces for specified users. Ultimately, we piloted the bot and started collecting usage metrics.

End Results

We analyzed the outcomes a few weeks after the launch: our bot successfully closed 50% of incoming requests.

Now, our employees can use the bot for daily tasks and find information about product setup or other projects much faster.

We’re also scaling the chatbot to support our clients directly, so they can quickly find answers to questions about setting up features or using the platform without having to reach out to the client support team.

Our plans include expanding the chatbot to handle end-user requests as well, which will help reduce the support load for our clients and streamline player assistance.