1.2 The Knowledge Gap
To make this lab more realistic, we will frame it within a common enterprise scenario that can greatly benefit from the usage of private, local LLMs.
The Situation
-
We all work for "Parasol Insurance", a large multinational company with a busy IT Help Desk.
-
The company uses ServiceNow as its IT Service Management (ITSM) platform.
-
Over the years, thousands of incident tickets have been resolved. Each closed ticket contains a wealth of information:
-
The initial problem description.
-
The troubleshooting steps taken by support engineers.
-
The final, successful resolution notes.
-
The Problem
This repository of solved problems is a goldmine of organizational knowledge. However, it is almost completely inaccessible and unusable in its current form.
-
Trapped Knowledge: All of this valuable information is locked away in unstructured text fields within the ServiceNow database. There is no easy way to search for, correlate, or analyze past solutions that could help resolve current issues.
-
Inefficient Support: When a new incident occurs, support engineers spend a significant amount of time manually searching for similar past tickets, often with little success. This leads to:
-
Longer Resolution Times: Engineers frequently have to "reinvent the wheel" to solve problems that have been solved before.
-
Inconsistent Fixes: Different engineers may apply different solutions to the same problem, leading to inconsistent outcomes.
-
High Training Costs: It takes a long time to train new support staff on the specific "tribal knowledge" of the company’s IT environment.
-
-
The Cost: This inefficiency directly impacts productivity and operational costs. The company estimates that it loses thousands of hours per year due to engineers researching previously solved issues.
Our team has been tasked with building a prototype that unlocks this knowledge and makes it instantly accessible to our support engineers.