The project is complete. The new system went live on schedule, the migration worked, the integrations are running, users were trained, and the technology is stable. The project team delivered what it committed to deliver.
By the usual measures, it was a successful implementation.
Six months later, someone asks a different question: did the thing we were trying to improve actually get better?
That's a harder question to answer.
Most technology initiatives begin because something needs to change. Customers are waiting too long. Employees spend too much time doing things manually. Information is difficult to find. A process costs too much. An existing system is holding the business back. Or perhaps there's an opportunity the organization simply can't pursue with what it has today.
Technology becomes part of the response because there's an expectation that it will make something better. Once the project begins, though, attention naturally shifts toward getting the technology delivered. The original business problem becomes requirements, milestones, budgets, architecture, designs, testing and implementation plans. These are all necessary, and each brings its own demands.
Over time, however, the language of the project can begin to replace the language of the problem. Meetings are about delivery dates, defects, dependencies and readiness. Status reports show whether milestones are green or red. Success gradually becomes associated with getting the system into production.
Then the system goes live, everyone gets through the inevitable early issues, and the project is declared complete. The original problem may not come up again for quite some time.
This is how an organization can successfully deliver a new customer service platform only to discover that customers are still waiting just as long for service. The functionality is there. Performance is good. The integrations work and employees know how to use the system. Technically, there may be nothing seriously wrong with it.
Yet employees have created a spreadsheet beside the new system because something they need is awkward to do. Or the information everyone expected to have still isn't available when they need it. Maybe a process that was supposed to become simpler now has a new set of manual steps.
Nothing has to be technically broken for the investment to disappoint.
Workarounds are often among the first clues.
A spreadsheet appears. Someone keeps a separate list. Employees copy information between systems or quietly continue using part of the old process because it works better for a particular situation.
It's easy to look at this as an adoption problem. Sometimes it is. People need time to adjust to new technology, training matters, and familiar ways of working can be hard to change.
But sometimes the workaround is telling you something else.
The process may work differently in practice than everyone thought it did during design. Employees may need information at a point in the workflow nobody anticipated. A requirement that made perfect sense in a meeting may feel quite different when someone is trying to help an actual customer at 10:30 on a Tuesday morning.
Before go-live, much of what we believe about a new system is based on expectations. We expect customers to behave a certain way, employees to use particular capabilities, a new process to save time, or a feature to be valuable because people told us they needed it.
Then real people start using the system.
Some assumptions prove correct. Others don't. Customers behave differently. Employees find exceptions nobody anticipated. A feature everyone considered critical is barely touched while something relatively minor becomes essential. Processes that looked straightforward on a diagram turn out to have all sorts of complications.
None of this necessarily means the project was badly run. It means the organization now has something it didn't have before: evidence of what actually happens.
The question is whether anyone is still looking.
Technology teams understandably continue to watch the things they can measure directly. Availability, performance, incidents, defects, usage and response times matter. A system that is unreliable isn't going to support much of anything.
But those measures tell us whether the technology is working, not necessarily whether the reason for investing in it is being addressed.
A system can be available 99.99% of the time, perform beautifully and have growing usage while the process it was supposed to shorten still takes exactly as long as it did before. Both stories can be true at the same time.
This is where things get uncomfortable, because technology rarely creates a business outcome by itself.
The new system may work exactly as intended while the surrounding process hasn't changed. Responsibilities may still be unclear. Information may remain fragmented. A policy may prevent people from using a new capability effectively. Customers may simply behave differently from what the original business case assumed.
That doesn't mean the technology team should somehow be responsible for every business result. It means the technology was only ever one part of the change the organization wanted to create.
This distinction matters because otherwise everyone can do their job well and the organization can still miss the outcome. The vendor delivers. Engineering delivers. The project manager closes the project. Operations accepts the system. Each part can look successful when viewed on its own.
Meanwhile, the thing everyone originally wanted to improve hasn't moved very much.
There's also the question of time. Even when a technology initiative produces exactly the improvement everyone hoped for, the organization keeps changing around it. Customers change, volumes grow, regulations evolve, vendors change, security threats change, and new technologies create possibilities that didn't exist when the system was designed.
Something that fits the organization extremely well today may become the system everyone complains about five years from now. That's not necessarily evidence that the original decision was wrong. Technology has to live inside a changing organization, and its usefulness will eventually be tested by circumstances nobody could completely predict when the project began.
This is why go-live tells us only part of the story.
When things go well, the conversation about the original objective doesn't disappear when the project closes.
The system goes into use and the organization pays attention to what happens next. Workarounds aren't automatically dismissed as resistance; sometimes they're clues that reality differs from what was expected. Actual usage helps show which assumptions held up and which didn't. If the expected improvement isn't appearing, the conversation isn't limited to whether the technology is functioning correctly.
That doesn't diminish the importance of delivery. Getting a difficult technology initiative into production takes engineering, coordination, discipline and persistence. Systems need to be secure, reliable and maintainable. Projects need to be managed well. Those things matter enormously.
They just aren't the whole definition of success.
The project finish line and the outcome finish line aren't always in the same place. Delivery tells us that the organization successfully created a capability. What happens afterward tells us whether that capability made the difference everyone hoped it would.
Successful technology doesn't end at delivery. Ultimately, success is whether the thing that mattered enough to justify the investment actually became better.