Case study · Software Testing

Computer vision-guided testing for a Malta-based testing laboratory.

How we replaced manual visual QA cycles with a computer vision layer that caught regressions humans missed, and reclaimed engineering hours that used to disappear into screen-watching.

Computer Vision Test Automation Malta Anonymised
INDUSTRY
Software testing laboratory
ENGAGEMENT
Build Sprint · Milestone pricing
DURATION
12 weeks, end to end
STATUS
In production
The context

A laboratory that ran out of eyeballs, not ambition.

The client is a Malta-based software testing laboratory that runs quality assurance for gaming and consumer software vendors. Most of their work involves running regression suites against client builds and manually verifying visual output, a category of testing that does not lend itself neatly to traditional automation frameworks.

The bottleneck wasn't ambition. It was time. Every new client build required a tester to physically watch the UI, compare it against an expected state, and flag differences. This is work that AI handles better than humans, but only if the tooling is set up correctly and the edge cases are addressed honestly. Most off-the-shelf visual testing tools fall over on dynamic content, localisation, or animated elements. The lab had tried several. None survived production use.

The challenge

Three constraints that made this harder than it looked.

How we approached it

Four stages. Standard Elevate AI playbook.

The engagement ran through our standard four-stage framework. Each phase had a defined deliverable and a milestone gate.

Discover (weeks 1–2). We embedded with the lab's senior testing engineers to map their current manual QA workflow end to end. We identified which categories of test actually benefited from visual AI, and which were better left to traditional assertion-based tooling. Not everything was a nail.

Co-create (weeks 3–6). Rapid prototype built against one client's regression suite. We used computer vision frameworks to handle structural comparison, plus targeted LLM calls for semantic interpretation where pixel-perfect comparison would have produced false positives. Reviewed with the client's engineers every Friday.

Build (weeks 6–10). Production integration. Connected into the lab's CI pipeline, test management system, and reporting layer. Hardened the confidence scoring so the system only raised flags it was sure of. Added a human-in-the-loop escalation path for edge cases.

Scale (weeks 10–12). Rolled out across additional client suites. Documentation, handover, internal training for the lab's engineers. Monitoring and observability in place before we stepped back.

Computer VisionOpenCV, custom pipelines
LLM LayerFor semantic comparison
IntegrationCI/CD hooks, test reports
"The difference isn't just speed. It's that our testers can spend their time on the exploratory work where they actually add value, not watching a screen refresh for the hundredth time that week. — Senior Testing Engineer (anonymised at client's request)

[Note: placeholder attribution. To be updated with a real, consented quote from the client before publication.]

The results

What shipped, what changed.

TEST COVERAGE
3x
More regression cycles completed per engineer per week. No headcount added.
REGRESSIONS CAUGHT
+
A material number of visual regressions caught by the system that the previous manual process had missed in earlier builds. [CONFIRM exact number]
TIME TO LIVE
12 wk
From kickoff to production integration. Milestone-priced, no overruns.
The takeaway

Why this engagement became a pattern.

This was one of the three engagements that shaped the studio's early thesis. Each one involved a regulated or compliance-heavy operator. Each one involved integrating AI capability into workflows that existing vendors had failed to handle. And each one produced a pattern that's now informing our next ventures.

Test automation at this level of visual complexity, done right, is a product category of its own. Watch this space.

Next case studies

Read more from the field.

Got a similar problem?

Most of our engagements start with a 30-minute discovery call. No deck. We'll tell you plainly whether we're the right team.