A health and safety compliance SaaS and accreditation business, owned by a UK private equity house

Predicting churn to protect a compliance SaaS business

A health and safety compliance SaaS and accreditation business wanted to move from BI reporting to predictive retention. QuantSpark built a proof-of-concept churn model that identified the customers most likely to leave at renewal, enabling prioritised outreach.

7 July 20261 min read
Headline result
76%
of churn instances predicted in test data
At a glance
76%
of churn instances predicted in test data
Editorial illustration for Predicting churn to protect a compliance SaaS business

of churn instances predicted in test data

76%

  • Delivered: the proof-of-concept model correctly identified 76% of churn instances when tested against held-out data.
  • Projected, not yet realised: contacting the highest-risk 50% of customers due for renewal was modelled to capture 87% of all churners.
  • Diagnostic finding: between 17% and 33% of churn was assessed as unavoidable, meaning the addressable, avoidable share of churn the model targets is roughly 83% of the total.
  • The delivery record evidences no realised retention uplift against the 90% target; this is a tested predictive capability, not a measured post-deployment business outcome.

The problem

The client sells accreditation, certification and SaaS products that help SME customers manage health and safety compliance, and it holds substantial customer data through its subscription model. Its measurement stack, though, stopped at business intelligence dashboards and KPI tracking: useful for showing what had already happened, but no help in deciding who to prioritise ahead of a renewal date.

There was no data-driven way to identify at-risk customers or to prioritise renewals outreach. The business wanted to move beyond descriptive reporting towards predictive value, a shift many subscription businesses attempt but few complete, since it requires both a clear-eyed audit of current data capability and a working model to prove the idea out.

Strategically, this mattered because the business needed to lift retention on its flagship accreditation product back above a 90% target. Undirected outreach to every renewing customer is costly and dilutes attention away from the accounts that are actually at risk of leaving, so the absence of a prioritisation mechanism was not just a data gap but a commercial one.

How we delivered it

  1. Two-week Data Diagnostic

    13 workshops with 24 stakeholders across the C-suite, sales, marketing, finance and management information functions, run over two weeks to map current data capability and process.

  2. Document and dataset review

    Eight internal documents and six datasets reviewed to produce a capabilities and process audit of how data was being used across the business.

  3. Opportunity Menu prioritisation

    Findings distilled into a prioritised, scoped Opportunity Menu identifying where predictive and analytical work would add most value; the churn problem on the flagship accreditation product was the opportunity carried forward into the second workstream.

  4. Churn driver hypothesis generation

    The team hypothesised the likely drivers of customer churn on the flagship product before touching the data, keeping the model grounded in plausible business mechanisms rather than pure correlation-hunting.

  5. Data matching

    Each hypothesised driver was matched against the client's internal datasets to confirm which could actually be evidenced and used as model inputs.

  6. Model build

    A Random Forest classifier was trained to score churn risk at the level of the individual renewal, producing a risk score per customer ahead of their renewal date.

  7. Validation on test data

    The model was tested against held-out data, correctly identifying 76% of actual churn instances, and its outputs were used to project the effect of targeting outreach at the highest-risk segment.

  1. Diagnostic workshops

    13 workshops, 24 stakeholders; 8 documents and 6 datasets reviewed

  2. Process audit & Opportunity Menu

    Capabilities audit distilled into a prioritised, scoped list of opportunities

  3. Churn hypothesis & data matching

    Likely churn drivers hypothesised, then matched to available internal data

  4. Model build

    Random Forest classifier trained to score renewal-level churn risk

  5. Test validation

    76% of churn instances correctly identified in held-out test data

From two weeks of stakeholder diagnostics to a tested, renewal-level churn risk score.

Built with

  • Machine learning classification (Random Forest)

    Core predictive model, scoring churn risk at the level of the individual renewal

  • Internal subscription, renewals and customer datasets

    Training and test data source for the churn model, drawn from the client's own systems rather than any third-party or proprietary platform

  • Business intelligence / KPI dashboards

    Pre-existing descriptive reporting layer the business used before the engagement, limited to backward-looking metrics

Return on investment

Delivered return

76%

of churn instances predicted in test data

What was delivered

  • Delivered: the proof-of-concept model correctly identified 76% of churn instances when tested against held-out data.
  • Projected, not yet realised: contacting the highest-risk 50% of customers due for renewal was modelled to capture 87% of all churners.
  • Diagnostic finding: between 17% and 33% of churn was assessed as unavoidable, meaning the addressable, avoidable share of churn the model targets is roughly 83% of the total.
  • The delivery record evidences no realised retention uplift against the 90% target; this is a tested predictive capability, not a measured post-deployment business outcome.

How the return was measured

The value case is a targeting argument rather than a monetised return. Retention outreach, calls, incentives, account-management time, costs more the more customers are contacted, while its benefit depends on how much churn is actually prevented among those contacted. By scoring every renewal for risk, the model lets the business concentrate a fixed outreach budget on the smaller, highest-risk segment while modelling shows most preventable churn would still be caught. No pound-value return, cost saving or payback period is stated in the source record, and none is calculated here, since that would require customer lifetime value, outreach cost and conversion assumptions that are not evidenced in the delivery record.

A proof-of-concept churn model built for a health and safety compliance SaaS and accreditation business correctly identified 76% of churn instances in test data. Modelling on top of that result showed that contacting just the highest-risk half of customers due for renewal was projected to capture 87% of all churners, giving the business a way to concentrate a limited retention effort on the accounts most likely to actually leave.

The client sells accreditation, certification and SaaS products that help SME customers manage health and safety compliance, and it holds substantial customer data through its subscription model. Its measurement stack, though, stopped at business intelligence dashboards and KPI tracking: useful for showing what had already happened, but no help in deciding who to prioritise ahead of a renewal date. There was no data-driven way to identify at-risk customers or to prioritise renewals outreach. That mattered strategically because the business needed to lift retention on its flagship accreditation product back above a 90% target, and undirected outreach to every renewing customer is costly and dilutes attention away from the accounts that are actually at risk.

QuantSpark split the engagement into two workstreams. The first was a two-week Data Diagnostic: 13 workshops with 24 stakeholders spanning the C-suite, sales, marketing, finance and management information functions, alongside a review of eight internal documents and six datasets. This produced a capabilities and process audit and a prioritised, scoped Opportunity Menu, the shortlist of where predictive and analytical work would add most value. Churn on the flagship accreditation product was the opportunity carried forward into the second workstream.

The second workstream carried that priority into a working proof of concept. The team first hypothesised the likely drivers of churn, a discipline that keeps a model grounded in plausible business mechanisms rather than pure correlation-hunting, then matched each hypothesis against the client's internal datasets to see which could actually be evidenced. Only then was a Random Forest classifier trained, scoring churn risk at the level of the individual renewal rather than at the portfolio level, so that outreach could in principle be targeted customer by customer.

In practice the work ran as a single pipeline rather than two separate projects: diagnostic workshops and document review fed the process audit; the audit fed the scoped Opportunity Menu; the churn opportunity identified on that menu was carried into hypothesis generation and data matching; and that fed the model build and its validation against a held-out test set. The technical core throughout was standard supervised machine learning, a Random Forest classifier, trained on the client's own subscription, renewals and customer data rather than any proprietary or third-party system.

Two figures matter for the value case, and they are not the same kind of figure. The 76% churn-detection rate is a measured result, drawn from testing the model against data the model had not seen during training. The second figure, that contacting the highest-risk half of the renewal base was projected to capture 87% of all churners, is a modelled projection of what targeted outreach could achieve, not a retention uplift that has actually been realised and evidenced in the delivery record. The diagnostic work also surfaced that somewhere between 17% and 33% of churn is effectively unavoidable, customers leaving for reasons outside the business's control, which means the addressable, avoidable share of churn the model is aimed at is roughly 83% of the total.

Put together, the logic for the client is that a small, prioritised slice of the renewal book, rather than the whole book, can be targeted with retention effort and still catch most of the churn that is realistically preventable. That is the return-on-investment argument in outline: the cost of retention outreach, calls, incentives, account-management time, scales with how many customers you contact, while the benefit scales with how much churn is actually prevented among those contacted. A model that concentrates outreach on the highest-risk half while still catching the large majority of preventable churners lets a fixed retention budget go further than blanket coverage would. No pound-figure return has been calculated here: doing so would require assumptions about customer lifetime value, outreach cost and conversion rates that are not present in the source record, so none has been invented for this case study. What is evidenced is a tested predictive capability, not yet a measured business outcome.

Figures are drawn from completed QuantSpark engagements. Clients are anonymised by agreement; on a call we will walk you through how each number was measured and, where the client has agreed, put you in touch with a reference.

Ask about our work

Answers only from our documented case studies

Powered by the same applied-AI approach we deliver for clients

Solving something similar in Private Equity?

Get in touch. We will discuss your challenge and show you what is possible.