All Insights
Perspective//6 min read

Your AML alerts are a labeling budget

Alerts in AML are not merely indications of potential illicit activity; they are a critical input for training and validating the next generation of financial crime detection systems.

By the Lanthos partnership
Illustration for the article “Your AML alerts are a labeling budget”

The fluorescent hum of the trading floor has long since faded, replaced by the hushed glow of screens in a financial crime operations centre. Here, an analyst confronts a queue of alerts, each a digital flag raised by an automated system. This specific alert, one of hundreds processed daily, pertains to a series of seemingly innocuous transactions from a corporate account to a vendor in a high-risk jurisdiction. The system has flagged it for 'unusual volume and frequency'. The analyst, armed with experience and a procedural playbook, delves into the client's profile, transaction history, and open-source intelligence. After some minutes, perhaps an hour, the conclusion is reached: the activity is legitimate, explicable by a new supply contract. The alert is closed, categorised as 'false positive'. This moment of human judgment, repeated millions of times across the global financial system, is not merely the disposition of a case. It is, more fundamentally, an act of labelling. Each such act, whether affirming suspicion or dismissing it, consumes resources, but simultaneously, it generates invaluable data. This data, carefully curated and understood, is the very currency that will finance the next evolutionary step in financial crime detection.

the hidden cost of disposition

Traditional anti-money laundering frameworks are designed to cast a wide net. Rules-based systems, calibrated to avoid missing genuinely illicit activity, inevitably produce a significant volume of alerts that upon human review are deemed benign. This is the operational reality of the 'false positive' problem. Each alert, irrespective of its ultimate disposition, incurs a tangible cost. There is the direct labour expense of the analyst's time, the supervisory oversight, and the technological infrastructure required to present, investigate, and record the outcome. This cost is readily accounted for within operational budgets. Yet, there is a more subtle, systemic cost: the erosion of analyst efficiency and the potential for 'alert fatigue', which can desensitise even the most diligent human operator to genuine threats buried within the noise.

For decades, the imperative has been to reduce the volume of alerts, often through tighter rule calibration or the introduction of additional, often equally brittle, filtering logic. While this can offer some immediate relief to operational teams, it often represents a local optimisation that merely shifts the problem or, worse, introduces new blind spots. A more holistic view recognises that the disposition of an alert, whether true or false, represents a critical data point. The act of an analyst closing an alert is not simply an administrative task; it is the definitive classification of a transaction or activity as either suspicious or legitimate, based on the totality of available information and expert judgment. This classification, consistently applied, is the precious signal within the noise, the human intelligence that can transform an otherwise inert data stream into a powerful training resource.

the emergent value of human labels

The advent of advanced analytical techniques, particularly in machine learning, has fundamentally altered the calculus of alert management. These systems thrive on high-quality, human-labelled data. Every alert investigated and definitively closed by an analyst provides a 'label' – an explicit declaration that this specific pattern of activity, under these particular circumstances, is either 'suspicious' or 'not suspicious'. This human input, previously considered an overhead, now becomes the essential fuel for iterative improvement. Without a sufficiently large and diverse set of accurately labelled data, the most sophisticated algorithms remain theoretical constructs. The financial institution's existing operational expenditure on alert disposition, therefore, effectively constitutes its annual budget for generating this vital training data.

Consider the distinction between a 'false positive' and a 'true negative'. In a rules-based system, a transaction that does not trigger an alert is simply not seen. In a machine learning context, however, if that same transaction is reviewed and explicitly deemed legitimate, it becomes a 'true negative' – a powerful example of what normal, acceptable behaviour looks like. The explicit labelling of these non-alerts, or the confirmation of their benign nature post-alert, is critical for teaching models to discriminate. The institution with a well-structured process for capturing the granular detail of analyst decisions – not just 'closed' but 'closed because of X, Y, Z' – is effectively building a proprietary data asset of immense strategic value. This asset is far more potent than any generic, off-the-shelf dataset because it reflects the institution's specific client base, product offerings, and risk appetite.

beyond mere calibration: model iteration

The traditional approach to improving AML systems often involves periodic, arduous calibration exercises. These are typically manual efforts, often using small, retrospectively selected datasets, aiming to tweak rule thresholds to reduce alert volumes without unacceptable risk. The results are often ephemeral, as criminal methodologies evolve and business practices shift. In contrast, viewing alerts as a labeling budget opens the door to continuous, data-driven model iteration. Each human decision feeds back into the system, allowing for regular retraining and refinement of predictive models. This transforms the operational cost of alert disposition from a sunk cost into an ongoing investment in system intelligence.

The effectiveness of this iterative feedback loop hinges on several factors. First, the granularity and quality of the labels are paramount. A simple 'closed' is less valuable than 'closed, legitimate business reason: new supplier contract verified'. Second, the ability to rapidly ingest and incorporate this labelled data into model updates is critical. Legacy technology architectures often impede this agility. Third, there must be a robust process for validating model performance against newly labelled data, ensuring that changes genuinely improve detection capabilities and reduce the burden on human analysts without increasing compliance risk. This cycle of label generation, model retraining, and performance validation constitutes a modern, agile approach to financial crime detection.

the economics of data generation

When viewing alert disposition as a data labeling exercise, the economics shift. The goal is no longer solely to minimise the absolute number of alerts, but to optimise the return on the labelling effort. This means understanding which alerts, even if ultimately false positives, contribute the most valuable or diverse labels to the training set. It might be strategically beneficial to tolerate a higher volume of certain types of alerts if they illuminate novel patterns of legitimate behaviour or provide crucial examples of emerging illicit typologies. The cost per label, rather than simply the cost per alert, becomes a key performance indicator. This metric drives decisions about workflow, technology investment, and analyst training.

Furthermore, the concept extends beyond the disposition of alerts generated by automated systems. Consider the Suspicious Activity Reports (SARs) filed. Each SAR, representing a confirmed instance of suspected illicit activity, is a highly valuable 'true positive' label. The meticulous documentation supporting these reports contains rich, contextual information that can significantly enhance model training. Similarly, instances where initial suspicions were dismissed but later proven to be illicit activity (false negatives) are exceptionally rare but critically important data points for model adjustment. Capturing and integrating these diverse data points, alongside the daily stream of alert dispositions, creates a comprehensive and continuously evolving picture of financial crime risk tailored to the institution's unique operating environment.

from cost center to intelligence engine

The financial crime operations function has traditionally been perceived as a cost centre – a necessary, albeit expensive, overhead dictated by regulatory imperative. This perspective, while understandable given the compliance burden, overlooks the profound strategic potential embedded within its daily activities. By re-framing the function, particularly its alert disposition processes, as a sophisticated data labelling factory, its role transforms. It becomes an intelligence engine, continuously generating the proprietary data necessary to build and refine an institution's bespoke defence against financial crime.

This transformation is not merely conceptual; it necessitates tangible shifts in investment priorities, technology architecture, and operational design. It requires a move from static, rules-based logic to dynamic, learning systems that can adapt to evolving threats. It demands that the human analyst, far from being replaced, is empowered with tools that enhance their investigative capabilities and streamline the capture of their expert judgment. The future of financial crime detection lies not in simply reducing alerts, but in intelligently leveraging every alert to make the entire system smarter, more resilient, and ultimately, more effective.

Leaders within financial institutions should therefore critically assess the infrastructure and processes supporting their financial crime operations. They must ensure that the design of their alert management systems facilitates granular data capture at the point of human decision. Investment in agile data pipelines and model retraining capabilities should be prioritised. The role of the financial crime analyst should be elevated to that of a crucial data annotator and domain expert, their insights explicitly valued as the foundation for the institution’s evolving defence strategies.