back to overview

AI on messy data is expensive self-deception

Industrial AI

CONTENT

  • The solved problem that was not solved
  • What messy data actually looks like
  • Why the deeper problem is architectural
  • What changes when data carries context

Hypothetically, if a manufacturer invested six months and a substantial engineering budget in an AI model for predictive maintenance, only to find that the model needs constant retraining and engineers still do not trust its recommendations, the temptation is to conclude that the algorithm was not good enough. In the majority of cases, that conclusion is wrong. The algorithm is rarely the problem. The data it was trained on almost always is.

The solved problem that was not solved

Industrial AI projects follow a recognizable arc. A team identifies a valuable use case: predicting a failure mode, optimizing a process parameter, detecting anomalies before they become stoppages. Data is collected from historians, MES systems, energy meters, and maintenance logs. A model is trained. Initial results look promising. Correlations appear. A dashboard shows the first predictions.

Then reality complicates the picture. Predictions are inconsistent across product variants. The model flags warnings that engineers dismiss as irrelevant. Some genuine failures are missed entirely. The team responds by retraining on more data, adjusting features, tuning thresholds. The model improves slightly, then regresses. Six months later, the AI project is technically still running but practically inert: maintained out of investment inertia rather than operational trust. The problem appears to be solved because a model exists. The actual problem, the data the model relies on, was never addressed.

What messy data actually looks like

Messy data in an industrial context is not usually corrupted or missing. It is structurally incoherent. A historian stores motor current at one-second intervals. A MES system logs production orders at the moment an operator confirms a changeover, which may be ten minutes after the actual transition. An energy meter publishes readings every fifteen minutes. A maintenance system records an intervention when the work order is closed, which may be two days after the physical repair happened.

Each of those datasets is internally consistent. Together, they describe the same production environment from four different perspectives using four different event models and four different time granularities. When a machine learning model receives those datasets without a shared contextual structure, it is presented with thousands of signals that are technically simultaneous but semantically unconnected. An energy spike may appear in proximity to a production order transition and a maintenance intervention and a process parameter deviation, all within the same time window, with no information about which of those events caused which. The model will find correlations. Those correlations will reflect the noise structure of the combined dataset as much as the actual physics of the process.

Why the deeper problem is architectural

The deeper layer beneath failed AI projects is almost always a data architecture that was designed for storage and monitoring rather than for machine-readable event relationships. A raw tag in a historian carries a name and a value. It does not carry the information that would make it analytically meaningful: which asset it belongs to, which process phase was active, which production order was running, which other systems were in which state at that moment. That context exists in the process. It rarely exists in the data.

For a human engineer, that gap is bridgeable through experience. An engineer who knows the plant understands that a current spike on motor tag "CNV_4A" during a changeover from product type B to product type C is structurally different from the same spike during steady-state production of product type A. That knowledge is not in the data. It is in the engineer's head. An algorithm has access only to what is in the data. When the context that distinguishes meaningful signals from noise is not part of the data model, the algorithm is, in a literal sense, working with incomplete information about the system it is supposed to learn.

What changes when data carries context

When industrial data is organized around assets, events, and process context, the nature of what a model receives changes fundamentally. A motor current reading is no longer an anonymous numeric value on a timeline. It is a measurement from a specific conveyor, during a production order running a specific product variant, in a process phase with defined parameters, at a moment when no operator intervention was logged and no maintenance flag was active. The features available to the model are not just the raw signals but the operational circumstances in which those signals occurred.

For data scientists, this means models trained on contextually structured data are more stable across product variants, more interpretable when they produce unexpected results, and more reliable when deployed in production. For plant managers, it means the gap between model output and engineering judgment narrows, because both are working from the same description of the system. AI built on structured industrial data is not necessarily more sophisticated algorithmically. It is more honest about what it knows.

Capture creates that structural foundation by connecting sensor values, production events, asset states, and operational context within a shared data model. When AI applications are built on top of that structure, they are analyzing the behavior of a system rather than searching for patterns in a collection of disconnected signals. That is not a minor improvement in data quality. It is the difference between a model that learns the process and one that learns the noise.

Want to get your reporting straight?