Objective Tracking of Calibration Model Quality

In the petroleum industry, this approach is applied at scale. Facilities often monitor dozens or even hundreds of predictive models simultaneously, such as summer, winter, and all-season fuel grades. In this example, 27 models (a 9×3 grid) are tracked, though some refineries monitor more than 300. The system works with any optical instrument and with any chemometrics assessment software.

ASTM D6122 provides sample-specific guidelines for evaluating these models. Rather than relying on simple fixed limits, it defines dynamic, sample-specific thresholds. When samples fall outside these limits, Ai-Metrix can kick in to supply an updated model in minutes.

Different visual indicators convey different issues:

  • Yellow triangles represent samples that are statistically in control but unusual for the model. These are often good candidates for inclusion to improve model robustness.
  • Red squares indicate that model diagnostics are acceptable, but the predicted value does not match laboratory results—typically signaling a laboratory error.
  • X markers show both diagnostic failures and unusual samples, indicating a true system failure that requires intervention.

Although the ASTM calculations are complex, they are well-suited for automated computation. Once implemented, users can quickly drill into individual samples to examine diagnostics, model predictions, and laboratory values. This allows identification of discrepancies where the system is stable, but results are out of specification, often revealing process or lab issues rather than model faults.

By compressing large volumes of historical data into actionable metrics and applying these models in real time, organizations can distinguish false positives, detect procedural problems, and better understand the sources of disagreement between manufacturing and laboratory measurements.

ASTM’s work is notable because it formally codifies how to evaluate model performance—something that had not been standardized before. While adoption has been strongest in refining, these methods are largely unknown in pharmaceuticals, chemicals, and food manufacturing.

With real-time feedback and rapid model updates, these systems enable smarter, more adaptive manufacturing. This is where machine learning and AI naturally fit: not as replacements, but as practical overlays that enhance existing workflows and produce outputs that can support regulatory discussions.

Learn more about Ai-Metrix automation. Contact us at info@infometrix.com for a demo.

Quality Assurance with Ai-Metrix Automated Model Validation

Ai-Metrix Automated Model ValidationAi-Metrix®now offers a fully automated model validation framework, combining real-time tracking with powerful diagnostics based on ASTM D6122 and comprehensive Nelson Rule monitoring. Designed to support high-stakes environments like gasoline blending, this feature ensures your predictive models remain accurate, reliable, and audit-ready as new data flows in.

🎯Smarter Monitoring Starts Here
As your team uploads fresh data to the Ai-Metrix server, our system continuously evaluates model performance using robust statistical tools. A streamlined dashboard gives you instant visibility:

✅ Visual Control Charts – Instantly identify anomalies with trend plots showing ±1, 2, and 3 standard deviations.
✅ Advanced Rule Integration – Choose from Nelson Rules or ASTM D6122 checks to detect early signs of model drift or calibration issues.
✅ Dynamic Model Grid – See all active models at a glance, organized by product grade and property. Click to dive deeper into sample counts and validation metrics.
✅ Flexible Metric Selection – Monitor predicted values, residuals, F-ratios, or Mahalanobis distance to match your validation strategy.
✅ Rule Violations Trigger – Violations can trigger an email to a distribution list for action.

🎯Why It Matters
→ Regulatory Alignment – ASTM D6122 compliance, built-in.
→ Hands-Free Oversight – Continuous, automated validation as data is collected.
→ Proactive Alerts – Catch issues before they affect process quality.
→ Complete Transparency – From calibration sample size to rule violations, everything is traceable and actionable.
→ Real time updates – With the Ai-Metrix calibration power, model updates are available in real time to move the system back into compliance.

🎯Confidence in your models isn’t optional—it’s critical.
Ai-Metrix delivers a smarter, automated approach to model validation that helps your team maintain compliance, ensure process integrity, and make better decisions, faster. Explore the new validation dashboard today and take control of your model quality.

Book a quick demo and see how Ai-Metrix can elevate your operations. info@infometrix.com

“Quality is never an accident. It is always the result of intelligent effort.”
– John Ruskin, English writer (1819-1900)

Analytically Speaking Podcast Ep. 33 – Automating Chemometrics for Expert Calibration System

Analytically Speaking Podcast Ep. 33 Host Dr. Jerry Workman speaks with Dr. Brian G. Rohrback to discuss to his research and experience in automating the process of building multivariate calibrations.

Enjoy the podcast. For more information and further conversation, contact us at info@infometrix.com.

Click to access Analytically Speaking Podcast Ep.33

 

Automating the Optimization of Locally Weighted Models is a Solution

Automation of Local Regression Model Building for Spectroscopic Data, JChem2024 Pell et alA calibration model tends to improve as additional calibration samples are added to the library. If the samples reflect variation in the chemical composition, the model then expands its zone of relevance. Ultimately, as these new zones expand calibration scope, the model can degrade in performance due to nonlinearities and may require adding to the model rank, which can make the model fragile. Building local models is one answer to gain the best of both worlds, but optimizing a locally weighted model is tricky and time consuming. Automating the optimization of locally weighted models is a solution.

http://doi.org/10.1002/cem.3637

For additional information or questions, contact info@infometrix.com.

#chemometrics #LWR #spectroscopy #regression

IFPAC 2025 – Save the Date

IFPAC 2025
Date: March 2-5, 2025
Venue:  Washington, D.C.
website: www.ifpacglobal.org

If you are interested in keeping abreast of the interactions of chemometrics, analytical instrumentation, and data processing (particularly as it relates to the bio and pharma world) this is the place to go.

If you have an interesting application in chemometrics, machine learning, or information architecture, contact us at info@infometrix.com.