Reduced error detection time by 90% with a custom AI model

Logistics & Transportation
Machine Learning
Consulting
LLM
Product Strategy
Enterprise

Amerit Fleet is an enterprise fleet maintenance and repair provider

Amerit Fleet is one of the country's largest trucking fleet repair services. Every day, their mechanics complete a few thousand maintenance jobs on delivery trucks for retailers and companies across the U.S., working across 15,000 separate repair codes. A team of a few dozen quality control people manually reviews each work order to catch incorrect billings, wrong part numbers, false readings, and forgotten repairs. The company needed an automated system to flag errors before they became billing problems, and they needed outside AI expertise to build it.

90% faster detection  
30% auto-resolved orders
10x ROI 
1,000+ orders auto-categorized

What we delivered

Custom ML Model

Built a machine learning model to predict errors in repair orders and flag high-risk records for review.

Real-time Reasoning

Added a reasoning system that gives mechanics human-readable explanations for each flagged error.

Error Prioritization

Automatically identified and prioritized the most error-prone records for the quality team.

Modern Data Pipeline

Built ETL with daily snapshots to create labeled training data from 300,000+ mechanic comments.

challenges

Amerit Fleet faced three main challenges

A high volume of repair orders with inconsistent data made manual error checking slow and unreliable, and the first AI model could flag problems but could not explain them.

No data pipeline or version history

Modern ETL processes did not exist. All data sat in a single SQL database with no version history. Records were overwritten on update, making it impossible to track changes or build a reliable training dataset from historical repair orders.

Data quality errors from mechanics

Mechanics sometimes forgot to add comments or logged abnormal hours. Others included incorrect parts to simplify billing. Imagine seeing an oil change billed, but the parts list including brake pads and wiper fluid. Each incorrect entry adds unnecessary labor and parts costs for Amerit.

Poor prioritization of quality reviews

Without model-driven insights, the quality team could only prioritize work orders by time since repair. They had no way to weigh repair value, mistake cost, or error likelihood, so high-impact issues sat in the same queue as low-risk ones.

How we solved it

NineTwoThree validated with a POC, then built a two-phase ML error detection system

NineTwoThree approached the problem in two phases: first predicting which repair orders had errors, then explaining why those errors occurred so mechanics could fix them fast.

Phase 1: Machine learning error prediction

A POC on 300,000+ mechanic comments validated the approach without infrastructure spend. NineTwoThree then built a data pipeline with daily snapshots and QC-labeled training data, using gradient boosting (CatBoost) instead of generative AI.

90%
reduction in average error detection time
CatBoost is a fast, scalable, high performance gradient boosting on decision trees library. Used for ranking, classification, regression and other ML tasks.

Phase 2: Real-time reasoning system

The model predicts zero errors vs any errors, reaching 66% and 72% accuracy respectively. We added a real-time reasoning system that generates human-readable explanations for each flagged error. Mechanics can now see why a record was flagged and what corrective action to take, without needing to investigate from scratch.

30%
of work orders auto-classified without manual review
Flowchart illustrating data processing: Amerit Data (Azure Blob Container) and Pretrained Model (Azure Blob Container) inputs feed into ML Prediction App (Azure App Container), which outputs to Prediction Storage (Azure Table).

Process improvements: prioritization and auto-categorization

Instead of reviewing repair orders first-in-first-out, the model ranks them by cost-weighted risk and auto-clears the safe ones, so review capacity goes to the records most likely to be wrong.

1,000+
repair orders auto-categorized as low-risk
Flowchart showing four repair orders with amounts $120, $8,450, $230, and $12,700 processed through an ML Risk Model (Azure App Container). The model assigns risk scores (Azure Table). Orders are ranked by risk: two high-risk orders ($12,700 and $8,450) are flagged for human review, and two low-risk orders ($230 and $120) are auto-cleared as safe.

What Amerit Fleet gained from partnering with us

90% reduction in error detection time

The ML model reduced the average time to detect errors in repair orders by 90%. The quality team now identifies and addresses issues across a few thousand daily work orders far faster than manual review allowed.

Explanations, not just flags

Mechanics no longer get a bare risk score. SHAP values and Z-score analysis explain what is off: an anomaly in parts or labor cost, and the specific areas worth checking. A flagged order arrives with a starting point, not a question.

Review capacity aimed at real risk

The model's cost-benefit logic flagged 1,000+ repair orders as safe to skip manual review. Only 6 errors were missed in that batch, costing less than investigating all of them. The quality team now focuses on high-impact cases instead of reviewing every order.

10x return on investment

Amerit saves at least six figures annually and dozens of hours of labor each day. The recurring commitment is measured in tens of thousands of dollars, instead of paying a team of data scientists seven figures to maintain a comparable system.

“The 923 team was fantastic to work with and taught me a lot about ML and AI.”

NineTwoThree delivered a quality check API that helped the client reduce the time spent reviewing orders by the quality team. The team provided timely items, responded well to needs, took action against potential blockers, and shared constant updates on the progress and results of their work.

Jack Flora

Jack Flora

Product Manager at Amerit Fleet Solutions

case studies

Similar case studies

Doubled revenue with ML route sequencing for millions of packages

Arrow Right

Modernized a supply chain portal and boosted user satisfaction

Arrow Right

Streamlined fleet communication with a dashboard app

Arrow Right
Contact us

Ready to become an AI-first company? Let’s connect.

Build a new platform, or add AI capabilities to existing software, we deliver solutions that work in real operational environments.

  • Meet with founders Andrew Amann & Pavel Kirillov

    founders
  • Custom AI implementation roadmap

  • No sales pressure

This site is protected by reCAPTCHA