1. Pull PO and shipment data from the ERP. NetSuite, Fulfil, or whichever ERP holds the order record. PO number, supplier, line items, expected and actual delivery dates.
2. Parse the delivery confirmations. Emails and PDF reports from suppliers and carriers. The AI step extracts confirmed dates, quantities, and any deviation reasons.
3. Match against the PO. Tie each confirmation back to the right PO line by number, then compare expected versus actual.
4. Calculate the metrics. On-time rate, in-full rate, OTIF rate, average days late, quantity variance, fill rate. Per vendor, per category, per period.
5. Score against thresholds. Apply your tier logic. Above 95% is green, 90 to 95 is yellow, below 90 is red. Whatever the procurement team uses.
6. Build the scorecard report. One row per vendor with the score, the underlying metrics, and the trend versus the prior period.
7. Send the package. PDF or sheet to procurement, exception list for the buyer review, and an alert when a key vendor crosses a threshold.