Model Performance Overview

How the Model Works

This college football prediction model is built on math, statistics, and play-by-play analytics. For every game, it runs thousands of Monte Carlo simulations using only its own database. It has no knowledge of Vegas lines, expert picks, human perception, injuries, weather, or late roster changes. All of which a human or professional may have, which should provide an advantage over the model.

Performance Against the Spread (ATS)

The model consistently beats the 50% critical threshold for picking games against the spread (ATS). Here are some highlights:

2023: 51.5% ATS accuracy (All Games)
2024: 53.2% ATS accuracy (All Games)
Average ATS accuracy (All Games): 52.4%
Average ATS accuracy (Power 5): 54.2%

Beating the “coin flip” line (50% ATS) over hundreds of games, without any market or human input, shows real predictive power.

Winner Accuracy

The model also does well at picking outright winners:

Average winner accuracy (All Games): 68.5% (Vegas: 71.2%)
Average winner accuracy (Power 5): 65.9% (Vegas: 67.5%)

Win Probability Calibration

The model's confidence is insightful, especially for high-probability predictions. Here's how often the model was correct in each win probability bracket:

Win Probability BracketAccuracy
50-60%53.7% (246/458)
60-70%63.1% (252/399)
70-80%75.5% (262/347)
80-90%79.8% (174/218)
90-100%93.2% (153/164)

Cover Probability Calibration

The model's confidence in covering the spread does not strongly correlate with actual results. Although it still hits over 50%, increased confidence does not appear to be meaningful.

Cover Probability BracketAccuracy
50-60%52.8% (316/598)
60-75%49.1% (323/658)
75-100%53.6% (177/330)