You’re probably hearing a lot right now about how Matt Schaub is not a primetime player — literally. Schaub and the Texans struggled in embarassing losses on Sunday Night Football to the Packers earlier in the season and on Monday Night Football two days ago to the Patriots. Schaub posted terrible numbers in a defensively-driven 13-6 win over the Jay Cutler/Jason Campbell Bears.

For his career, Schaub is 2-5 (0.286 winning percentage) in night games and 41-31 (0.569) in day games. Among the 24 quarterbacks studied (more on that below), that drop in winning percentage is the largest such decline. You might think this is due to facing better defenses in night games, but that’s not really the case.

Schaub has averaged 7.8 Adjusted Yards per Attempt during day games and 6.0 AY/A during night games; that difference of 1.8 AY/A is the second largest among the twenty-four quarterbacks.

So yes, there is no debate: Schaub has been noticeably worse during night games in his career.

The table below shows all quarterbacks who have started a game this season and that have started at least five night games in their career. The data consist of all games throughout their career in which they were the starter. To make it a little easier to read, I’ve shaded the day and night categories differently:

QB	D_W/L	D_WIN%	D_Y/A	D_AY/A	N_W/L	N_WIN%	N_Y/A	N_AY/A	Y/A_DIFF	AY/A_DIFF	Win%_Diff
Jason Campbell	28-31	0.475	6.93	6.65	3-9	0.25	5.75	4.77	-1.18	-1.88	-0.225
Matt Schaub	41-31	0.569	7.93	7.79	2-5	0.286	6.94	6	-0.99	-1.79	-0.284
Jay Cutler	37-28	0.569	7.3	6.84	13-14	0.481	7.1	6.08	-0.2	-0.76	-0.088
Joe Flacco	46-21	0.687	7.11	6.9	12-7	0.632	6.64	6.19	-0.47	-0.71	-0.055
Ben Roethlisberger	67-27	0.713	7.94	7.79	29-14	0.674	7.85	7.14	-0.09	-0.65	-0.038
Matt Ryan	47-19	0.712	7.19	7.03	7-5	0.583	6.63	6.4	-0.56	-0.63	-0.129
Carson Palmer	48-58	0.453	7.25	6.74	5-10	0.333	6.55	6.27	-0.7	-0.47	-0.119
Matt Cassel	25-29	0.463	6.59	6.11	4-5	0.444	6.35	5.65	-0.24	-0.46	-0.019
Matt Hasselbeck	75-72	0.51	6.88	6.42	10-6	0.625	6.9	6.22	0.02	-0.2	0.115
Aaron Rodgers	40-20	0.667	8.21	8.68	14-7	0.667	8	8.49	-0.21	-0.19	0
Alex Smith	31-32	0.492	6.61	6.07	8-5	0.615	6.32	5.91	-0.29	-0.16	0.123
Sam Bradford	13-20	0.397	6.21	5.79	1-4	0.2	6.33	5.71	0.12	-0.08	-0.197
Michael Vick	43-38	0.53	6.97	6.55	15-8	0.652	7.06	6.52	0.09	-0.03	0.122
Mark Sanchez	29-20	0.592	6.64	5.82	8-9	0.471	6.42	5.83	-0.22	0.01	-0.121
Tony Romo	35-27	0.565	7.7	7.67	20-12	0.625	8.17	7.74	0.47	0.07	0.06
Eli Manning	61-39	0.61	7.13	6.54	24-19	0.558	6.96	6.68	-0.17	0.14	-0.052
Matthew Stafford	16-21	0.432	6.87	6.51	1-5	0.167	7.47	6.9	0.6	0.39	-0.266
Peyton Manning	120-62	0.659	7.58	7.39	40-18	0.69	7.7	7.79	0.12	0.4	0.03
Tom Brady	112-30	0.789	7.39	7.49	38-14	0.731	7.55	7.9	0.16	0.41	-0.058
Byron Leftwich	21-24	0.467	6.51	6	3-3	0.5	6.65	6.47	0.14	0.47	0.033
Philip Rivers	51-35	0.593	7.8	7.53	20-10	0.667	8.1	8.13	0.3	0.6	0.074
Drew Brees	79-62	0.56	7.39	7.18	23-11	0.676	7.7	7.84	0.31	0.66	0.116
Charlie Batch	16-27	0.372	6.72	5.78	9-3	0.75	7.73	8.22	1.01	2.44	0.378
Chad Henne	12-17	0.414	6.3	5.17	2-3	0.4	8.05	7.81	1.75	2.64	-0.014

There is a simple explanation of why Schaub has played poorly at night. It’s because his real name is Choker McChoker. At least, that’s one way of looking at the data. Here’s another. Schaub has started 79 games in his career. Over those 79 starts, he has averaged an AY/A of 7.6 and has a standard deviation of 3.0. Therefore, there is a 30% chance that, purely by chance, over a random 7-start sample his AY/A would be 6.0 or worse.

But let’s say you hate math. Consider: there are 24 quarterbacks on the above list. Considering the large number of quarterbacks and the small number of night games, there was an excellent change that somebody was going to look like the captain of Choketown, USA.

Longtime readers will make the connection between this post and two of my favorites posts of all-time. In Splits Happen, I explained how if you look hard enough, it’s very easy to find crazy splits. For example, in 2011, Reggie Wayne had nearly twice as many fantasy points per game against teams that had blue in their uniforms. There are an endless number of silly splits you could find. I concluded with the line:

Despite what our brain tells us, there need not always be an explanation for a crazy split. Sometimes, splits happen.

We see Schaub’s nighttime/daytime splits, and think there must be an explanation. But that’s not the case. Sometimes, splits happen.

In “What Are the Odds of That?” — my favorite post ever — I looked at an obscure Jacoby Jones “stat.” In 2011, Jones gained three times as many receiving yards against teams at the back end of the alphabet as he did against the teams he faced in the front of the alphabet. Then I asked, “what are the odds of that?”

This is a very good reason why it’s often inappropriate to apply standard significance tests to football statistics. Surely Jones’ splits would pass any standard significance test, signaling that his wild split was in fact “real” even though we know it wasn’t. With a large enough sample, you would expect to have false positives, which isn’t a knock on standard significant testing. If something is statistically significant at the 1% level, that doesn’t mean you shouldn’t expect to see a false positive if you have 100 different samples…
…
Some in the statistical community refer to this as the Wyatt Earp Effect. You’ve undoubtedly heard of Wyatt Earp, who is famous precisely because he survived a large number of duels. What are the odds of that? Well, it depends on your perspective. The odds that one person would survive a large number of duels? Given enough time, it becomes a statistical certainty that someone would do just that. Think back to the famous Warren Buffett debate on the efficient market hypothesis. Suppose that 225 million Americans partake in a single elimination national coin-flipping contest, with one coin flip per day. After 20 days, we would expect 215 people to successfully call their coin flips 20 times out of 20. But that doesn’t mean those 215 people are any better at calling coins than you or I am. The Wyatt Earp Effect, the National Coin Flipping Example, and my Splits Happen post all illustrate the same principle. Asking “what are the odds of that?” is often meaningless in retrospect. If you look at enough things, enough players’ splits, enough 4th quarter comeback opportunities, enough coin flips, or enough roulette wheel spins, you will see some things that seem absurdly unlikely.

And if you look hard enough, you will find a split where Matt Schaub, or any other quarterback, performs poorly. Of course, that’s just my perspective. Like all things, the conclusion rests in the mind of the reader. If you’re the type of person who was inclined to believe that Schaub was the incorporator of Chokers ‘R’ Us, Inc., well, I doubt this post is going to change your mind.