≡ Menu

In yesterday’s post, I examined the methodology behind passer rating. Here were the passer ratings for the 30 quarterbacks who threw enough passes to qualify for the crown in 2016:

RkPlayerTmAttCmpYdsTDIntCmp%Yd/AttTD%INT%Rating
1Matt Ryan*+ATL534373494438769.9%9.267.1%1.3%117.1
2Tom Brady*NWE432291355428267.4%8.236.5%0.5%112.2
3Dak Prescott*DAL459311366723467.8%7.995.0%0.9%104.9
4Aaron Rodgers*GNB610401442840765.7%7.266.6%1.1%104.2
5Drew BreesNOR6734715208371570.0%7.745.5%2.2%101.7
6Sam BradfordMIN552395387720571.6%7.023.6%0.9%99.3
7Kirk CousinsWAS6064064917251267.0%8.114.1%2.0%97.2
8Derek Carr*OAK560357393728663.8%7.035.0%1.1%96.7
9Andrew LuckIND5453464240311363.5%7.785.7%2.4%96.4
10Marcus MariotaTEN451276342626961.2%7.605.8%2.0%95.6
11Ben Roethlisberger*PIT5093283819291364.4%7.505.7%2.6%95.4
12Ryan TannehillMIA3892612995191267.1%7.704.9%3.1%93.5
13Matthew StaffordDET5943884327241065.3%7.284.0%1.7%93.3
14Russell WilsonSEA5463534219211164.7%7.733.8%2.0%92.6
15Andy DaltonCIN563364420618864.7%7.473.2%1.4%91.8
16Alex SmithKAN489328350215867.1%7.163.1%1.6%91.2
17Colin KaepernickSFO331196224116459.2%6.774.8%1.2%90.7
18Tyrod TaylorBUF436269302317661.7%6.933.9%1.4%89.7
19Philip RiversSDG5783494386332160.4%7.595.7%3.6%87.9
20Carson PalmerARI5973644233261461.0%7.094.4%2.3%87.2
21Jameis WinstonTAM5673454090281860.8%7.214.9%3.2%86.1
22Eli ManningNYG5983774027261663.0%6.734.3%2.7%86.0
23Trevor SiemianDEN4862893401181059.5%7.003.7%2.1%84.6
24Joe FlaccoBAL6724364317201564.9%6.423.0%2.2%83.5
25Carson WentzPHI6073793782161462.4%6.232.6%2.3%79.3
26Blake BortlesJAX6253683905231658.9%6.253.7%2.6%78.8
27Case KeenumLAR322196220191160.9%6.842.8%3.4%76.4
28Cam NewtonCAR5102703509191452.9%6.883.7%2.7%75.8
29Brock OsweilerHOU5103012957151659.0%5.802.9%3.1%72.2
30Ryan FitzpatrickNYJ4032282710121756.6%6.723.0%4.2%69.6

Now, as we learned yesterday, passer rating is the result of four variables: completion percentage, yards per attempt, touchdown rate, and interception rate. Those variables are all scaled so that the average score is 1.0 for each variable. Then, we take an average of the four variables and multiply it by 66.67, since that was intended to be the league average passer rating (or, said differently and how it is more commonly represented in formulas, we sum the four numbers, divide by six, and multiply by 100).

So let’s take a look at the scores in each of the four variables for these 30 quarterbacks to better understand their 2016 passer ratings. The far right column shows the average of those variables, which again, is equivalent to their passer rating divided by 66.67.

RkPlayerTmCmp%Yd/AttTD%INT%RatingCmp% VarY/A VarTD% VarINT% VarAverage
1Matt Ryan*+ATL69.9%9.267.1%1.3%117.11.991.561.422.051.76
2Tom Brady*NWE67.4%8.236.5%0.5%112.21.871.311.302.261.68
3Dak Prescott*DAL67.8%7.995.0%0.9%104.91.891.251.002.161.57
4Aaron Rodgers*GNB65.7%7.266.6%1.1%104.21.791.061.312.091.56
5Drew BreesNOR70.0%7.745.5%2.2%101.72.001.181.101.821.53
6Sam BradfordMIN71.6%7.023.6%0.9%99.32.081.010.722.151.49
7Kirk CousinsWAS67.0%8.114.1%2.0%97.21.851.280.831.881.46
8Derek Carr*OAK63.8%7.035.0%1.1%96.71.691.011.002.111.45
9Andrew LuckIND63.5%7.785.7%2.4%96.41.671.191.141.781.45
10Marcus MariotaTEN61.2%7.605.8%2.0%95.61.561.151.151.881.43
11Ben Roethlisberger*PIT64.4%7.505.7%2.6%95.41.721.131.141.741.43
12Ryan TannehillMIA67.1%7.704.9%3.1%93.51.851.170.981.601.40
13Matthew StaffordDET65.3%7.284.0%1.7%93.31.771.070.811.951.40
14Russell WilsonSEA64.7%7.733.8%2.0%92.61.731.180.771.871.39
15Andy DaltonCIN64.7%7.473.2%1.4%91.81.731.120.642.021.38
16Alex SmithKAN67.1%7.163.1%1.6%91.21.851.040.611.971.37
17Colin KaepernickSFO59.2%6.774.8%1.2%90.71.460.940.972.071.36
18Tyrod TaylorBUF61.7%6.933.9%1.4%89.71.580.980.782.031.34
19Philip RiversSDG60.4%7.595.7%3.6%87.91.521.151.141.471.32
20Carson PalmerARI61.0%7.094.4%2.3%87.21.551.020.871.791.31
21Jameis WinstonTAM60.8%7.214.9%3.2%86.11.541.050.991.581.29
22Eli ManningNYG63.0%6.734.3%2.7%86.01.650.930.871.711.29
23Trevor SiemianDEN59.5%7.003.7%2.1%84.61.471.000.741.861.27
24Joe FlaccoBAL64.9%6.423.0%2.2%83.51.740.860.601.821.25
25Carson WentzPHI62.4%6.232.6%2.3%79.31.620.810.531.801.19
26Blake BortlesJAX58.9%6.253.7%2.6%78.81.440.810.741.741.18
27Case KeenumLAR60.9%6.842.8%3.4%76.41.540.960.561.521.15
28Cam NewtonCAR52.9%6.883.7%2.7%75.81.150.970.751.691.14
29Brock OsweilerHOU59.0%5.802.9%3.1%72.21.450.700.591.591.08
30Ryan FitzpatrickNYJ56.6%6.723.0%4.2%69.61.330.930.601.321.04
Average63.4%7.244.4%2.1%91.01.671.060.891.841.37
Minimum52.9%5.802.6%0.5%69.61.150.700.531.321.04
Maximum71.6%9.267.1%4.2%117.12.081.561.422.261.76
Std Dev4.1%0.681.2%0.9%10.90.210.170.240.220.16

For these 30 passers, the average completion percentage is not 1.00, but 1.67; even crazier, the interception rate variable is at 1.84! Touchdown rate is actually worse than it used to be, and checks in here at 0.89, while yards per attempt has stayed the most consistent (1.06). With minimal tweaking, you could solve any era-related issues with touchdown rate and yards per attempt.

No, the real problems are the ever-escalating completion percentage and interception rate variables. Think about it like this: when the formula was created, 5.5% was suppose to represent an average interception rate. Yet in 2016, Ryan Fitzpatrick had the worst rate at 4.2%, and no one else was above 3.6%! How much has the sharp decline in interception rate contributed to the huge increase in passer ratings?

The average passer rating “is supposed to be” 66.67. This year, it was 91.0 for these qualifying passers, which is because the our variables sum to 5.46 (divide by 6, and multiply by 100, and you get 91.0) when they are “supposed to” sum to 4.00. What accounts for that 1.46 in excess value? Well, 58% of that (i.e., 0.84 of the 1.46) is due to the rising interception rate.

So how do we “fix” the interception rate issue prevalent in passer rating? That’s the million dollar question. Because there are many ways to do it. One way is to do what Bryan did. The formula, when designed in 1972, had an expected average INT rate of 5.5%. So the formula, intending to yield an average result of 1.00, became:

2.375 – INT rate (expected = 5.5%) * 25

The 2.375 was reverse engineered, of course, since 0.055 * 25 equals 1.375. You need to get 1.375, on average, in the right side of the formula, and multiplying a player’s interception rate by 25 was a good way to do that when the average interception rate was between five and six.

Now? It’s less than half that. The interception rate was 2.3% last year, so one option for 2016 would be to make the formula this:

2.375 – INT rate * 60

Now if a player has a 2.3% interception rate, this formula will yield a variable of 0.995, which of course is essentially 1.00.

Sounds simple, right? But there are some issues with this. This changes the lower bounds of interception rate: whereas before, the maximum number was 9.5% (the result of 2.375 divided by 25), now the maximum interception rate is 3.96%. That means a passer with an interception rate of 4% is treated the same as one at 7%. Maybe this isn’t a huge issue — on a season-long basis, it only helps Ryan Fitzpatrick — but it is definitely going to be rough around the edges.

Another thing this does — and I’ll leave it to you to decide if it’s a feature or a bug — is that it increases the importance of interceptions. Let’s use Philip Rivers and Carson Palmer as examples. In 2016, Rivers had a passer rating of 87.9, and Palmer had a rating of 87.1. Rivers had the thinnest of edges: his four variables averaged 1.32, while Palmer’s four averaged 1.31.

Rivers had the 2nd worst interception rate (3.6%) in the NFL last year, but as a sign of how out-of-whack the numbers are, Rivers’ 2nd best variable was his interception rate, at 1.47. Palmer had a 2.3% interception rate, which turns into a 1.79 in the passer rating formula. Rivers’ superior edge in yards per attempt and touchdown rate were enough to help him overcome that difference and finish with a better passer rating than Palmer.

ow, what if we use our modified interception rate formula? If we multiply interception rate by 60, not 25, and subtract that result from 2.375? Well, Rivers’ grade would drop from 1.47 to 0.20. That’s pretty stark, although perhaps appropriate given that he had the 2nd-worst rate in the NFL. Palmer? He was just a hair worse than league average, so his grade in this metric would drop from 1.79 to 0.97.

What does that mean for the formula? Keeping everything else constant, Rivers’ four variables would now average to 1.00, while Palmer’s would average to 1.10. So while Rivers had a slight lead in passer rating before, now Palmer would edge him out considerably, 73.5 to 66.7.

So, is that good? It puts more weight on interceptions, but given that interceptions were already valued at -100 in the old formula, I’m not so sure this intuitive era adjustment is the proper way to go about things.

To take another example, Matt Ryan led the NFL in passer rating at 117.1, and he had a 1.3% interception rate with 7 interceptions on 534 attempts. If he had 8 interceptions on 538 attempts, his interception rate would jump to 1.5%, but his passer rating would only drop to 116.3. [1]On 538 attempts, one more interception is worth about 0.002 to a player’s interception rate. In the formula, you multiply that by 25, so the variable would decrease by 0.05. That number would … Continue reading Now, if instead, we used this era-adjusted formula, Ryan’s 2016 passer rating would be 109.5. Give him 8 interceptions instead of 7, though, and his passer rating drops to 107.6. [2]That’s because the 0.002 gets multiplied by 60, and then divided by 6 and multiplied by 100….so a change of about 2 points. This era adjustment makes interceptions 2.4 times more significant than they were before.

What do you guys think?

References

References
1 On 538 attempts, one more interception is worth about 0.002 to a player’s interception rate. In the formula, you multiply that by 25, so the variable would decrease by 0.05. That number would get divided by 6 and multiplied by 100, which is why you get a 0.8 change in his passer rating. In other words, one more interception on ~500 attempts causes a .2% change to the interception rate and a 0.8 change to passer rating.
2 That’s because the 0.002 gets multiplied by 60, and then divided by 6 and multiplied by 100….so a change of about 2 points.
{ 28 comments }