In yesterday’s post, I examined the methodology behind passer rating. Here were the passer ratings for the 30 quarterbacks who threw enough passes to qualify for the crown in 2016:
Rk | Player | Tm | Att | Cmp | Yds | TD | Int | Cmp% | Yd/Att | TD% | INT% | Rating |
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Matt Ryan*+ | ATL | 534 | 373 | 4944 | 38 | 7 | 69.9% | 9.26 | 7.1% | 1.3% | 117.1 |
2 | Tom Brady* | NWE | 432 | 291 | 3554 | 28 | 2 | 67.4% | 8.23 | 6.5% | 0.5% | 112.2 |
3 | Dak Prescott* | DAL | 459 | 311 | 3667 | 23 | 4 | 67.8% | 7.99 | 5.0% | 0.9% | 104.9 |
4 | Aaron Rodgers* | GNB | 610 | 401 | 4428 | 40 | 7 | 65.7% | 7.26 | 6.6% | 1.1% | 104.2 |
5 | Drew Brees | NOR | 673 | 471 | 5208 | 37 | 15 | 70.0% | 7.74 | 5.5% | 2.2% | 101.7 |
6 | Sam Bradford | MIN | 552 | 395 | 3877 | 20 | 5 | 71.6% | 7.02 | 3.6% | 0.9% | 99.3 |
7 | Kirk Cousins | WAS | 606 | 406 | 4917 | 25 | 12 | 67.0% | 8.11 | 4.1% | 2.0% | 97.2 |
8 | Derek Carr* | OAK | 560 | 357 | 3937 | 28 | 6 | 63.8% | 7.03 | 5.0% | 1.1% | 96.7 |
9 | Andrew Luck | IND | 545 | 346 | 4240 | 31 | 13 | 63.5% | 7.78 | 5.7% | 2.4% | 96.4 |
10 | Marcus Mariota | TEN | 451 | 276 | 3426 | 26 | 9 | 61.2% | 7.60 | 5.8% | 2.0% | 95.6 |
11 | Ben Roethlisberger* | PIT | 509 | 328 | 3819 | 29 | 13 | 64.4% | 7.50 | 5.7% | 2.6% | 95.4 |
12 | Ryan Tannehill | MIA | 389 | 261 | 2995 | 19 | 12 | 67.1% | 7.70 | 4.9% | 3.1% | 93.5 |
13 | Matthew Stafford | DET | 594 | 388 | 4327 | 24 | 10 | 65.3% | 7.28 | 4.0% | 1.7% | 93.3 |
14 | Russell Wilson | SEA | 546 | 353 | 4219 | 21 | 11 | 64.7% | 7.73 | 3.8% | 2.0% | 92.6 |
15 | Andy Dalton | CIN | 563 | 364 | 4206 | 18 | 8 | 64.7% | 7.47 | 3.2% | 1.4% | 91.8 |
16 | Alex Smith | KAN | 489 | 328 | 3502 | 15 | 8 | 67.1% | 7.16 | 3.1% | 1.6% | 91.2 |
17 | Colin Kaepernick | SFO | 331 | 196 | 2241 | 16 | 4 | 59.2% | 6.77 | 4.8% | 1.2% | 90.7 |
18 | Tyrod Taylor | BUF | 436 | 269 | 3023 | 17 | 6 | 61.7% | 6.93 | 3.9% | 1.4% | 89.7 |
19 | Philip Rivers | SDG | 578 | 349 | 4386 | 33 | 21 | 60.4% | 7.59 | 5.7% | 3.6% | 87.9 |
20 | Carson Palmer | ARI | 597 | 364 | 4233 | 26 | 14 | 61.0% | 7.09 | 4.4% | 2.3% | 87.2 |
21 | Jameis Winston | TAM | 567 | 345 | 4090 | 28 | 18 | 60.8% | 7.21 | 4.9% | 3.2% | 86.1 |
22 | Eli Manning | NYG | 598 | 377 | 4027 | 26 | 16 | 63.0% | 6.73 | 4.3% | 2.7% | 86.0 |
23 | Trevor Siemian | DEN | 486 | 289 | 3401 | 18 | 10 | 59.5% | 7.00 | 3.7% | 2.1% | 84.6 |
24 | Joe Flacco | BAL | 672 | 436 | 4317 | 20 | 15 | 64.9% | 6.42 | 3.0% | 2.2% | 83.5 |
25 | Carson Wentz | PHI | 607 | 379 | 3782 | 16 | 14 | 62.4% | 6.23 | 2.6% | 2.3% | 79.3 |
26 | Blake Bortles | JAX | 625 | 368 | 3905 | 23 | 16 | 58.9% | 6.25 | 3.7% | 2.6% | 78.8 |
27 | Case Keenum | LAR | 322 | 196 | 2201 | 9 | 11 | 60.9% | 6.84 | 2.8% | 3.4% | 76.4 |
28 | Cam Newton | CAR | 510 | 270 | 3509 | 19 | 14 | 52.9% | 6.88 | 3.7% | 2.7% | 75.8 |
29 | Brock Osweiler | HOU | 510 | 301 | 2957 | 15 | 16 | 59.0% | 5.80 | 2.9% | 3.1% | 72.2 |
30 | Ryan Fitzpatrick | NYJ | 403 | 228 | 2710 | 12 | 17 | 56.6% | 6.72 | 3.0% | 4.2% | 69.6 |
Now, as we learned yesterday, passer rating is the result of four variables: completion percentage, yards per attempt, touchdown rate, and interception rate. Those variables are all scaled so that the average score is 1.0 for each variable. Then, we take an average of the four variables and multiply it by 66.67, since that was intended to be the league average passer rating (or, said differently and how it is more commonly represented in formulas, we sum the four numbers, divide by six, and multiply by 100).
So let’s take a look at the scores in each of the four variables for these 30 quarterbacks to better understand their 2016 passer ratings. The far right column shows the average of those variables, which again, is equivalent to their passer rating divided by 66.67.
Rk | Player | Tm | Cmp% | Yd/Att | TD% | INT% | Rating | Cmp% Var | Y/A Var | TD% Var | INT% Var | Average |
---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Matt Ryan*+ | ATL | 69.9% | 9.26 | 7.1% | 1.3% | 117.1 | 1.99 | 1.56 | 1.42 | 2.05 | 1.76 |
2 | Tom Brady* | NWE | 67.4% | 8.23 | 6.5% | 0.5% | 112.2 | 1.87 | 1.31 | 1.30 | 2.26 | 1.68 |
3 | Dak Prescott* | DAL | 67.8% | 7.99 | 5.0% | 0.9% | 104.9 | 1.89 | 1.25 | 1.00 | 2.16 | 1.57 |
4 | Aaron Rodgers* | GNB | 65.7% | 7.26 | 6.6% | 1.1% | 104.2 | 1.79 | 1.06 | 1.31 | 2.09 | 1.56 |
5 | Drew Brees | NOR | 70.0% | 7.74 | 5.5% | 2.2% | 101.7 | 2.00 | 1.18 | 1.10 | 1.82 | 1.53 |
6 | Sam Bradford | MIN | 71.6% | 7.02 | 3.6% | 0.9% | 99.3 | 2.08 | 1.01 | 0.72 | 2.15 | 1.49 |
7 | Kirk Cousins | WAS | 67.0% | 8.11 | 4.1% | 2.0% | 97.2 | 1.85 | 1.28 | 0.83 | 1.88 | 1.46 |
8 | Derek Carr* | OAK | 63.8% | 7.03 | 5.0% | 1.1% | 96.7 | 1.69 | 1.01 | 1.00 | 2.11 | 1.45 |
9 | Andrew Luck | IND | 63.5% | 7.78 | 5.7% | 2.4% | 96.4 | 1.67 | 1.19 | 1.14 | 1.78 | 1.45 |
10 | Marcus Mariota | TEN | 61.2% | 7.60 | 5.8% | 2.0% | 95.6 | 1.56 | 1.15 | 1.15 | 1.88 | 1.43 |
11 | Ben Roethlisberger* | PIT | 64.4% | 7.50 | 5.7% | 2.6% | 95.4 | 1.72 | 1.13 | 1.14 | 1.74 | 1.43 |
12 | Ryan Tannehill | MIA | 67.1% | 7.70 | 4.9% | 3.1% | 93.5 | 1.85 | 1.17 | 0.98 | 1.60 | 1.40 |
13 | Matthew Stafford | DET | 65.3% | 7.28 | 4.0% | 1.7% | 93.3 | 1.77 | 1.07 | 0.81 | 1.95 | 1.40 |
14 | Russell Wilson | SEA | 64.7% | 7.73 | 3.8% | 2.0% | 92.6 | 1.73 | 1.18 | 0.77 | 1.87 | 1.39 |
15 | Andy Dalton | CIN | 64.7% | 7.47 | 3.2% | 1.4% | 91.8 | 1.73 | 1.12 | 0.64 | 2.02 | 1.38 |
16 | Alex Smith | KAN | 67.1% | 7.16 | 3.1% | 1.6% | 91.2 | 1.85 | 1.04 | 0.61 | 1.97 | 1.37 |
17 | Colin Kaepernick | SFO | 59.2% | 6.77 | 4.8% | 1.2% | 90.7 | 1.46 | 0.94 | 0.97 | 2.07 | 1.36 |
18 | Tyrod Taylor | BUF | 61.7% | 6.93 | 3.9% | 1.4% | 89.7 | 1.58 | 0.98 | 0.78 | 2.03 | 1.34 |
19 | Philip Rivers | SDG | 60.4% | 7.59 | 5.7% | 3.6% | 87.9 | 1.52 | 1.15 | 1.14 | 1.47 | 1.32 |
20 | Carson Palmer | ARI | 61.0% | 7.09 | 4.4% | 2.3% | 87.2 | 1.55 | 1.02 | 0.87 | 1.79 | 1.31 |
21 | Jameis Winston | TAM | 60.8% | 7.21 | 4.9% | 3.2% | 86.1 | 1.54 | 1.05 | 0.99 | 1.58 | 1.29 |
22 | Eli Manning | NYG | 63.0% | 6.73 | 4.3% | 2.7% | 86.0 | 1.65 | 0.93 | 0.87 | 1.71 | 1.29 |
23 | Trevor Siemian | DEN | 59.5% | 7.00 | 3.7% | 2.1% | 84.6 | 1.47 | 1.00 | 0.74 | 1.86 | 1.27 |
24 | Joe Flacco | BAL | 64.9% | 6.42 | 3.0% | 2.2% | 83.5 | 1.74 | 0.86 | 0.60 | 1.82 | 1.25 |
25 | Carson Wentz | PHI | 62.4% | 6.23 | 2.6% | 2.3% | 79.3 | 1.62 | 0.81 | 0.53 | 1.80 | 1.19 |
26 | Blake Bortles | JAX | 58.9% | 6.25 | 3.7% | 2.6% | 78.8 | 1.44 | 0.81 | 0.74 | 1.74 | 1.18 |
27 | Case Keenum | LAR | 60.9% | 6.84 | 2.8% | 3.4% | 76.4 | 1.54 | 0.96 | 0.56 | 1.52 | 1.15 |
28 | Cam Newton | CAR | 52.9% | 6.88 | 3.7% | 2.7% | 75.8 | 1.15 | 0.97 | 0.75 | 1.69 | 1.14 |
29 | Brock Osweiler | HOU | 59.0% | 5.80 | 2.9% | 3.1% | 72.2 | 1.45 | 0.70 | 0.59 | 1.59 | 1.08 |
30 | Ryan Fitzpatrick | NYJ | 56.6% | 6.72 | 3.0% | 4.2% | 69.6 | 1.33 | 0.93 | 0.60 | 1.32 | 1.04 |
Average | 63.4% | 7.24 | 4.4% | 2.1% | 91.0 | 1.67 | 1.06 | 0.89 | 1.84 | 1.37 | ||
Minimum | 52.9% | 5.80 | 2.6% | 0.5% | 69.6 | 1.15 | 0.70 | 0.53 | 1.32 | 1.04 | ||
Maximum | 71.6% | 9.26 | 7.1% | 4.2% | 117.1 | 2.08 | 1.56 | 1.42 | 2.26 | 1.76 | ||
Std Dev | 4.1% | 0.68 | 1.2% | 0.9% | 10.9 | 0.21 | 0.17 | 0.24 | 0.22 | 0.16 |
For these 30 passers, the average completion percentage is not 1.00, but 1.67; even crazier, the interception rate variable is at 1.84! Touchdown rate is actually worse than it used to be, and checks in here at 0.89, while yards per attempt has stayed the most consistent (1.06). With minimal tweaking, you could solve any era-related issues with touchdown rate and yards per attempt.
No, the real problems are the ever-escalating completion percentage and interception rate variables. Think about it like this: when the formula was created, 5.5% was suppose to represent an average interception rate. Yet in 2016, Ryan Fitzpatrick had the worst rate at 4.2%, and no one else was above 3.6%! How much has the sharp decline in interception rate contributed to the huge increase in passer ratings?
The average passer rating “is supposed to be” 66.67. This year, it was 91.0 for these qualifying passers, which is because the our variables sum to 5.46 (divide by 6, and multiply by 100, and you get 91.0) when they are “supposed to” sum to 4.00. What accounts for that 1.46 in excess value? Well, 58% of that (i.e., 0.84 of the 1.46) is due to the rising interception rate.
So how do we “fix” the interception rate issue prevalent in passer rating? That’s the million dollar question. Because there are many ways to do it. One way is to do what Bryan did. The formula, when designed in 1972, had an expected average INT rate of 5.5%. So the formula, intending to yield an average result of 1.00, became:
2.375 – INT rate (expected = 5.5%) * 25
The 2.375 was reverse engineered, of course, since 0.055 * 25 equals 1.375. You need to get 1.375, on average, in the right side of the formula, and multiplying a player’s interception rate by 25 was a good way to do that when the average interception rate was between five and six.
Now? It’s less than half that. The interception rate was 2.3% last year, so one option for 2016 would be to make the formula this:
2.375 – INT rate * 60
Now if a player has a 2.3% interception rate, this formula will yield a variable of 0.995, which of course is essentially 1.00.
Sounds simple, right? But there are some issues with this. This changes the lower bounds of interception rate: whereas before, the maximum number was 9.5% (the result of 2.375 divided by 25), now the maximum interception rate is 3.96%. That means a passer with an interception rate of 4% is treated the same as one at 7%. Maybe this isn’t a huge issue — on a season-long basis, it only helps Ryan Fitzpatrick — but it is definitely going to be rough around the edges.
Another thing this does — and I’ll leave it to you to decide if it’s a feature or a bug — is that it increases the importance of interceptions. Let’s use Philip Rivers and Carson Palmer as examples. In 2016, Rivers had a passer rating of 87.9, and Palmer had a rating of 87.1. Rivers had the thinnest of edges: his four variables averaged 1.32, while Palmer’s four averaged 1.31.
Rivers had the 2nd worst interception rate (3.6%) in the NFL last year, but as a sign of how out-of-whack the numbers are, Rivers’ 2nd best variable was his interception rate, at 1.47. Palmer had a 2.3% interception rate, which turns into a 1.79 in the passer rating formula. Rivers’ superior edge in yards per attempt and touchdown rate were enough to help him overcome that difference and finish with a better passer rating than Palmer.
ow, what if we use our modified interception rate formula? If we multiply interception rate by 60, not 25, and subtract that result from 2.375? Well, Rivers’ grade would drop from 1.47 to 0.20. That’s pretty stark, although perhaps appropriate given that he had the 2nd-worst rate in the NFL. Palmer? He was just a hair worse than league average, so his grade in this metric would drop from 1.79 to 0.97.
What does that mean for the formula? Keeping everything else constant, Rivers’ four variables would now average to 1.00, while Palmer’s would average to 1.10. So while Rivers had a slight lead in passer rating before, now Palmer would edge him out considerably, 73.5 to 66.7.
So, is that good? It puts more weight on interceptions, but given that interceptions were already valued at -100 in the old formula, I’m not so sure this intuitive era adjustment is the proper way to go about things.
To take another example, Matt Ryan led the NFL in passer rating at 117.1, and he had a 1.3% interception rate with 7 interceptions on 534 attempts. If he had 8 interceptions on 538 attempts, his interception rate would jump to 1.5%, but his passer rating would only drop to 116.3. [1]On 538 attempts, one more interception is worth about 0.002 to a player’s interception rate. In the formula, you multiply that by 25, so the variable would decrease by 0.05. That number would … Continue reading Now, if instead, we used this era-adjusted formula, Ryan’s 2016 passer rating would be 109.5. Give him 8 interceptions instead of 7, though, and his passer rating drops to 107.6. [2]That’s because the 0.002 gets multiplied by 60, and then divided by 6 and multiplied by 100….so a change of about 2 points. This era adjustment makes interceptions 2.4 times more significant than they were before.
What do you guys think?
References
↑1 | On 538 attempts, one more interception is worth about 0.002 to a player’s interception rate. In the formula, you multiply that by 25, so the variable would decrease by 0.05. That number would get divided by 6 and multiplied by 100, which is why you get a 0.8 change in his passer rating. In other words, one more interception on ~500 attempts causes a .2% change to the interception rate and a 0.8 change to passer rating. |
---|---|
↑2 | That’s because the 0.002 gets multiplied by 60, and then divided by 6 and multiplied by 100….so a change of about 2 points. |