Which Fantasy Experts Like to Gamble?

by dave
Dec 29, 2011

I’m not going to lie, I like gambling (legally, of course). I just returned from a birthday weekend in Vegas and I’ll be heading back to Sin City in a couple weeks for a fantasy sports conference (to give out our accuracy awards, and to give back the money I took from Caesars). For me, not much beats the thrill of putting money down on a 37-1 long-shot…and hitting.
The same holds true for fantasy football. I’ve been known to get a little cute with my start/sit decisions just to be able to say I started the right guy when everyone told me to start the other guy. I also usually keep a list of my preseason bold predictions so I can shove it in my league’s face if a few of them come true. Yep, I’m that guy.
Hitting and missing on bold predictions and sleeper starts got me thinking about how an expert’s accuracy score relates to his tendency to “gamble” with player rankings that don’t conform to the consensus opinion. To help analyze this, we’ve come up with a measurement called ARD (Average Rank Deviation). ARD measures how different an expert’s rankings are compared to our ECR (Expert Consensus Ranking). ARD’s calculation is described in more detail at the end of this post.
A number of you have asked us to share how accurate our ECR is. We’ve checked in on this a few times, most recently in this guest post at The New York Times. Bottom line is that our consensus rankings are very accurate. ECR has a way of minimizing the impact of individual rogue predictions that may be as brutal as they are bold.
Since ECR tends to be accurate, it’s logical to assume that experts whose rankings closely resemble ECR would have relatively higher accuracy as well. Based on the data below that compares ARD to PAY (Prediction Accuracy Yield) for each expert, there is indeed a strong correlation. The higher your ARD is, the lower your PAY tends to be. In other words, the more you gamble the less accurate you are.

Each dot in the scatter chart represents an expert. The cluster in the bottom right corner (high deviation; low accuracy) is made up of primarily computer based projection sites. It’s nice to know the humans beat out the computers for a change!
While the data shows an overall inverse relationship between ARD and PAY, we should keep in mind that there’s very little difference in accuracy scores among the top experts. We’ll be reporting on the winner of our Most Accurate Expert competition very shortly; it’s amazing how razor thin the difference is between a large number of experts. Which begs the question, of the experts with higher than average ARD, which of them score the highest for accuracy?
Experts with 61% PAY or better through week 15 that have higher than average ARD:
Sigmund Bloom – FootballGuys | ARD: 4.38 | PAY: 61.9%
Alessandro Miglio – ProFootballFocus | ARD: 3.75 | PAY: 61.0%
Brad Evans – Yahoo! Sports | ARD: 3.59 | PAY: 61.1%
Staff Rankings – FFToolbox | ARD: 3.56 | PAY: 62.1%
Here are the ARDs for experts with at least 14 weeks of tracked rankings. The experts at the top of the list tend to agree with our ECR the most. The experts at the bottom of the list tend to disagree with our ECR the most. Each expert’s PAY through week 15 is included as a reference point. The average ARD from this group of experts is 3.5 and the median is 3.2.
Scroll down to see the experts that like to gamble the most.

I should note that “gambling” may not be the best term to use since an expert’s player rankings reflect his own opinion (perhaps not a gamble in his eye). If the expert tends to disagree with our consensus, I’m classifying it as a gamble on his part, even if it’s not something he’s consciously trying to do.
ARD’s calculation is pretty straightforward. We compare where each expert ranks a player vs. where that player is ranked in our ECR. We take the absolute value of this rank difference and sum it across the minimum ranks we require at each position (e.g. top 40 RBs). We then divide the sum by the total rank spots (40 for RB), and average this number across the four main positions (QB, RB, WR & TE). The resulting number is the Average Rank Deviation. The larger an expert’s ARD, the greater the difference between his weekly player rankings and our ECR. An ARD of zero would mean that the expert’s rankings are identical to our ECR.
This was probably pretty interesting data to a few of you and not-so-interesting to a lot of you. What I’m excited about is that we’re just scratching the surface of what can be done with the mountain of data we’re collecting. Once we dive even deeper into rank and accuracy deviations for specific players, I’m confident we’ll find some very useful data on things like over and under valued players, experts that tend to have certain players pegged better than others, and an objective way to measure “sleeper accuracy” across experts.
It’s a good thing we have an off-season to crunch the numbers. Stay tuned…

What's your take? Leave a comment

Fantasy Games
FanDuel photo
Win your first contest
Or we'll credit your entry fee
DRAFT photo
Get a free best ball entry with your 1st deposit!
CBS Sports photo
Serious Fantasy Football
1David Johnson (ARI)RB
2Le'Veon Bell (PIT)RB
3Antonio Brown (PIT)WR
4Julio Jones (ATL)WR
5Odell Beckham Jr. (NYG)WR
6LeSean McCoy (BUF)RB
7Melvin Gordon (LAC)RB
8Mike Evans (TB)WR
9A.J. Green (CIN)WR
10Devonta Freeman (ATL)RB
 View All Rankings 
11Jordy Nelson (GB)WR
12Jay Ajayi (MIA)RB
13Jordan Howard (CHI)RB
14DeMarco Murray (TEN)RB
15Michael Thomas (NO)WR
16Dez Bryant (DAL)WR
17Todd Gurley (LAR)RB
18T.Y. Hilton (IND)WR
19Amari Cooper (OAK)WR
20Leonard Fournette (JAC)RB
21Ezekiel Elliott (DAL)RB
22Doug Baldwin (SEA)WR
23Rob Gronkowski (NE)TE
24Isaiah Crowell (CLE)RB
25Lamar Miller (HOU)RB
26Brandin Cooks (NE)WR
27DeAndre Hopkins (HOU)WR
28Demaryius Thomas (DEN)WR
29Marshawn Lynch (OAK)RB
30Carlos Hyde (SF)RB
1Mike Trout (LAA)CF,DH
2Paul Goldschmidt (ARI)1B
3Jose Altuve (HOU)2B
4Nolan Arenado (COL)3B
5Charlie Blackmon (COL)CF
6Chris Sale (BOS)SP
7Max Scherzer (WSH)SP
8Giancarlo Stanton (MIA)RF
9Joey Votto (CIN)1B
10Kris Bryant (CHC)1B,3B
 View All Rankings 
11Manny Machado (BAL)3B,SS
12Mookie Betts (BOS)RF
13Corey Kluber (CLE)SP
14Freddie Freeman (ATL)1B,3B
15Corey Seager (LAD)SS
16Anthony Rizzo (CHC)1B,2B
17George Springer (HOU)CF,RF
18Nelson Cruz (SEA)RF,DH
19Francisco Lindor (CLE)SS
20Daniel Murphy (WSH)1B,2B
21Clayton Kershaw (LAD)SP
22J.D. Martinez (ARI)RF
23Edwin Encarnacion (CLE)1B,DH
24Aaron Judge (NYY)RF,DH
25Jose Abreu (CWS)1B,DH
26Robinson Cano (SEA)2B
27Cody Bellinger (LAD)1B,LF
28Jose Ramirez (CLE)2B,3B
29Yu Darvish (LAD)SP
30Miguel Cabrera (DET)1B,DH
1Russell Westbrook (OKC)PG
2James Harden (HOU)PG,SG
3Stephen Curry (GSW)PG,SG
4Kevin Durant (GSW)SF,PF
5Karl-Anthony Towns (MIN)C
6Anthony Davis (NOR)PF,C
7LeBron James (CLE)SF,PF
8Chris Paul (HOU)PG
9Kawhi Leonard (SAS)SG,SF
10DeMarcus Cousins (NOR)PF,C
 View All Rankings 
11Giannis Antetokounmpo (MIL)PG,SG
12Paul George (OKC)SF,PF
13Hassan Whiteside (MIA)C,PF
14Damian Lillard (POR)PG
15John Wall (WAS)PG
16Kyle Lowry (TOR)PG
17Paul Millsap (DEN)PF,C
18Jimmy Butler (MIN)SG,SF
19Draymond Green (GSW)SF,PF
20Kemba Walker (CHA)PG
21Kyrie Irving (BOS)PG,SG
22Al Horford (BOS)PF,C
23Victor Oladipo (IND)PG,SG
24Isaiah Thomas (CLE)PG
25C.J. McCollum (POR)PG,SG
26LaMarcus Aldridge (SAS)PF,C
27Brook Lopez (LAL)C
28Klay Thompson (GSW)SG,SF
29Kristaps Porzingis (NYK)PF,C
30Carmelo Anthony (NYK)SF,PF