Matthew Berry vs. David Dodds – Who gives better fantasy advice?

by dave
Aug 24, 2010

A Heads-up comparison of two heavyweights from ESPN and FootballGuys

Well, if you’ve been studying our accuracy scores, the answer is obvious. After slugging it out over 16 weeks in 2009, David Dodds beat out Matthew Berry in the key categories of RB, WR, QB, and TE accuracy. They split on DST and K, but this is the last time I’ll ever mention the word kicker in the first paragraph of a fantasy football post.

Here’s how high their PAY™ (Prediction Accuracy Yield) was for the four key positions in 2009:

[table id=7 /]

So why am I bringing up something that can be easily found on our Accuracy Scores page? Am I just taking a cheap shot at Mr. Berry because he’s the most well know fantasy football expert? Or am I secretly on the FootballGuys payroll? Neither.  OK, a little of the first (people like reading about Matthew Berry), and none of the second (although I’m open to free subscription offers).

I’m bringing up a specific example of two experts because I think it helps illustrate the foundation of how we do our accuracy assessments. A surprising number of people have actually taken the time to read about our methodology, so this seems to be an area of interest. Using the RB category as an example, let’s take a closer look at this expert faceoff:

How often did they agree/disagree with each other on RB predictions?

This chart shows how often Matthew Berry and David Dodds agreed and disagreed with each other’s RB predictions. We basically ran a round robin of head-to-head player match-ups and noted which player each expert predicted would win, based on how they ranked them in their published rankings. Note that we scrubbed out predictions that all the experts in our pool agreed on (e.g. Chris Johnson vs. Mr. No Name Desperation Start), so this data only represents predictions where there was at least one expert backing each player being compared.

For RBs, these two experts disagreed with each other about 26% of the time.  The reason why David Dodds performed better than Matthew Berry was because when they disagreed, he was more likely to be right. Here’s how often each was right when they argued:

Who was right when they disagreed on RB predictions?

That doesn’t tell the whole story though. Not all predictions are worth the same amount of value in Fantasy Football. When you make a great start/sit call, you’re rewarded handsomely with the difference in fantasy points between the guy you started and the guy you benched. We believe the magnitude of this benefit must be included in an accuracy assessment because this is the true benefit that you’re receiving from following the expert’s advice. Once we bake in the net fantasy points from each expert’s correct predictions, the spread between Berry and Dodds becomes a bit more pronounced. Basically, not only did Dodds get more of the disagreements correct, he also tended to get the more valuable predictions right. Here’s the difference once we bake in fantasy points:

PAY when Disagreeing on RB Predictions

The metric we use to measure accuracy is called PAY™ because it tells you what benefit you receive for following the expert’s advice. A 100% PAY™ would mean that following the expert’s advice would have given you the optimal lineup each week of the season. Note that the PAY™ amount in the chart above is different from what’s reported in the very first table because it only looks at match-ups where Berry and Dodds disagreed.

Also, keep in mind again that we only score predictions that are not unanimous among the experts. So these ratings represent how the experts are doing with the relatively harder predictions in fantasy football. No one’s looking for advice on whether to start Chris Johnson over Mr. No Name. We believe we should base our accuracy assessment on the predictions that actually matter to fantasy players. A score in the 50’s and 60’s may look poor to you, but we all know how tough it is to get the close calls right. Similar to sports gambling, a small relative edge can mean all the difference between whether you make a trip to the cashier window or the ATM.

I hope this post helps to illustrate the approach we take for rating fantasy advice. Obviously, accuracy is only one benefit we get from listening to true experts. I’m still going to read what TMR has to say, but perhaps with a little less blind faith. The good news for Mr. Berry is that he gets to get in the ring with Dodds again this year for a rematch. May the best fantasy expert win!

Note: We’re planning on following up this post with a look at how these two guys did when they agreed and disagreed with the expert consensus opinion. So, not compared to each other but compared to the wisdom of the consensus rankings. Stay tuned for that insightful analysis…

Image Credit: Link

What's your take? Leave a comment

Fantasy Games
DRAFT photo
Get a FREE FantasyPros upgrade with first deposit
FanDuel photo
Play for your share of $1m+
for FREE with first deposit
CBS Sports photo
Serious Fantasy Football
Get our Mobile App!

Enter your phone number below, and we'll text you a link to download the app.

1Le'Veon Bell (PIT)RB
2Todd Gurley (LAR)RB
3Antonio Brown (PIT)WR
4David Johnson (ARI)RB
5Ezekiel Elliott (DAL)RB
6DeAndre Hopkins (HOU)WR
7Odell Beckham Jr. (NYG)WR
8Kareem Hunt (KC)RB
9Leonard Fournette (JAC)RB
10Alvin Kamara (NO)RB
 View All Rankings 
11Michael Thomas (NO)WR
12Julio Jones (ATL)WR
13Melvin Gordon (LAC)RB
14A.J. Green (CIN)WR
15Dalvin Cook (MIN)RB
16Mike Evans (TB)WR
17LeSean McCoy (BUF)RB
18Keenan Allen (LAC)WR
19Devonta Freeman (ATL)RB
20Davante Adams (GB)WR
21Mark Ingram (NO)RB
22Jordan Howard (CHI)RB
23Tyreek Hill (KC)WR
24Derrick Henry (TEN)RB
25Brandin Cooks (NE)WR
26Rob Gronkowski (NE)TE
27Doug Baldwin (SEA)WR
28Christian McCaffrey (CAR)RB
29Adam Thielen (MIN)WR
30Carlos Hyde (CLE)RB
1Mike Trout (LAA)CF
2Jose Altuve (HOU)2B
3Nolan Arenado (COL)3B
4Trea Turner (WSH)SS
5Charlie Blackmon (COL)CF
6Mookie Betts (BOS)RF
7Bryce Harper (WSH)RF
8Paul Goldschmidt (ARI)1B
9Giancarlo Stanton (NYY)RF
10Clayton Kershaw (LAD)SP
 View All Rankings 
11Max Scherzer (WSH)SP
12Kris Bryant (CHC)3B,RF
13Carlos Correa (HOU)SS
14Joey Votto (CIN)1B
15Corey Kluber (CLE)SP
16Chris Sale (BOS)SP
17Freddie Freeman (ATL)1B,3B
18Manny Machado (BAL)3B
19Anthony Rizzo (CHC)1B,2B
20J.D. Martinez (BOS)RF
21Francisco Lindor (CLE)SS
22Aaron Judge (NYY)RF
23Jose Ramirez (CLE)2B,3B
24Josh Donaldson (TOR)3B
25George Springer (HOU)CF,RF
26Cody Bellinger (LAD)1B,LF
27Gary Sanchez (NYY)C
28Stephen Strasburg (WSH)SP
29Jose Abreu (CWS)1B
30Brian Dozier (MIN)2B
1Kevin Durant (GSW)SF,PF
2Giannis Antetokounmpo (MIL)SF,PF
3James Harden (HOU)PG,SG
4Stephen Curry (GSW)PG,SG
5Russell Westbrook (OKC)PG
6Karl-Anthony Towns (MIN)C
7Anthony Davis (NOR)PF,C
8Kawhi Leonard (SAS)SG,SF
9LeBron James (CLE)SF,PF
10Nikola Jokic (DEN)PF,C
 View All Rankings 
11John Wall (WAS)PG
12Chris Paul (HOU)PG
13Damian Lillard (POR)PG
14Jimmy Butler (MIN)SG,SF
15Rudy Gobert (UTH)C
16Kyrie Irving (BOS)PG,SG
17Hassan Whiteside (MIA)C,PF
18Myles Turner (IND)PF,C
19Paul George (OKC)SG,SF
20Kyle Lowry (TOR)PG
21Draymond Green (GSW)SF,PF
22Kemba Walker (CHA)PG
23CJ McCollum (POR)PG,SG
24Bradley Beal (WAS)SG
25Klay Thompson (GSW)SG,SF
26Marc Gasol (MEM)C
27Kevin Love (CLE)PF,C
28Paul Millsap (DEN)PF,C
29Joel Embiid (PHI)PF,C
30Eric Bledsoe (MIL)PG,SG