Matthew Berry vs. David Dodds – Who gives better fantasy advice?

by dave
Aug 24, 2010

A Heads-up comparison of two heavyweights from ESPN and FootballGuys

Well, if you’ve been studying our accuracy scores, the answer is obvious. After slugging it out over 16 weeks in 2009, David Dodds beat out Matthew Berry in the key categories of RB, WR, QB, and TE accuracy. They split on DST and K, but this is the last time I’ll ever mention the word kicker in the first paragraph of a fantasy football post.

Here’s how high their PAY™ (Prediction Accuracy Yield) was for the four key positions in 2009:

[table id=7 /]

So why am I bringing up something that can be easily found on our Accuracy Scores page? Am I just taking a cheap shot at Mr. Berry because he’s the most well know fantasy football expert? Or am I secretly on the FootballGuys payroll? Neither.  OK, a little of the first (people like reading about Matthew Berry), and none of the second (although I’m open to free subscription offers).

I’m bringing up a specific example of two experts because I think it helps illustrate the foundation of how we do our accuracy assessments. A surprising number of people have actually taken the time to read about our methodology, so this seems to be an area of interest. Using the RB category as an example, let’s take a closer look at this expert faceoff:

How often did they agree/disagree with each other on RB predictions?

This chart shows how often Matthew Berry and David Dodds agreed and disagreed with each other’s RB predictions. We basically ran a round robin of head-to-head player match-ups and noted which player each expert predicted would win, based on how they ranked them in their published rankings. Note that we scrubbed out predictions that all the experts in our pool agreed on (e.g. Chris Johnson vs. Mr. No Name Desperation Start), so this data only represents predictions where there was at least one expert backing each player being compared.

For RBs, these two experts disagreed with each other about 26% of the time.  The reason why David Dodds performed better than Matthew Berry was because when they disagreed, he was more likely to be right. Here’s how often each was right when they argued:

Who was right when they disagreed on RB predictions?

That doesn’t tell the whole story though. Not all predictions are worth the same amount of value in Fantasy Football. When you make a great start/sit call, you’re rewarded handsomely with the difference in fantasy points between the guy you started and the guy you benched. We believe the magnitude of this benefit must be included in an accuracy assessment because this is the true benefit that you’re receiving from following the expert’s advice. Once we bake in the net fantasy points from each expert’s correct predictions, the spread between Berry and Dodds becomes a bit more pronounced. Basically, not only did Dodds get more of the disagreements correct, he also tended to get the more valuable predictions right. Here’s the difference once we bake in fantasy points:

PAY when Disagreeing on RB Predictions

The metric we use to measure accuracy is called PAY™ because it tells you what benefit you receive for following the expert’s advice. A 100% PAY™ would mean that following the expert’s advice would have given you the optimal lineup each week of the season. Note that the PAY™ amount in the chart above is different from what’s reported in the very first table because it only looks at match-ups where Berry and Dodds disagreed.

Also, keep in mind again that we only score predictions that are not unanimous among the experts. So these ratings represent how the experts are doing with the relatively harder predictions in fantasy football. No one’s looking for advice on whether to start Chris Johnson over Mr. No Name. We believe we should base our accuracy assessment on the predictions that actually matter to fantasy players. A score in the 50’s and 60’s may look poor to you, but we all know how tough it is to get the close calls right. Similar to sports gambling, a small relative edge can mean all the difference between whether you make a trip to the cashier window or the ATM.

I hope this post helps to illustrate the approach we take for rating fantasy advice. Obviously, accuracy is only one benefit we get from listening to true experts. I’m still going to read what TMR has to say, but perhaps with a little less blind faith. The good news for Mr. Berry is that he gets to get in the ring with Dodds again this year for a rematch. May the best fantasy expert win!

Note: We’re planning on following up this post with a look at how these two guys did when they agreed and disagreed with the expert consensus opinion. So, not compared to each other but compared to the wisdom of the consensus rankings. Stay tuned for that insightful analysis…

Image Credit: Link

What's your take? Leave a comment

Fantasy Games
DRAFT photo
Get a FREE FantasyPros upgrade with first deposit
FanDuel photo
Play for your share of $1m+
for FREE with first deposit
CBS Sports photo
Serious Fantasy Football
Get our Mobile App!

Enter your phone number below, and we'll text you a link to download the app.

1Todd Gurley (LAR)RB
2Le'Veon Bell (PIT)RB
3Ezekiel Elliott (DAL)RB
4Antonio Brown (PIT)WR
5David Johnson (ARI)RB
6DeAndre Hopkins (HOU)WR
7Odell Beckham Jr. (NYG)WR
8Alvin Kamara (NO)RB
9Kareem Hunt (KC)RB
10Julio Jones (ATL)WR
 View All Rankings 
11Leonard Fournette (JAC)RB
12Saquon Barkley (NYG)RB
13Michael Thomas (NO)WR
14Melvin Gordon (LAC)RB
15A.J. Green (CIN)WR
16Dalvin Cook (MIN)RB
17Keenan Allen (LAC)WR
18Davante Adams (GB)WR
19Mike Evans (TB)WR
20LeSean McCoy (BUF)RB
21Devonta Freeman (ATL)RB
22Jordan Howard (CHI)RB
23Rob Gronkowski (NE)TE
24Doug Baldwin (SEA)WR
25Tyreek Hill (KC)WR
26Christian McCaffrey (CAR)RB
27Adam Thielen (MIN)WR
28Jerick McKinnon (SF)RB
29Joe Mixon (CIN)RB
30T.Y. Hilton (IND)WR
1Mike Trout (LAA)CF
2Jose Altuve (HOU)2B
3Nolan Arenado (COL)3B
4Trea Turner (WSH)SS
5Mookie Betts (BOS)RF
6Charlie Blackmon (COL)CF
7Paul Goldschmidt (ARI)1B
8Bryce Harper (WSH)RF
9Giancarlo Stanton (NYY)RF
10Clayton Kershaw (LAD)SP
 View All Rankings 
11Max Scherzer (WSH)SP
12Kris Bryant (CHC)3B,RF
13Carlos Correa (HOU)SS
14Corey Kluber (CLE)SP
15Chris Sale (BOS)SP
16Joey Votto (CIN)1B
17Manny Machado (BAL)3B
18Freddie Freeman (ATL)1B,3B
19Anthony Rizzo (CHC)1B,2B
20J.D. Martinez (BOS)RF
21Aaron Judge (NYY)RF
22Francisco Lindor (CLE)SS
23George Springer (HOU)CF,RF
24Josh Donaldson (TOR)3B
25Cody Bellinger (LAD)1B,LF
26Stephen Strasburg (WSH)SP
27Noah Syndergaard (NYM)SP
28Gary Sanchez (NYY)C
29Jose Ramirez (CLE)2B,3B
30Brian Dozier (MIN)2B
1Kevin Durant (GSW)SF,PF
2Giannis Antetokounmpo (MIL)SF,PF
3James Harden (HOU)PG,SG
4Stephen Curry (GSW)PG,SG
5Russell Westbrook (OKC)PG
6Karl-Anthony Towns (MIN)C
7Anthony Davis (NOR)PF,C
8Kawhi Leonard (SAS)SG,SF
9LeBron James (CLE)SF,PF
10Nikola Jokic (DEN)PF,C
 View All Rankings 
11John Wall (WAS)PG
12DeMarcus Cousins (NOR)PF,C
13Chris Paul (HOU)PG
14Damian Lillard (POR)PG
15Jimmy Butler (MIN)SG,SF
16Rudy Gobert (UTH)C
17Kyrie Irving (BOS)PG,SG
18Hassan Whiteside (MIA)C,PF
19Myles Turner (IND)PF,C
20Paul George (OKC)SG,SF
21Kyle Lowry (TOR)PG
22Draymond Green (GSW)SF,PF
23Kristaps Porzingis (NYK)PF,C
24Kemba Walker (CHA)PG
25CJ McCollum (POR)PG,SG
26Mike Conley (MEM)PG
27Bradley Beal (WAS)SG
28Klay Thompson (GSW)SG,SF
29Marc Gasol (MEM)C
30Gordon Hayward (BOS)SG,SF