Yahoo! vs. ESPN – Who Gives Better Fantasy Advice?

Sep 3, 2010

With our accuracy study results recently announced, we thought it would be interesting to take a look at how well two of the most popular sites in the fantasy industry, Yahoo! & ESPN, performed with their 2009 weekly rankings. Our previous findings revealed how the individual experts at each site fared with their predictions so the next obvious question is: Which site gave more accurate advice with their composite staff rankings?

The answer: Yahoo! and it was a clean sweep across all of the positions in our study. In the table below we take a look at the accuracy results for each site using our PAY™ (Prediction Accuracy Yield) scoring methodology.

Yahoo! vs. ESPN Accuracy Results

Yahoo! Staff: Andy Behrens, Brandon Funston, Scott Pianowski, Brad Evans

ESPN Staff: Matthew Berry, Christopher Harris, Eric Karabell, Erik Kuselias

Site Running Back Wide Receiver Quarterback Tight End Kicker DST
Yahoo! Staff 63.1% 60.2% 61.0% 59.3% 59.7% 61.2%
ESPN Staff 60.9% 56.9% 58.1% 54.7% 57.4% 56.3%

Of course, these composite results aren’t too surprising considering that all of the Yahoo! experts finished inside the top 10 of our overall results while each ESPN expert was outside the top 10. What obviously stands out from this though is how consistently Yahoo! had the edge over ESPN regardless of the position in question. Given this, we half expect that if the sites had predicted each team’s water boy performance that Yahoo! would have had the advantage there as well.

In all seriousness, if we take a deeper look at the numbers, we can start to see some interesting data emerge about how the sites differed with their predictions and what gave Yahoo! its edge. As an example, let’s isolate the WR position for this site faceoff.

How often did the sites agree/disagree with each other on WR predictions?

This chart shows how often the two sites disagreed with their picks. For those unfamiliar with our methodology, we ran a round robin of head-to-head player match-ups and noted which player each site predicted would score more fantasy points, based on how the sites ranked each player in their published rankings. We also scrubbed out predictions for match-ups like “Andre Johnson vs. Domenik Hixon” where all of the experts in our study were in agreement. The rationale for removal being that these picks don’t provide much value to advice seekers (at least, we hope this is the case for the advice seekers’ sake).

So, you’re probably looking at this chart and thinking “Wow, these guys agreed with each other a lot!” It’s true but the real key is the small bucket where the sites disagreed because this largely represents the most difficult player predictions. In many ways, these are the player decisions that fantasy owners struggle with regarding who to start or sit because they’re such close calls. Ultimately, this is where Yahoo! gets its advantage over ESPN as the following chart shows:

Who was right when the sites disagreed on their WR predictions?

This chart looks at the Win % for each site and shows that Yahoo! had a decisive edge over ESPN for this category of picks. Using Win % as a success metric doesn’t paint a full picture of how good each site’s advice is, however, because not all predictions are worth the same in fantasy football. For example, when you make a great start/sit call, you are rewarded with the difference in fantasy points between the guy you started and the guy you benched. In our assessment, we factor in this value of benefit for each correct prediction using our PAY™ scoring methodology. When we bake this element into the results we can see that Yahoo!’s advantage over ESPN increases even further:

Accuracy (PAY™) When Disagreeing on WR Predictions

This tells us that not only did Yahoo! pick the right player more often than ESPN but they also did a better job of correctly predicting the outcomes that provided high value to fantasy owners. As mentioned, this wide gap in accuracy when the two sites disagreed is ultimately what gave Yahoo! the overall advantage with its WR predictions.

So what does all of this tell us? Basically, we now know that Yahoo! was more accurate than ESPN with their composite 2009 weekly player rankings across the RB, WR, QB, TE, K, and DST positions. And when we isolate the WR position we can see that Yahoo! gained its advantage by outperforming ESPN with their predictions for the difficult, high value start/sit decisions that fantasy owners labor over each week.

Will this hold up in 2010? That’s anyone’s guess and we’ll certainly be tracking the accuracy results again and sharing them with you as the season progresses. For now, Yahoo! has the edge but the chance for redemption starts next week for ESPN when the new season begins. As always, may the best site win!

What's your take? Leave a comment

Fantasy Games
DRAFT photo
Get a FREE $3 Best Ball entry with your 1st deposit
FanDuel photo
Play for your share of $1m+
for FREE with first deposit
CBS Sports photo
Serious Fantasy Football
Get our Mobile App!

Enter your phone number below, and we'll text you a link to download the app.

1Le'Veon Bell (PIT)RB
2Todd Gurley (LAR)RB
3Antonio Brown (PIT)WR
4David Johnson (ARI)RB
5Ezekiel Elliott (DAL)RB
6DeAndre Hopkins (HOU)WR
7Odell Beckham Jr. (NYG)WR
8Kareem Hunt (KC)RB
9Leonard Fournette (JAC)RB
10Alvin Kamara (NO)RB
 View All Rankings 
11Michael Thomas (NO)WR
12Julio Jones (ATL)WR
13Melvin Gordon (LAC)RB
14A.J. Green (CIN)WR
15Dalvin Cook (MIN)RB
16Mike Evans (TB)WR
17LeSean McCoy (BUF)RB
18Keenan Allen (LAC)WR
19Devonta Freeman (ATL)RB
20Davante Adams (GB)WR
21Mark Ingram (NO)RB
22Jordan Howard (CHI)RB
23Tyreek Hill (KC)WR
24Derrick Henry (TEN)RB
25Brandin Cooks (NE)WR
26Rob Gronkowski (NE)TE
27Doug Baldwin (SEA)WR
28Christian McCaffrey (CAR)RB
29Adam Thielen (MIN)WR
30Carlos Hyde (FA)RB
1Mike Trout (LAA)CF
2Jose Altuve (HOU)2B
3Nolan Arenado (COL)3B
4Trea Turner (WSH)SS
5Charlie Blackmon (COL)CF
6Paul Goldschmidt (ARI)1B
7Mookie Betts (BOS)RF
8Bryce Harper (WSH)RF
9Giancarlo Stanton (NYY)RF
10Clayton Kershaw (LAD)SP
 View All Rankings 
11Max Scherzer (WSH)SP
12Kris Bryant (CHC)3B,RF
13Carlos Correa (HOU)SS
14Joey Votto (CIN)1B
15Corey Kluber (CLE)SP
16Chris Sale (BOS)SP
17Freddie Freeman (ATL)1B,3B
18Anthony Rizzo (CHC)1B,2B
19Manny Machado (BAL)3B
20J.D. Martinez (BOS)RF
21Francisco Lindor (CLE)SS
22Aaron Judge (NYY)RF
23Jose Ramirez (CLE)2B,3B
24George Springer (HOU)CF,RF
25Cody Bellinger (LAD)1B,LF
26Josh Donaldson (TOR)3B
27Gary Sanchez (NYY)C
28Stephen Strasburg (WSH)SP
29Madison Bumgarner (SF)SP
30Brian Dozier (MIN)2B
1Kevin Durant (GSW)SF,PF
2Giannis Antetokounmpo (MIL)SF,PF
3James Harden (HOU)PG,SG
4Stephen Curry (GSW)PG,SG
5Russell Westbrook (OKC)PG
6Karl-Anthony Towns (MIN)C
7Anthony Davis (NOR)PF,C
8Kawhi Leonard (SAS)SG,SF
9LeBron James (CLE)SF,PF
10Nikola Jokic (DEN)PF,C
 View All Rankings 
11John Wall (WAS)PG
12Chris Paul (HOU)PG
13Damian Lillard (POR)PG
14Jimmy Butler (MIN)SG,SF
15Rudy Gobert (UTH)C
16Kyrie Irving (BOS)PG,SG
17Hassan Whiteside (MIA)C,PF
18Myles Turner (IND)PF,C
19Paul George (OKC)SG,SF
20Kyle Lowry (TOR)PG
21Draymond Green (GSW)SF,PF
22Kemba Walker (CHA)PG
23CJ McCollum (POR)PG,SG
24Bradley Beal (WAS)SG
25Klay Thompson (GSW)SG,SF
26Marc Gasol (MEM)C
27Kevin Love (CLE)PF,C
28Paul Millsap (DEN)PF,C
29Joel Embiid (PHI)PF,C
30Eric Bledsoe (MIL)PG,SG