Yahoo! vs. ESPN – Who Gives Better Fantasy Advice?

by Andrew Sears | Accuracy | Sep 3rd 2010

With our accuracy study results recently announced, we thought it would be interesting to take a look at how well two of the most popular sites in the fantasy industry, Yahoo! & ESPN, performed with their 2009 weekly rankings. Our previous findings revealed how the individual experts at each site fared with their predictions so the next obvious question is: Which site gave more accurate advice with their composite staff rankings?

The answer: Yahoo! and it was a clean sweep across all of the positions in our study. In the table below we take a look at the accuracy results for each site using our PAY™ (Prediction Accuracy Yield) scoring methodology.

Yahoo! vs. ESPN Accuracy Results

Yahoo! Staff: Andy Behrens, Brandon Funston, Scott Pianowski, Brad Evans

ESPN Staff: Matthew Berry, Christopher Harris, Eric Karabell, Erik Kuselias

Site Running Back Wide Receiver Quarterback Tight End Kicker DST
Yahoo! Staff 63.1% 60.2% 61.0% 59.3% 59.7% 61.2%
ESPN Staff 60.9% 56.9% 58.1% 54.7% 57.4% 56.3%

Of course, these composite results aren’t too surprising considering that all of the Yahoo! experts finished inside the top 10 of our overall results while each ESPN expert was outside the top 10. What obviously stands out from this though is how consistently Yahoo! had the edge over ESPN regardless of the position in question. Given this, we half expect that if the sites had predicted each team’s water boy performance that Yahoo! would have had the advantage there as well.

In all seriousness, if we take a deeper look at the numbers, we can start to see some interesting data emerge about how the sites differed with their predictions and what gave Yahoo! its edge. As an example, let’s isolate the WR position for this site faceoff.

How often did the sites agree/disagree with each other on WR predictions?

This chart shows how often the two sites disagreed with their picks. For those unfamiliar with our methodology, we ran a round robin of head-to-head player match-ups and noted which player each site predicted would score more fantasy points, based on how the sites ranked each player in their published rankings. We also scrubbed out predictions for match-ups like “Andre Johnson vs. Domenik Hixon” where all of the experts in our study were in agreement. The rationale for removal being that these picks don’t provide much value to advice seekers (at least, we hope this is the case for the advice seekers’ sake).

So, you’re probably looking at this chart and thinking “Wow, these guys agreed with each other a lot!” It’s true but the real key is the small bucket where the sites disagreed because this largely represents the most difficult player predictions. In many ways, these are the player decisions that fantasy owners struggle with regarding who to start or sit because they’re such close calls. Ultimately, this is where Yahoo! gets its advantage over ESPN as the following chart shows:

Who was right when the sites disagreed on their WR predictions?

This chart looks at the Win % for each site and shows that Yahoo! had a decisive edge over ESPN for this category of picks. Using Win % as a success metric doesn’t paint a full picture of how good each site’s advice is, however, because not all predictions are worth the same in fantasy football. For example, when you make a great start/sit call, you are rewarded with the difference in fantasy points between the guy you started and the guy you benched. In our assessment, we factor in this value of benefit for each correct prediction using our PAY™ scoring methodology. When we bake this element into the results we can see that Yahoo!’s advantage over ESPN increases even further:

Accuracy (PAY™) When Disagreeing on WR Predictions

This tells us that not only did Yahoo! pick the right player more often than ESPN but they also did a better job of correctly predicting the outcomes that provided high value to fantasy owners. As mentioned, this wide gap in accuracy when the two sites disagreed is ultimately what gave Yahoo! the overall advantage with its WR predictions.

So what does all of this tell us? Basically, we now know that Yahoo! was more accurate than ESPN with their composite 2009 weekly player rankings across the RB, WR, QB, TE, K, and DST positions. And when we isolate the WR position we can see that Yahoo! gained its advantage by outperforming ESPN with their predictions for the difficult, high value start/sit decisions that fantasy owners labor over each week.

Will this hold up in 2010? That’s anyone’s guess and we’ll certainly be tracking the accuracy results again and sharing them with you as the season progresses. For now, Yahoo! has the edge but the chance for redemption starts next week for ESPN when the new season begins. As always, may the best site win!



What's your take? Leave a comment

Fantasy Games
Get 5 free NFL entries
with your first deposit
Join a League for Free
Serious Fantasy Football
1Antonio Brown (PIT)WR
2Odell Beckham Jr. (NYG)WR
3Julio Jones (ATL)WR
4Todd Gurley (LA)RB
5David Johnson (ARI)RB
6Adrian Peterson (MIN)RB
7A.J. Green (CIN)WR
8DeAndre Hopkins (HOU)WR
9Ezekiel Elliott (DAL)RB
10Lamar Miller (HOU)RB
 View All Rankings 
11Rob Gronkowski (NE)TE
12Allen Robinson (JAC)WR
13Dez Bryant (DAL)WR
14Le'Veon Bell (PIT)RB
15Jamaal Charles (KC)RB
16Brandon Marshall (NYJ)WR
17Mike Evans (TB)WR
18Devonta Freeman (ATL)RB
19Mark Ingram (NO)RB
20Jordy Nelson (GB)WR
21Alshon Jeffery (CHI)WR
22Keenan Allen (SD)WR
23LeSean McCoy (BUF)RB
24Eddie Lacy (GB)RB
25Doug Martin (TB)RB
26Brandin Cooks (NO)WR
27Amari Cooper (OAK)WR
28T.Y. Hilton (IND)WR
29Sammy Watkins (BUF)WR
30C.J. Anderson (DEN)RB
1Mike Trout (LAA)CF,DH
2Paul Goldschmidt (ARI)1B
3Josh Donaldson (TOR)3B,DH
4Nolan Arenado (COL)3B
5Jose Altuve (HOU)2B,DH
6Anthony Rizzo (CHC)1B
7Bryce Harper (WSH)CF,RF
8Mookie Betts (BOS)CF,RF
9Manny Machado (BAL)3B,SS
10Miguel Cabrera (DET)1B,DH
 View All Rankings 
11Kris Bryant (CHC)3B,LF
12Max Scherzer (WSH)SP
13Edwin Encarnacion (TOR)1B,DH
14Madison Bumgarner (SF)SP
15Jake Arrieta (CHC)SP
16Carlos Correa (HOU)SS
17Starling Marte (PIT)LF,CF
18Chris Sale (CWS)SP
19George Springer (HOU)CF,RF
20Jose Fernandez (MIA)SP
21Carlos Gonzalez (COL)RF
22Nelson Cruz (SEA)RF,DH
23Joey Votto (CIN)1B
24Charlie Blackmon (COL)LF,CF
25Corey Kluber (CLE)SP
26Ryan Braun (MIL)LF,RF
27Andrew McCutchen (PIT)CF
28Stephen Strasburg (WSH)SP
29Xander Bogaerts (BOS)SS
30Robinson Cano (SEA)2B
1Anthony Davis (NOR)F
2Stephen Curry (GSW)G
3James Harden (HOU)G
4Russell Westbrook (OKC)G
5Chris Paul (LAC)G
6LeBron James (CLE)F
7Kevin Durant (GSW)F
8DeMarcus Cousins (SAC)F
9Damian Lillard (POR)G
10John Wall (WAS)G
 View 2015 Rankings 
11Kawhi Leonard (SAS)G
12Klay Thompson (GSW)G
13Jimmy Butler (CHI)G
14Paul Millsap (ATL)F
15Marc Gasol (MEM)C
16Blake Griffin (LAC)F
17Carmelo Anthony (NYK)F
18LaMarcus Aldridge (SAS)F
19Serge Ibaka (ORL)F
20Rudy Gobert (UTH)C
21Eric Bledsoe (PHO)G
22Al Horford (BOS)C
23Kyle Lowry (TOR)G
24Paul George (IND)F
25Nikola Vucevic (ORL)F
26Draymond Green (GSW)F
27Kevin Love (CLE)F
28Pau Gasol (SAS)F
29Gordon Hayward (UTH)G
30DeAndre Jordan (LAC)C