Yahoo! vs. ESPN – Who Gives Better Fantasy Advice?

by Andrew Sears | Accuracy | Sep 3rd 2010

With our accuracy study results recently announced, we thought it would be interesting to take a look at how well two of the most popular sites in the fantasy industry, Yahoo! & ESPN, performed with their 2009 weekly rankings. Our previous findings revealed how the individual experts at each site fared with their predictions so the next obvious question is: Which site gave more accurate advice with their composite staff rankings?

The answer: Yahoo! and it was a clean sweep across all of the positions in our study. In the table below we take a look at the accuracy results for each site using our PAY™ (Prediction Accuracy Yield) scoring methodology.

Yahoo! vs. ESPN Accuracy Results

Yahoo! Staff: Andy Behrens, Brandon Funston, Scott Pianowski, Brad Evans

ESPN Staff: Matthew Berry, Christopher Harris, Eric Karabell, Erik Kuselias

Site Running Back Wide Receiver Quarterback Tight End Kicker DST
Yahoo! Staff 63.1% 60.2% 61.0% 59.3% 59.7% 61.2%
ESPN Staff 60.9% 56.9% 58.1% 54.7% 57.4% 56.3%

Of course, these composite results aren’t too surprising considering that all of the Yahoo! experts finished inside the top 10 of our overall results while each ESPN expert was outside the top 10. What obviously stands out from this though is how consistently Yahoo! had the edge over ESPN regardless of the position in question. Given this, we half expect that if the sites had predicted each team’s water boy performance that Yahoo! would have had the advantage there as well.

In all seriousness, if we take a deeper look at the numbers, we can start to see some interesting data emerge about how the sites differed with their predictions and what gave Yahoo! its edge. As an example, let’s isolate the WR position for this site faceoff.

How often did the sites agree/disagree with each other on WR predictions?

This chart shows how often the two sites disagreed with their picks. For those unfamiliar with our methodology, we ran a round robin of head-to-head player match-ups and noted which player each site predicted would score more fantasy points, based on how the sites ranked each player in their published rankings. We also scrubbed out predictions for match-ups like “Andre Johnson vs. Domenik Hixon” where all of the experts in our study were in agreement. The rationale for removal being that these picks don’t provide much value to advice seekers (at least, we hope this is the case for the advice seekers’ sake).

So, you’re probably looking at this chart and thinking “Wow, these guys agreed with each other a lot!” It’s true but the real key is the small bucket where the sites disagreed because this largely represents the most difficult player predictions. In many ways, these are the player decisions that fantasy owners struggle with regarding who to start or sit because they’re such close calls. Ultimately, this is where Yahoo! gets its advantage over ESPN as the following chart shows:

Who was right when the sites disagreed on their WR predictions?

This chart looks at the Win % for each site and shows that Yahoo! had a decisive edge over ESPN for this category of picks. Using Win % as a success metric doesn’t paint a full picture of how good each site’s advice is, however, because not all predictions are worth the same in fantasy football. For example, when you make a great start/sit call, you are rewarded with the difference in fantasy points between the guy you started and the guy you benched. In our assessment, we factor in this value of benefit for each correct prediction using our PAY™ scoring methodology. When we bake this element into the results we can see that Yahoo!’s advantage over ESPN increases even further:

Accuracy (PAY™) When Disagreeing on WR Predictions

This tells us that not only did Yahoo! pick the right player more often than ESPN but they also did a better job of correctly predicting the outcomes that provided high value to fantasy owners. As mentioned, this wide gap in accuracy when the two sites disagreed is ultimately what gave Yahoo! the overall advantage with its WR predictions.

So what does all of this tell us? Basically, we now know that Yahoo! was more accurate than ESPN with their composite 2009 weekly player rankings across the RB, WR, QB, TE, K, and DST positions. And when we isolate the WR position we can see that Yahoo! gained its advantage by outperforming ESPN with their predictions for the difficult, high value start/sit decisions that fantasy owners labor over each week.

Will this hold up in 2010? That’s anyone’s guess and we’ll certainly be tracking the accuracy results again and sharing them with you as the season progresses. For now, Yahoo! has the edge but the chance for redemption starts next week for ESPN when the new season begins. As always, may the best site win!



What's your take? Leave a comment

Fantasy Games
Get 5 free NFL entries
with your first deposit
Join a League for Free
Serious Fantasy Football
1Odell Beckham Jr. (NYG)WR
2David Johnson (ARI)RB
3C.J. Anderson (DEN)RB
4Antonio Brown (PIT)WR
5Julio Jones (ATL)WR
6A.J. Green (CIN)WR
7DeAngelo Williams (PIT)RB
8Lamar Miller (HOU)RB
9Ezekiel Elliott (DAL)RB
10DeAndre Hopkins (HOU)WR
 View all Flex Rankings 
11Alshon Jeffery (CHI)WR
12Allen Robinson (JAC)WR
13Adrian Peterson (MIN)RB
14Brandin Cooks (NO)WR
15Amari Cooper (OAK)WR
16Brandon Marshall (NYJ)WR
17Mike Evans (TB)WR
18Mark Ingram (NO)RB
19Spencer Ware (KC)RB
20Jordy Nelson (GB)WR
21Matt Forte (NYJ)RB
22Kelvin Benjamin (CAR)WR
23Todd Gurley (LA)RB
24Latavius Murray (OAK)RB
25Jordan Reed (WAS)TE
26LeSean McCoy (BUF)RB
27Doug Baldwin (SEA)WR
28Rashad Jennings (NYG)RB
29Jordan Matthews (PHI)WR
30Dez Bryant (DAL)WR
1Mike Trout (LAA)CF,DH
2Paul Goldschmidt (ARI)1B
3Nolan Arenado (COL)3B
4Josh Donaldson (TOR)3B,DH
5Jose Altuve (HOU)2B,DH
6Manny Machado (BAL)3B,SS
7Bryce Harper (WSH)CF,RF
8Mookie Betts (BOS)CF,RF
9Anthony Rizzo (CHC)1B
10Kris Bryant (CHC)1B,3B
 View All Rankings 
11Clayton Kershaw (LAD)SP
12Miguel Cabrera (DET)1B,DH
13Max Scherzer (WSH)SP
14Edwin Encarnacion (TOR)1B,DH
15Madison Bumgarner (SF)SP
16Chris Sale (CWS)SP
17George Springer (HOU)CF,RF
18Jake Arrieta (CHC)SP
19Carlos Correa (HOU)SS
20Carlos Gonzalez (COL)RF
21Charlie Blackmon (COL)LF,CF
22Joey Votto (CIN)1B
23Nelson Cruz (SEA)RF,DH
24Andrew McCutchen (PIT)CF
25Corey Kluber (CLE)SP
26J.D. Martinez (DET)RF
27Starling Marte (PIT)LF,CF
28Xander Bogaerts (BOS)SS
29David Price (BOS)SP
30Yoenis Cespedes (NYM)LF,CF
1Anthony Davis (NOR)F
2Stephen Curry (GSW)G
3James Harden (HOU)G
4Russell Westbrook (OKC)G
5Chris Paul (LAC)G
6LeBron James (CLE)F
7Kevin Durant (GSW)F
8DeMarcus Cousins (SAC)F
9Damian Lillard (POR)G
10John Wall (WAS)G
 View 2016 Rankings 
11Kawhi Leonard (SAS)G
12Klay Thompson (GSW)G
13Jimmy Butler (CHI)G
14Paul Millsap (ATL)F
15Marc Gasol (MEM)C
16Blake Griffin (LAC)F
17Carmelo Anthony (NYK)F
18LaMarcus Aldridge (SAS)F
19Serge Ibaka (ORL)F
20Rudy Gobert (UTH)C
21Eric Bledsoe (PHO)G
22Paul George (IND)F
23Kyle Lowry (TOR)G
24Al Horford (BOS)C
25Nikola Vucevic (ORL)F
26Draymond Green (GSW)F
27Kevin Love (CLE)F
28Pau Gasol (SAS)F
29Gordon Hayward (UTH)G
30DeAndre Jordan (LAC)C