Author Archive

A Look at SGP-Based Rankings Using Different Projection Sets (Part 1)

The bulk of the work I do pre-draft and in-season is essentially based on an SGP (standings gain points) projections and ranking system. I use SGP data from leagues that match the format and settings of the league I’m ranking for (ideally from 10+ years of data from the actual league, where possible). While I usually do my own projections for 30-40 players of specific interest, in general I’m happy to utilize the projections published by experts that actually know what they’re doing and do it for a living. Specifically (and in no particular order) I use Steamer, Pecota, and Baseball HQ.

These lists may not be useful in ‘absolute’ terms – again, the data I’m using here reflect the SGP settings I use that reflect the league I play in. However, I still believe the lists offer an interesting way to notice a) how each projection system differs on its view of individual players, and b) general overall differences in each projection system. Blindly following a projection set is probably going to be better than randomly picking players by throwing darts at the wall. But you can squeeze a lot more value out of these rankings and the projections you use by gaining a deeper understanding of how each set of projections work, and what ‘biases’ and tendencies might be part of the numbers.

What I like to do each year is generate ‘top X’ lists of players at each position for each projection set I use, then play around in the results to spot any glaring differences.  Is one projection overly conservative on expected ABs? Is one projection set basically expecting a repeat of last year’s career year? I can use that as a starting point to drill down into some of the numbers to see what might be behind the differences. Personally, I find it all too easy to get overwhelmed at all the different numbers available to be looked at – far too often I find myself deep down the rabbit’s hole, spending three hours looking at average fly ball distance on balls hit on the second Wednesday of the month on even-numbered days or something. I find this approach helps me narrow in on specific players or numbers of interest. And the benefit of doing this by SGP, broken down by category, is that it is easier to see specifically how each player is projected to impact each category. Player stats will not win your fantasy league, roto points will win you your fantasy league: I get a better understanding of the player’s ‘value components’ and how it impacts the particular league I play in.

First, a quick overview of SGP. Standings Gain Points is a way to measure the contribution of each player to your overall roto league standings. Larry Schecter’s excellent book, ‘Winning Fantasy Baseball’ is a great primer on the subject. Other places to read about SGP online are here and here. In a nutshell the system looks at the average stats needed to gain one point in the standings for a particular rotisserie category. For example, suppose in your league over the past 10 years, you needed 10 HRs to gain one point in the HR category standings. A player projected to hit 30 home runs would be credited with 3 SGPs for the HR category. Tally up all the SGPs the player is expected to add (or subtract) for all categories, and you get a total SGP score.

There’s a ton more to it, but that’s the basics – ever tried to figure out if the guy hitting a lot of HRs but no average was more valuable (and if so, by how much) than the guy hitting for a decent average and some SBs but no power? Now you have an idea.

In this first article, I look at at Catchers. I’ll add reports on all the hitter positions over the next couple of weeks. A reminder that these rankings are based on SGP values which are basically unique to my specific league, so your numbers will differ if you play in a different league format, but again, we’re looking a relative differences, not absolute numbers (For the record, the league format for the SGP rankings here: Standard 12-team 5×5 roto, 1 catcher, three OF and two util, 1250 innings cap).

Here is the list of top 12 catchers ranked by my league’s SGP, based on Baseball HQ projections:

Figure 1. Top 15 catchers by SGP & BHQ projections

Rank MLBAMID Full Name RSPG HRSPG RBISPG SBSPG AVGSPG Total
1 457763 Buster Posey 4.22 2.66 4.60 0.15 1.24 12.87
2 543228 Yan Gomes 4.22 3.08 4.28 0.15 0.12 11.84
3 519023 Devin Mesoraco 3.73 3.78 4.33 0.15 -0.31 11.67
4 594828 Evan Gattis 3.48 4.33 4.12 0.00 -0.48 11.45
5 518960 Jonathan Lucroy 3.98 2.24 3.84 0.73 0.62 11.40
6 431145 Russell Martin 3.54 2.52 3.84 1.02 -0.12 10.80
7 521692 Salvador Perez 3.54 2.38 4.01 0.00 0.46 10.39
8 435263 Brian McCann 3.42 3.50 4.01 0.15 -0.68 10.38
9 425877 Yadier Molina 3.66 1.54 3.74 0.58 0.71 10.23
10 467092 Wilson Ramos 2.86 2.52 3.84 0.00 -0.16 9.06
11 446308 Matt Wieters 3.11 2.38 3.41 0.15 -0.14 8.90
12 444379 John Jaso 3.85 1.54 3.19 0.44 -0.32 8.70
13 572287 Mike Zunino 3.66 2.80 3.68 0.00 -1.52 8.63
14 519083 Derek Norris 3.29 1.96 3.14 0.73 -0.72 8.40
15 425900 Dioner Navarro 2.61 1.96 3.25 0.29 0.05 8.16

Nobody should be surprised to see Buster Posey at the top of any catchers list; he’s there because he has such a huge advantage over everyone else at the position in Batting Average. And he has a full point advantage over the next tier of players. Gomes and Mesoraco at 2nd and 3rd? Probably more of a surprise. Gomes has legit power, and the batting average isn’t a fluke (career BABIP: .323). Mesoraco had a career year last year – his 25 HRs in 440 PA is only 6 fewer than he hit in 1,100 PAs in 2013, 2012, 2011 combined. Yes, he plays in a tiny crackerjack box of a park. But his FB% jumped 10ppt (33.8% to 43%) from 2013 and 2014, while his HR/FB rate more than doubled, from a constant 10% or so in 2011-2013 to 20.5% in 2014. Color me less than convinced. And with only .44 points separating them, the next four players (Gomes, Mesoraco, Gattis and Lucroy) are basically interchangeable.

Russell Martin’s ranking gets a big boost from expected SB contribution; if those SBs dip he falls quite a bit. Would anyone be surprised if a catcher that turns 32 in February and was only 4-of-8 in stolen base attempts last year doesn’t run that much in 2015?

Conversely, if Zunino can boost his average a bit, he could be excellent late-round value. He gets a massive -1.52 hit to his SGP total after hitting less than his weight last year. On the one hand, one could possibly expect a bit of an uptick in the batting average; his BABIP last year of .248 was the lowest mark he’s recorded at any point for a full season going back to 2012 and his days in the Arizona Fall League. On the other hand, he struck out 33% of the time last year, so…yeah.

Finally – what’s surprising about this list is who’s not on it – no d’Arnaud, no Rosario.

Figure 2. Top 15 catchers by SGP & Steamer projections

Rank MLBAMID Full Name RSPG HRSPG RBISPG SBSPG AVGSPG Total
1 457763 Buster Posey 4.29 2.66 4.06 0.15 0.87 12.02
2 594828 Evan Gattis 4.22 3.92 4.28 0.15 -0.88 11.68
3 435263 Brian McCann 3.85 3.36 3.79 0.15 -0.54 10.61
4 518960 Jonathan Lucroy 4.04 1.96 3.47 0.73 0.36 10.55
5 431145 Russell Martin 3.79 2.24 3.19 0.87 -0.81 9.28
6 518595 Travis d’Arnaud 3.29 2.38 3.25 0.29 -0.54 8.67
7 521692 Salvador Perez 3.23 1.96 3.14 0.15 0.10 8.58
8 446308 Matt Wieters 3.35 2.38 3.03 0.44 -0.68 8.52
9 543228 Yan Gomes 3.17 2.24 3.09 0.29 -0.36 8.42
10 519023 Devin Mesoraco 2.98 2.52 2.98 0.44 -0.60 8.31
11 467092 Wilson Ramos 2.86 2.24 2.98 0.15 -0.03 8.19
12 425877 Yadier Molina 2.92 1.40 2.76 0.44 0.35 7.86
13 501647 Wilin Rosario 2.30 1.96 2.44 0.29 0.16 7.14
14 518735 Yasmani Grandal 2.98 1.82 2.71 0.29 -0.69 7.11
15 455139 Robinson Chirinos 2.73 1.68 2.49 0.29 -0.80 6.39

The first thing to notice about this list – in general the total ‘SGP’s provided are considerably lower than for the BHQ group above. At 8.90 total SGPs, Wieters wasn’t even in the top 10 in the BHQ list; 8.90 SGPs almost makes him a top-5 pick on this list. The numbers suggest that Steamer is a bit more conservative (or BHQ overly optimistic) in its forecasts, particularly for HR and RBIs. My understanding is that BHQ’s projections are largely based on playing time projections, so perhaps the numbers will change as we get closer to spring training and the start of the season and jobs are won/lost etc. It will be interesting to see how (if) these numbers change.

Looking at the list itself, Posey and Gattis again in the top five, no surprise there. McCann in the top five looks somewhat surprising (despite a rather big gap between Gattis and McCann). Maybe Steamer remembers that McCann still hit 23 HRs last year and still plays in a favorable park? His LD% was stable last year, GB% down a tick, FB% up a tick. His HR/FB rate was down quite a bit from 2013, which is surprising given that the conventional wisdom suggested he was moving to a more favorable ballpark…but his 2014 HR/FB rate was almost exactly in line with his average since 2008. Steamer might also be expecting an uptick on that awful .231 BABIP from 2014, although not sure if it’s factoring in the increased defensive shifts he saw last year. Less than .50 points separate d’Arnaud at #6 and Ramos at #11. Of the group, Wieters is now the grizzled veteran of the bunch and looked like he was on his way to a career year before getting hurt last year. If he’s healthy, he ironically could be the ‘safe’ pick of the bunch.

Grandal makes an appearance. Interestingly, Steamer is forecasting almost exactly the same number of Runs, RBIs and HRs this year – in the same number of at-bats – as last year, despite Grandal moving from a horrible Padres team (last year at least) to a much better Dodgers team (last year at least). I’d normally expect a bit of an uptick in those numbers.

Spoiler alert, but this is the only projection where Chirinos comes in the top 15; Steamer appears to be a bit more optimistic in projected at-bats, giving him a bump in Runs and RBIs that he doesn’t enjoy in the other projections.

Figure 3. Top 15 catchers by SGP & Pecota projections

Rank MLBAMID Full Name RSPG HRSPG RBISPG SBSPG AVGSPG Total
1 594828 Evan Gattis 4.41 4.19 4.82 0.0 -0.6 12.82
2 457763 Buster Posey 4.47 2.66 4.33 0.15 0.90 12.51
3 435263 Brian McCann 4.10 3.36 4.12 0.15 -0.78 10.93
4 431145 Russell Martin 4.85 2.38 3.30 1.16 -1.13 10.56
5 518960 Jonathan Lucroy 3.98 1.96 3.68 0.87 0.06 10.54
6 518595 Travis d’Arnaud 3.91 2.66 3.68 0.15 -0.57 9.83
7 521692 Salvador Perez 3.54 1.96 3.68 0.0 0.33 9.51
8 446308 Matt Wieters 3.66 2.38 3.57 0.29 -0.77 9.14
9 425877 Yadier Molina 3.42 1.54 3.19 0.58 0.39 9.12
10 572287 Mike Zunino 3.79 3.08 3.74 0.29 -1.79 9.1
11 543228 Yan Gomes 3.23 2.24 3.09 0.15 -0.03 8.67
12 518735 Yasmani Grandal 3.66 2.10 3.09 0.29 -0.56 8.58
13 519023 Devin Mesoraco 3.23 2.38 3.25 0.29 -0.68 8.47
14 455104 Chris Iannetta 4.04 1.96 3.19 0.44 -1.46 8.16
15 467092 Wilson Ramos 3.11 1.96 2.92 0.0 -0.26 7.73

Pecota loooooves it some Gattis, putting him in the top spot over Posey. The Pecota rankings for catchers have fairly clear tiers: Gattis and Posey at the top, a substantial gap to McCann, Martin, and Lucroy, then another gap, followed by only a point or so between d’Arnaud at #6 and Iannetta at #14. Iannetta actually only shows up here because Pecota is significantly more bullish on Iannetta across the board vs the other projection sets; this almost certainly is due to differing views on ABs; Pecota’s AB projection for Iannetta is about 80 ABs higher than the BHQ projection, and over 150 more than the Steamer projection.

The difference between the Pecota numbers for Yan Gomes and the BHQ numbers are interesting – BHQ projects Gomes as one of the top 3-4 HR hitters at the catcher spot; here he’s projected to be 8th.

Martin again gets a big SB bump, which just manages to offset a rather large Avg hit (particularly compared to, say the BHQ projection, where the Avg hit was minor). Pecota is probably looking at his .290 average last year and figuring it’s a .336 BABIP-fueled fluke; Martin hadn’t had a BABIP over .290 since 2008.

Zunino again projects to have great all-around numbers except for the black hole at Batting Average. If he somehow is able to hit even .250, Zunino would likely be a top-five fantasy play behind the plate.

Looking at all three rankings, the projections differ – sometimes significantly – on some players. The BHQ-based SGP rankings loved Yan Gomes and Mesoraco; Steamer and Pecota, not so much. At the other end of the spectrum: Salvador Perez was ranked 7th in all three projection systems, largely because he’s one of the few catchers expected to make a reasonably-sized positive contribution to batting average. Although we saw last time that maybe targeting batting average wasn’t all that important…


Fantasy Baseball: Are Some Categories More Important Than Others?

While doing some work on my pre-season projections sheet, I came across a link to complete data from Razzball – complete full-season data for 48 12-team 5×5 fantasy baseball leagues[1]. I’ve been using this as a handy cross-reference in doing some SPG (Standings Points Gained) calculations, but I decided to try and use the data to do an exercise on something I’d been thinking about: are some categories more important than others?

First, I looked at the by-category scores for all 48 first place teams, then all the second place teams, etc:

R

HR RBI SB Avg W Sv K ERA WHIP Avg score
1st pl teams

10.8

10.4 10.2 9.8 8.3 10.7 10.3 11.1 9.8 9.9

10.11

2nd pl teams

9.8

9.0 9.9 8.3 8.2 9.5 9.8 9.9 9.6 9.1

9.31

3rd pl teams

9.0

8.4 9.1 8.5 7.6 8.9 8.9 9.1 8.1 7.8

8.56

4th pl teams

8.5

8.0 8.2 7.8 7.7 7.7 7.7 7.8 7.6 7.6

7.86

5th pl teams

7.9 7.5 6.9 7.4 6.8 7.3 7.2 7.5 7.1 6.8

7.24

The 48 first place teams, on average, scored 10.11 in the 5×5 categories. So basically a top-3 finish in all categories. Not that surprising.

Digging a bit deeper, I looked at the average score in each category for 1st place teams, then for 2nd place teams, and so on. I included the standard deviation (a measure of variability) and how often a team was in the top 3 for that category:

1st Place teams R HR RBI SB Avg W Sv K ERA WHIP
Average score 10.8 10.4 10.2 9.8 8.3 10.7 10.3 11.1 9.8 9.9
Std Dev 1.6 2.1 2.3 2.3 2.9 1.7 1.8 1.2 2.2 2.0
% in top 3 77.1% 72.9% 70.8% 62.5% 41.7% 79.2% 75.0% 87.5% 64.6% 66.7%
2nd place teams R HR RBI SB Avg W Sv K ERA WHIP
Average score 9.8 9.0 9.9 8.3 8.2 9.5 9.8 9.9 9.6 9.1
Std Dev 2.0 2.6 2.0 3.0 3.2 1.9 2.3 1.9 2.4 2.6
% in top 3 58.3% 52.1% 68.8% 41.7% 43.8% 60.4% 68.8% 66.7% 62.5% 56.3%
3rd place teams R HR RBI SB Avg W Sv K ERA WHIP
Average score 9.0 8.4 9.1 8.5 7.6 8.9 8.9 9.1 8.1 7.8
Std Dev 2.5 3.1 2.3 2.8 3.2 2.5 2.6 2.1 2.8 2.7
% in top 3 54.2% 47.9% 54.2% 47.9% 33.3% 52.1% 50.0% 50.0% 39.6% 37.5%

A quick glance seems to suggest that the most important categories were Runs on the batting side, and Ks on the pitching side: the average score for the team that won their league was highest – by quite a margin, and also varied less – for those two categories. Winning teams were also more likely to be at least in the top 3 in Runs and Ks compared to any of the other batting and pitching categories, respectively.

Conversely, Batting Average did not appear to be that important – less than half of the teams that won their league were in the top 3 in Batting Average, and it had the lowest average score for champion teams of all the 5×5 categories. It was also the most volatile – with a standard deviation of 2.9, around 67% of teams that won their league would have had a Batting Average score ranging from 11.2 down to as low as 5.3!

What about second-place teams? Ks and Runs were important here as well, but without the gaps seen for winning teams. The highest-scoring category on the pitching side was again Ks, but at 9.9, this was only 0.1 higher than the second category (Saves). On the hitting side, RBIs had the highest average score at 9.9, with Runs at 9.8

There’s another way to look at the data – if you were the leader in, say, Home Runs, how likely is it that you won your league? Here’s another breakdown:

1st in category
R HR RBI SB Avg W Sv K ERA WHIP
Avg Finish 2.1 3.0 3.0 3.4 5.2 2.5 3.1 2.2 3.2 3.6
% in top 3 75.0% 58.3% 56.3% 50.0% 31.3% 60.4% 58.3% 75.0% 60.4% 54.2%
2nd in category
R HR RBI SB Avg  W Sv K ERA WHIP
Avg Finish 3.4 4.3 3.3 4.3 4.9 3.5 3.0 3.3 4.5 4.2
% in top 3 39.6% 35.4% 56.3% 31.3% 31.3% 43.8% 41.7% 43.8% 27.1% 35.4%
3rd in category
R HR RBI SB Avg  W Sv K ERA WHIP
Avg Finish 4.3 4.3 4.1 4.7 5.5 4.1 3.8 3.5 4.6 4.9
% in top 3 20.8% 31.3% 25.0% 22.9% 22.9% 31.3% 43.8% 35.4% 39.6% 29.2%

This table tells us, for example, that once again, teams that finished tops in Runs or K’s, had an average overall finish of 2.1 and 2.2, respectively: basically, they finished 1st or 2nd overall in their league, and fully 75% of teams that were first in Runs or K’s had a top-3 overall finish. (15 teams were first in both Runs and Ks – of those, 14 won the league; the lone exception came in third).

Conversely, teams that had the best Batting Average only finished 5th on average, and only 30% of teams with the best batting average were in the top 3.

I’m not showing the data here, but the reverse was also true: of the teams that were in the bottom half in the league in Runs, or in K’s, exactly none of them won the league. None. Only four teams (for both Runs and K’s) even managed a 2nd place overall finish!

On the flip side, there were 26 teams that were in the bottom half in Batting Average but 1st or 2nd overall, including 14 overall winners.

So the data appear to be telling us that we need to focus on Runs and Ks, and not worry quite as much about Batting Average. There may be some logic behind this: players scoring lots of runs are, perhaps, coming to bat more often, which means more opportunities for HRs, SBs and RBIs. Pitchers generating lots of Ks are perhaps more likely to be in position to pick up Wins and Saves and have better ratios.

While I don’t think anyone would recommend ignoring a category altogether – even Batting Average – I think the key takeaway is that in looking at roster construction, you might benefit by paying closer attention to Runs and K’s – for example, by letting those two categories be the tie-breaker if two players appear to be close in value.

Obviously, none of this is particularly new or revolutionary. And of course the usual caveats apply: 48 leagues from one particular year may or may not be a sufficient sample size to draw conclusions from. Results will almost certainly differ in some way or another for leagues with different settings (1 catcher leagues vs 2 catcher leagues, 5 outfielders & 1 util vs 3 OF and 2 util, etc). My knowledge (or lack thereof) of statistics and such could make the entire exercise completely worthless, etc.

But I, at least, found it interesting – that’s all that matters, really – and I am looking to incorporate this as I do my projections this year.

[1] 12-team, standard 5×5, 5 outfielders and one utility spot; max 180 games started for pitchers, and – at least according to Razzball – the Razzball leagues are supposed to be generally more competitive that more casual leagues.