Archive for prospects

Using Double-A Stats to Predict Future Performance

Over the last couple of weeks, I’ve been looking into how a players’ stats, age, and prospect status can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there.

Things that were predictive for players in low-A and high-A included age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America in the pre-season. However, a player’s walk rate was not significant in predicting a player’s ascension to the majors. Today, I’ll look into what KATOH has to say about players in double-A leagues. For those interested, here’s the R output based on all players with at least 400 plate appearances in a season in double-A from 1995-2010. Due to varying offensive environments in different years and leagues, all players’ stats were adjusted to reflect his league’s average for that year.

AA Output

Unlike in the A-ball iterations of KATOH, a player’s double-A walk rate is predictive — albeit only slightly — of whether or not he’ll make it to the show. While walk rate is statistically significant, it still matters much less than the other stats: it takes 3 or 4 percentage points on a player’s walk rate to match what 1 percentage point of strikeout rate does to a player’s MLB probability.

This version is also different in that there are a couple of significant interaction terms, signified by the last two coefficients in the above output. The “I(Age^2)” term adds a little bit of nuance into how a players’ age can predict his future success. While the “ISO:BA.Top.100.Prospect” term basically says that if you’re a top 100 prospect, hitting for power is slightly less important than it would be otherwise. Hitting for power and making Baseball America’s top 100 list both make a player much more likely to make it to the majors, but if he does both, he’s a tad less likely to make it than his power output and prospect status would suggest independently. Put another way, a few top 100 prospects hit for power in double-A, but never cracked the majors — such as Jason Stokes (.241 ISO), Nick Weglarz (.204 ISO) and Eric Duncan (.173 ISO). But virtually all of the low-power guys made it, including Elvis Andrus (.073 ISO), Luis Castillo (.076 ISO), and Carl Crawford (.078). For non-top 100 guys, many more punchless hitters topped out in double-A and triple-A.

By clicking here, you can see what KATOH spits out for all current prospects who logged at least 250 PA’s in double-A as of July 7th, as well as a few that fell short of the cutoff — most notably Joey Gallo, Kevin Plawecki, and Robert Refsnyder. Topping the list is Mookie Betts with a probability of 99.95%, and of course the prophesy was fulfilled when the Red Sox called up the 21-year-old last month. Here’s an excerpt of the top players from double-A this year:

Player Organization Age MLB Probability
Mookie Betts BOS 21 100%
Francisco Lindor CLE 20 100%
Gary Sanchez NYY 21 99%
Austin Hedges SDP 21 99%
Alen Hanson PIT 21 99%
Jorge Bonifacio KCR 21 98%
Blake Swihart BOS 22 98%
Kris Bryant CHC 22 93%
Ketel Marte SEA 20 91%
Rangel Ravelo CHW 22 90%
Robert Refsnyder NYY 23 86%
Jake Lamb ARI 23 85%
Jake Hager TBR 21 84%
Darnell Sweeney LAD 23 83%
Joey Gallo TEX 20 82%
Preston Tucker HOU 23 81%
Scott Schebler LAD 23 79%
Kevin Plawecki NYM 23 79%
Cheslor Cuthbert KCR 21 78%
Kyle Kubitza ATL 23 77%
Michael Taylor WSN 23 76%
Christian Walker BAL 23 76%
Ryan Brett TBR 22 75%

Keep an eye out for the next installment, which will dive into what KATOH says about hitters at the triple-A level.

Statistics courtesy of FanGraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.


Using High-A Stats to Predict Future Performance

Last week, I looked into how a player’s low-A stats — along with his age and prospect status at the time — can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there.

Things that were predictive for players in low-A included: age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America in the pre-season. However, a player’s walk rate was not significant in predicting a player’s ascension to the majors. Today, I’ll analyze what KATOH has to say about players in class-A-advanced leagues. Here’s the R output based on all players with at least 400 plate appearances in a season in high-A from 1995-2009:

High-A Output

This looks very similar to what I found for low-A players: Walk rate isn’t significant, and everything else has very similar effects on the final probability. However, the coefficients from this model are all a tad bigger than those from the low-A version, implying that high-A stats might be a bit more telling of a player’s future. Intuitively, this makes sense: The closer a player is to the big leagues, the more his stats start to reflect his future potential.

By clicking here, you can see what KATOH spits out for all current prospects who logged at least 250 PA’s in high-A as of July 7th. I also included a few notable players who fell short of the threshold, namely Joey Gallo (who checks in at a remarkable 99.8%), Peter O’Brien, and Jesse Winker. Here’s an excerpt of the top-ranking players:

Player Organization Age MLB Probability
Joey Gallo TEX 20 100%
Corey Seager LAD 20 99%
Carlos Correa HOU 19 99%
Albert Almora CHC 20 93%
Nick Williams TEX 20 93%
D.J. Peterson SEA 22 93%
Jesse Winker CIN 20 91%
Orlando Arcia MIL 19 88%
Jose Peraza ATL 20 87%
Colin Moran MIA 21 87%
Renato Nunez OAK 20 86%
Tyrone Taylor MIL 20 85%
Hunter Renfroe SDP 22 84%
Josh Bell PIT 21 84%
Raul Mondesi KCR 18 83%
Daniel Robertson OAK 20 83%
Jorge Polanco MIN 20 81%
Dilson Herrera NYM 20 77%
Breyvic Valera STL 21 77%
Peter O’Brien NYY 23 76%
Matt Olson OAK 20 75%
Jorge Alfaro TEX 21 75%
Patrick Leonard TBR 21 75%
Dalton Pompey TOR 21 73%
Billy McKinney OAK 19 73%
Teoscar Hernandez HOU 21 73%
Brandon Nimmo NYM 21 72%
Jose Rondon LAA 20 70%
Rio Ruiz HOU 20 70%
Brandon Drury ARI 21 70%

Next up will be double-A. Unlike A-ball, double-A tends to be a random mishmash of prospects and minor-league lifers, so it will be interesting to see how KATOH handles this wide array of players. And perhaps double-A is where a player’s walk rate finally starts to tell us something about his future success.

Statistics courtesy of Fangraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.


Using low-A Stats to Predict Future Performance

For a piece I wrote a couple of weeks ago, I used historical minor league stats to to construct a model that predicts how likely it is that a teenager in A-ball will make it to the major leagues. While this method produced some interesting results, it also had some flaws, most notably that it didn’t take scouting or defense into account. This basically meant that a great defensive player — or a raw, toolsy player — could easily get an undeserving low rating if he had a poor year at the plate. Another drawback was that it only applied to teenaged players in low-A, who represent a pretty small portion of players at the level, and just a sliver of the prospect population.

With these shortcomings in mind, I’ve taken another stab at predicting which players from the South Atlantic and Midwest leagues are most and least likely to make it to the show. Like last time, I ran a probit regression, which tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. But instead of limiting my analysis to players under the age of 20, I considered all players and included age as a variable in my model. I also attempted to quantify scouting by taking into account whether or not a player made Baseball America’s pre-season prospect rankings. The model still relies heavily on offensive performance, but isn’t entirely guilty of “scouting the stat line.”

It’s come to my attention that Chris St. John of Beyond the Boxscore is doing something very similar with his JAVIER projection system, and it will be interesting to see where his model and mine agree and disagree once I repeat this exercise for all minor leaguers. Chris named his system after Chicago Cubs prospect Javier Baez, so I’ll follow suit and also name mine after a prospect. Yankees’ prospect Gosuke Katoh was my original my inspiration for this idea, so I’ll call my methodology KATOH. Without further adu, here’s the resulting R output if you’re into that kind of stuff:

Low-A Output
All hitting stats were taken relative to league average and then scaled to 2014 low-A league averages.

A player’s age, prospect status, strikeout rate, ISO, and even BABIP all proved to be predictive in the direction you’d expect. But the show-stopper here is that a player’s walk rate isn’t at all predictive of whether or not he’ll make it to the majors. One possible explanation is that — unlike power or speed — plate discipline is a skill that can be learned, and many players in low-A are still developing their batting eye and learning to lay off pitches. As one example, Brian McCann walked less than 5% of the time as a 19-year-old in the Sally League, but still developed into a relatively patient big leaguer.

Another possibility is that you don’t have to be a particularly good hitter to run a high walk rate in low-A. Pitchers at that level often have little idea where the ball’s going, which enables hitters to take an ultra-passive approach in the hopes that they’ll see four balls before they see three strikes. That strategy might work in the low minors, but can lose it’s effectiveness in the upper-levels where pitchers have a better handle on their control. I’ve included an excerpt of what KATOH spits out for modern-day players in low-A who logged at least 250 plate appearances through July 7th. The full list of qualifying players can be seen here.

Player Name Organization Player’s Age MLB Probability
David Dahl COL 20 89%
Jake Bauers SDP 18 89%
J.P. Crawford PHI 19 87%
Dominic Smith NYM 19 79%
Willy Adames DET 18 78%
Chance Sisco BAL 19 74%
Reese McGuire PIT 19 73%
Andrew Velazquez ARI 19 70%
Manuel Margot BOS 19 69%
Ryan McMahon COL 19 68%
Franmil Reyes SDP 18 66%
Brett Phillips HOU 20 65%
Wendell Rijo BOS 18 64%
Carson Kelly STL 19 63%
Kean Wong TBR 19 63%
Trey Michalczewski CHW 19 62%
Clint Frazier CLE 19 62%
Clint Coulter MIL 20 62%
Evan Van Hoosier TEX 20 59%
Austin Dean MIA 20 59%
Drew Ward WSN 19 58%
Raimel Tapia COL 20 56%
Tanner Rahier CIN 20 55%
Correlle Prime COL 20 55%
Carlos Asuaje BOS 22 54%
Dustin Peterson SDP 19 54%
Jesmuel Valentin LAD 20 54%
Dawel Lugo TOR 19 54%
Avery Romero MIA 21 53%
Chad Wallach MIA 22 53%
Nomar Mazara TEX 19 52%

Over the next couple of weeks, I plan to repeat this exercise for all levels of minor league play. As I climb the minor league ladder, it will be interesting to see when — or even if — a hitter’s walk rate starts to be predictive of whether or not he’ll make it to the majors. Keep an eye out for the next iteration, which will look at high-A stats and slap probabilities on current high-A players.

Statistics courtesy of FanGraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.


How Telling are a Teenager’s A-ball Stats?

The Charleston RiverDogs, the Yankees’ low-A affiliate, has rostered several of the team’s more interesting prospects this year, with Luis Severino, Ian Clarkin, Aaron Judge, Abiatal Avelino, Miguel Andujar, Luis Torrens, Gosuke Katoh, and Tyler Wade all having spent time in Charleston thus far. A few of these players are still teenagers, and despite having promising potential, are very raw in terms of their overall development. Despite being just 19-years-old, infielders Avelino, Andujar, Katoh, and Wade spent the entire first half in Charleston with varrying degrees of success. Avelino (108 wRC+) hit fairly well before going down with injury, but Andujar (78 wRC+), Katoh (79 wRC+), and Wade (98 wRC+) have looked a bit over-matched at the plate so far.

These players have been facing pitchers two or three years older than them, so it’s hard be too critical of their poor batting lines; and the fact that they’re even playing in full season ball as teenagers is an accomplishment on its own. Still, performance obviously matters, and you’d prefer to see them hit well than not. But it’s hard to know how much weight should be put on their stat lines. Should we be worried that Gosuke Katoh’s striking out 35% of the time? Or should we still be more focused on the tools that got him drafted in the second round last year? It’s a little hard to say.

To get a better idea of what to make of these guys’ performances, I turned to the reams of minor league data compiled over the last couple of decades. Below, you’ll find some heat maps representing the likelihood that a player will play in the majors based on his low-A stats as a teenager. “Average Power” refers to players with an ISO within .025 of their league’s average, and within each panel, walk rate above league average and strikeout rate above league average occupy the X and Y axes respectively. I considered all 321 player seasons where a teenager logged at least 400 PA’s from 1995-2008.

A couple things to keep in mind before I delve into the results:

1) This methodology measures the likelihood that a player made it to the majors and doesn’t take into account how well he played upon arriving. So a player with one big league game is counted the same as a player who went on to have a Hall of Fame-caliber career. A stat that predicts a player’s making the majors may also predict his level of big league success, but that’s not something I attempt to quantify here.

2) This methodology does not account for a player’s defensive skill or position. Obviously, a weak-hitting catcher or shortstop is more likely to crack the majors than a weak-hitting first baseman, but defensive skill is a little hard to quantify for minor leaguers. Prospects change positions all the time and there’s a good chance any given A-baller won’t stick at his current position as he navigates through three more minor league levels.

All Players

Low Power

Average Power

High Power

Overall, there’s not a ton of predictability here: There are examples of players who made it — or didn’t make it — from nearly every corner of every heat map. Players like Rocco Baldelli, Austin Jackson, Jhonny Peralta, and Pablo Sandoval, turned into fine hitters despite scuffling as teenagers, yet plenty of others hit for good power and put up healthy plate discipline numbers, only to flop at the higher levels. Jeff Goldbach, Nick Weglarz, and Mike Whitlock all raked in A-ball, but never made it to the show. Stats alone can’t tell us everything, but there are definitely some obvious trends. Most notably, players who hit for power appear to be much more likely to play in the majors than those who don’t. Completely ignoring strikeouts and walks, 70% players from the high power group made it to the bigs compared to 65% of players with average power and just 44% from the low power demographic. Plate discipline stats seem to matter a little, but power is clearly king.

The heat maps give a nice visual of what’s happening, but don’t really give us a precise estimate of how likely these players are to make it. To better quantify each player’s chances, I ran a probit regression analysis on this group of players. In a nutshell, a probit tells us how a variety of inputs can predict the probability of an event that has two possible outcomes. In this case, it shows that hitter’s strikeout rate, isolated power, and BABIP are predictive of whether or not he’ll play in the majors.

It’s worth pointing out that there are some obvious flaws in this model. As previously mentioned, it doesn’t consider defense, so if an elite defensive shortstop and a lumbering first baseman had the same batting line, they would receive the same probability, which obviously doesn’t seem right. It also doesn’t take scouting reports into account. We all know that there’s more to a player’s potential than his stat line, especially for minor leaguers; and in some cases, a good scouting report is worth more than a dog’s age of statistical regressions. Still, I think it does a good job of slapping an unbiased probability on a player’s MLB chances. For those interested, here’s the R output from my model:

R Output

Without getting too technical, the “Estimate” column basically tells us (in Z-scores) how a change in each stat affects a player’s MLB likelihood. As you’d expect, players with higher strikeout rates are less likely to crack the majors, while players with higher power and higher BABIPs have a better shot. Interestingly, walk rate was not statistically significant in predicting whether or not he’ll reach the big leagues. This might be partly due to the relatively small sample of players, but it’s probably safe to say that a player’s walk rate isn’t a make-or-break. Several players — including Erick Aybar, Michael Barrett, Engel Beltre, and A.J. Pierzynski — managed to reach baseball’s highest level despite walking around 3% of the time in their first tastes of full-season ball, while Mike Whitlock and Nick Weglarz fizzled after walking over 15% of the time.

That’s well and good, but what does it tell us about today’s prospects? Here’s what we get by applying my model to all low-A teenagers with at least 200 PA’s (I also included Abi Avelino, who’s logged 131). What stands out to me is how few players are true long-shots. Of the 36 players, two thirds are more likely than not to make it to the bigs and only one player gets less than a 27% chance. If a player’s talented enough to play in full season ball at 19, there’s a good chance he’ll make it to the majors one way or another.

Player Organization MLB Probability
Jake Bauers Padres 96%
Chance Sisco Orioles 87
Ryan McMahon Rockies 86
Andrew Velazquez Diamondbacks 84
Trey Michalczewski White Sox 80
Drew Ward Nationals 79
Manuel Margot Red Sox 78
J.P. Crawford Phillies 77
Abiatal Avelino Yankees 75
Kean Wong Rays 74
Willy Adames Tigers 74
Carson Kelly Cardinals 73
Harold Ramirez Pirates 71
Nomar Mazara Rangers 67
Travis Demeritte Rangers 65
Dustin Peterson Padres 62
Wendell Rijo Red Sox 61
Franmil Reyes Padres 61
Dawel Lugo Blue Jays 60
Reese McGuire Pirates 57
Dominic Smith Mets 54
Jamie Westbrook Diamondbacks 52
Javier Betancourt Tigers 52
Tyler Wade Yankees 52
Miguel Andujar Yankees 48
Elier Hernandez Royals 48
Victor Reyes Braves 47
Clint Frazier Indians 46
Alfredo Escalera-Maldonado Royals 42
Dorssys Paulino Indians 41
Ronald Guzman Rangers 41
Josh Van Meter Padres 39
Carlos Tocci Phillies 37
D.J. Davis Blue Jays 27
Gosuke Katoh Yankees 27
Jairo Beras Rangers 16

 

There are some highly-touted prospects on this list, but other than J.P. Crawford, they aren’t among the names listed near the top. Reese McGuire, Dominic Smith, and Clint Frazier all graced top 100 lists in the pre-season, but have had disappointing power outputs this year, which has lead to such mediocre probabilities. Instead, most of the top ranked players are relatively fringy prospects who have broken out in a big way this year.

As for the Yankees’ prospects, the model thinks Avelino has a pretty good shot at making it, but is relatively low on the others. Even so, Andujar and Wade both have around a 50-50 chance, which isn’t too bad — especially when you consider the model ignores their defensive skills. Things don’t look as promising for Katoh, who’s struck out a ton and hit for only modest power. The lone bright spot in Katoh’s line is his 12% walk rate, which unfortunately for him, proved un-predictive of a player’s big league future.


What the Cubs Need to Do to Be Successful

The Chicago Cubs have gotten off to a very slow start in the 2013-14 season scoring a total of 9 runs in their first 5 games and as a result of that they are 1-4. The buzz around the city of Chicago is all about the excitement of top prospects Javier Baez, Albert Almora, and Kris Bryant tearing up minor league pitching and rapidly moving up in the Cubs System. All of these players have fantastic stats but the stats don’t truly matter until these players can be productive big league players. The problem is is that these prospects have shown day in and day out that they are ready to move on to the bigs. Almora, might not be quite there yet but Baez and Bryant have proven they are by dominating minor league pitching and posting good spring training numbers. Cubs GM Theo Epstein won’t pull the trigger on sending these guys up. Bringing these players up will significantly improve the quality of the team but many more changes will need to take place in order for the Cubs to be a team to win games on a consistent basis. Here are 3 other things that need to happen for the cubs to start their path to being successful

1. The cubs need to find a reliable, all-around, everyday 2nd baseman. There are many different solutions the their problem at 2nd but first let’s establish what the problem is. Darwin Barney has proven that he is an excellent fielding 2nd baseman but he is an absolutely horrendous hitter. In 2013, Barney posted an atrocious slash line of .208/.266/.303. Not only does this show that he rarely gets hits or gets on base, but when he does it’s mostly because singles. The Cubs have many possible solutions to this problem. One possible solution is to bring up Javier Baez and play him at short and Starlin Castro at 2nd or vice versa. Doing this might slightly weaken the 2nd base spot defensively, but drastically improve it offensively. With the Cubs pitching being surprisingly good in the first few games of 2014, their offense is a glaring problem and Baez would improve it instantaneously.

Another solution would be to slide Luis Valbuena over to 2nd and make Mike Olt the everyday 3rd baseman. Currently, Olt and Valbuena are splitting time at third which is detrimental to the team because both players have shown offensive value to the cubs. Valbuena had an excellent eye and has proven to be adept at drawing walks. He also has shown solid power as he hit 12 homeruns in 108 games in 2013. Olt has also shown the ability to hit for power as he had 5 homeruns in a very good spring training that earned him a spot on the opening day roster. Either of these solutions would be a much better fit for the Cubs then having Barney as the everyday 2nd baseman.

2. If the Cubs want to be good now, their bullpen needs to be consistent, and deeper. The bullpen has been a problem for the Cubs for a very long time. However in 2014 they might show some signs of improvement. In 2013, reliever Pedro Strop Posted a solid 2.83 ERA in 35 innings with the Cubs. In his time in Chicago, he only gave up 11 earned runs, 5 of which were in one performance. Along with solid numbers Strop possesses a 97 MPH power sinker in addition to his best pitch which is his slider. Strop will be put into a much bigger role this season and if the cubs want to succeed he will need to continue to pitch at a high level. In the offseason the cubs also signed lefty Wesley Wright and Jose Veras who in recent history have proven themselves as reliable bullpen options to their clubs. Players like Brian Schlitter and Hector Rondon will also need to step up for the Cubs. If Strop can continue pitching at a high level and the rest of the pen can consistently pitch in late innings. The Cubs will improve as a team very much.

3. Lastly if the Cubs want to succeed Anthony Rizzo and Starlin Castro must have bounce back years. There are many things that I could criticize about these 2 players but there a few problems in their games that are in the most need of fixing. In 2013 Rizzo only hit .233 if Rizzo continues to hit in the heart of the cubs line up, a .233 average is unacceptable. If he was hitting 50 homeruns it might be a different story but .233 with only 23 HRs isn’t going to cut it. In order for the Cubs to succeed, Rizzo will either need to hit 10-15 more homers or improve is average by around 30 points.

Starlin Castro is a much bigger problem for the Cubs. Spending most of the season in the 3 spot, Castro posted a weak slash of .245/.284/.347. Castro’s numbers were only a bit better than Barney’s which makes him a big problem. In addition to his poor offensive play, Castro has been an extremely inconsistent defensive SS his entire career. There is optimism for Castro though. In Castro’s first 2 full big league seasons, he was voted to the All-Star Game and hit close to .300 in both of those seasons. Castro has shown in his career that he has the ability to hit, the question. is will he be able to have seasons reminiscent to his all-star years. Only time will tell for Castro but if he can bounce back along with Rizzo the Cubs might actually be a legitimate team.

Although many things need to happen for the Cubs to be a playoff contender, fans should be optimistic for the future. With a farm system fortified with elite prospects throughout and an improving bullpen, the cubs need their “key players” to perform at a higher level. If all of these things can happen, there might be October baseball played at Wrigley sometime in the near future.