Over the last couple of weeks, I’ve been looking into how a player’s stats, age, and prospect status can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there. In the future, I plan to engineer an alternative methodology to go along with this one, that takes into account how a player performs in the majors, rather than his just getting there.

For hitters in Low-A and High-A, age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America all played a role in forecasting future success. And walk rate, while not predictive for players in A-ball, added a little bit to the model for Double-A and Triple-A hitters. Today, I’ll look into what KATOH has to say about players in Rookie leagues. Due to varying offensive environments in different years and leagues, all players’ stats were adjusted to reflect his league’s average for that year. For those interested, here’s the R output based on all players with at least 200 plate appearances in a season in Rookie ball from 1995-2007.

Just like we saw with hitters in the A-ball leagues, a player’s walk rate is not at all predictive of whether or not he’ll crack the majors. Unlike all of the other levels I’ve looked at so far, a player’s Baseball America prospect status couldn’t tell us anything about his future as a big-leaguer. This was entirely due the scarcity of top-100 prospects in the sample, as only a handful of players spent the year in rookie ball after making BA’s top-100 list.

The season is less than 40 games old for most rookie league teams, which makes it a little premature to start analyzing players’ stats. But just for kicks, here’s a look at what KATOH says about this year’s crop of rookie-ballers with at least 80 plate appearances through July 28th. This only considers players in the American rookie leagues — the Appalachian, Arizona, Gulf Coast, and Pioneer Leagues, meaning it excludes the Dominican and Venezuelan Summer Leagues. The full list of players can be found here, and you’ll find an excerpt of those who broke the 40% barrier below:

What stands out most is that KATOH doesn’t think any of these players are shoo-ins to make it to the majors. Even those who are hitting the snot out of the ball get probabilities that fall short of what we saw for unremarkable performances in Double-A. Kevin Padlo, for example, gets just a 73%, despite hitting a ridiculous .317/.463/.619 as a 17-year-old. Its hard to do much better than that. I think this really speaks to how little rookie ball stats matter in the grand scheme of things. A good offensive showing is obviously better than a poor one, but numbers from this level need to be taken with a huge grain of salt. A hitter’s performance against pitchers who are fresh out of high school just can’t tell us much about how he’ll fare when matched up against more advanced pitching at the higher levels.

Next up, I’ll complete the series by looking at stats from short-season A-ball. Teams at that level are also only a few weeks into their season, but at the very least, it will be interesting to see how KATOH feels about SS A-ballers in general. Next week, I’ll apply the KATOH model to historical prospects and highlight some of its biggest “hits” and “misses” from the past.

Statistics courtesy of FanGraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.

Over the last couple of weeks, I’ve been looking into how a players’ stats, age, and prospect status can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there. This hypothesis may be less true for players at the Triple-A level since such a high proportion of these players make it to the majors, but I still think it provides some insight. To address this issue, In the future, I plan to engineer an alternative methodology that takes into account how a player performs in the majors, rather than his just getting there.

For hitters in Low-A and High-A, age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America all played a role in forecasting future success. And walk rate, while not predictive for players in A-ball, added a little bit to the model for Double-A hitters. Today, I’ll look into what KATOH has to say about players in Triple-A leagues. Due to varying offensive environments in different years and leagues, all players’ stats were adjusted to reflect his league’s average for that year. I also only considered what happened during or after the sample season. So if a former big leaguer spends the full season in Triple-A, he’s only considered to have “made it to the majors” if he resurfaces again. For those interested, here’s the R output based on all players with at least 400 plate appearances in a season in Triple-A from 1995-2011.

This output looks pretty similar to what we saw for Double-A hitters, including the “I(Age^2)” coefficient, which adds a bit of nuance into how a players’ age can predict his future success. But in this version, there’s also an interaction between ISO and age. Basically, this says that the ability to hit for power is much more important for older players than younger players at the Triple-A league level.

By clicking here, you can see what KATOH spits out for all players who logged at least 250 PA’s in Triple-A as of July 7th. . I also included a few interesting players who missed the 250 PA cut off, including Mookie Betts, Rob Refsnyder, Ramon Flores, and Kris Bryant. Here’s an excerpt of the top players from Triple-A this year. Joc Pederson tops the charts with an impressive 99.91% probability. Many of these players have already played in the majors, so these values can be interpreted as the odds that said player will play in the majors in the future.

Now that I’ve gone through all levels of full-season ball, I’ll start at the bottom and cycle through the short-season leagues. These samples will be pretty small, but perhaps not completely useless now that those players have a few weeks’ worth of games under their belts. At the very least, it will be interesting to see what KATOH’s able to tell us about batters so far away from the big leagues, even if it’s a little premature to ask KATOH about 2014’s players.

Over the last couple of weeks, I’ve been looking into how a players’ stats, age, and prospect status can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there.

Things that were predictive for players in low-A and high-A included age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America in the pre-season. However, a player’s walk rate was not significant in predicting a player’s ascension to the majors. Today, I’ll look into what KATOH has to say about players in double-A leagues. For those interested, here’s the R output based on all players with at least 400 plate appearances in a season in double-A from 1995-2010. Due to varying offensive environments in different years and leagues, all players’ stats were adjusted to reflect his league’s average for that year.

Unlike in the A-ball iterations of KATOH, a player’s double-A walk rate is predictive — albeit only slightly — of whether or not he’ll make it to the show. While walk rate is statistically significant, it still matters much less than the other stats: it takes 3 or 4 percentage points on a player’s walk rate to match what 1 percentage point of strikeout rate does to a player’s MLB probability.

This version is also different in that there are a couple of significant interaction terms, signified by the last two coefficients in the above output. The “I(Age^2)” term adds a little bit of nuance into how a players’ age can predict his future success. While the “ISO:BA.Top.100.Prospect” term basically says that if you’re a top 100 prospect, hitting for power is slightly less important than it would be otherwise. Hitting for power and making Baseball America’s top 100 list both make a player much more likely to make it to the majors, but if he does both, he’s a tad less likely to make it than his power output and prospect status would suggest independently. Put another way, a few top 100 prospects hit for power in double-A, but never cracked the majors — such as Jason Stokes (.241 ISO), Nick Weglarz (.204 ISO) and Eric Duncan (.173 ISO). But virtually all of the low-power guys made it, including Elvis Andrus (.073 ISO), Luis Castillo (.076 ISO), and Carl Crawford (.078). For non-top 100 guys, many more punchless hitters topped out in double-A and triple-A.

By clicking here, you can see what KATOH spits out for all current prospects who logged at least 250 PA’s in double-A as of July 7th, as well as a few that fell short of the cutoff — most notably Joey Gallo, Kevin Plawecki, and Robert Refsnyder. Topping the list is Mookie Betts with a probability of 99.95%, and of course the prophesy was fulfilled when the Red Sox called up the 21-year-old last month. Here’s an excerpt of the top players from double-A this year:

Keep an eye out for the next installment, which will dive into what KATOH says about hitters at the triple-A level.

Statistics courtesy of FanGraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.

Last week, I looked into how a player’s low-A stats — along with his age and prospect status at the time — can be used to predict whether he’ll ever play in the majors. I used a methodology that I named KATOH (after Yankees prospect Gosuke Katoh), which consists of running a probit regression analysis. In a nutshell, a probit regression tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. While KATOH technically predicts the likelihood that a player will reach the majors, I’d argue it can also serve as a decent proxy for major league success. If something makes a player more likely to make the majors, there’s a good chance it also makes him more likely to succeed there.

Things that were predictive for players in low-A included: age, strikeout rate, ISO, BABIP, and whether or not he was deemed a top 100 prospect by Baseball America in the pre-season. However, a player’s walk rate was not significant in predicting a player’s ascension to the majors. Today, I’ll analyze what KATOH has to say about players in class-A-advanced leagues. Here’s the R output based on all players with at least 400 plate appearances in a season in high-A from 1995-2009:

This looks very similar to what I found for low-A players: Walk rate isn’t significant, and everything else has very similar effects on the final probability. However, the coefficients from this model are all a tad bigger than those from the low-A version, implying that high-A stats might be a bit more telling of a player’s future. Intuitively, this makes sense: The closer a player is to the big leagues, the more his stats start to reflect his future potential.

By clicking here, you can see what KATOH spits out for all current prospects who logged at least 250 PA’s in high-A as of July 7th. I also included a few notable players who fell short of the threshold, namely Joey Gallo (who checks in at a remarkable 99.8%), Peter O’Brien, and Jesse Winker. Here’s an excerpt of the top-ranking players:

Next up will be double-A. Unlike A-ball, double-A tends to be a random mishmash of prospects and minor-league lifers, so it will be interesting to see how KATOH handles this wide array of players. And perhaps double-A is where a player’s walk rate finally starts to tell us something about his future success.

Statistics courtesy of Fangraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.

For a piece I wrote a couple of weeks ago, I used historical minor league stats to to construct a model that predicts how likely it is that a teenager in A-ball will make it to the major leagues. While this method produced some interesting results, it also had some flaws, most notably that it didn’t take scouting or defense into account. This basically meant that a great defensive player — or a raw, toolsy player — could easily get an undeserving low rating if he had a poor year at the plate. Another drawback was that it only applied to teenaged players in low-A, who represent a pretty small portion of players at the level, and just a sliver of the prospect population.

With these shortcomings in mind, I’ve taken another stab at predicting which players from the South Atlantic and Midwest leagues are most and least likely to make it to the show. Like last time, I ran a probit regression, which tells us how a variety of inputs can predict the probability of an event that has two possible outcomes — such as whether or not a player will make it to the majors. But instead of limiting my analysis to players under the age of 20, I considered all players and included age as a variable in my model. I also attempted to quantify scouting by taking into account whether or not a player made Baseball America’s pre-season prospect rankings. The model still relies heavily on offensive performance, but isn’t entirely guilty of “scouting the stat line.”

It’s come to my attention that Chris St. John of Beyond the Boxscore is doing something very similar with his JAVIER projection system, and it will be interesting to see where his model and mine agree and disagree once I repeat this exercise for all minor leaguers. Chris named his system after Chicago Cubs prospect Javier Baez, so I’ll follow suit and also name mine after a prospect. Yankees’ prospect Gosuke Katoh was my original my inspiration for this idea, so I’ll call my methodology KATOH. Without further adu, here’s the resulting R output if you’re into that kind of stuff:

A player’s age, prospect status, strikeout rate, ISO, and even BABIP all proved to be predictive in the direction you’d expect. But the show-stopper here is that a player’s walk rate isn’t at all predictive of whether or not he’ll make it to the majors. One possible explanation is that — unlike power or speed — plate discipline is a skill that can be learned, and many players in low-A are still developing their batting eye and learning to lay off pitches. As one example, Brian McCann walked less than 5% of the time as a 19-year-old in the Sally League, but still developed into a relatively patient big leaguer.

Another possibility is that you don’t have to be a particularly good hitter to run a high walk rate in low-A. Pitchers at that level often have little idea where the ball’s going, which enables hitters to take an ultra-passive approach in the hopes that they’ll see four balls before they see three strikes. That strategy might work in the low minors, but can lose it’s effectiveness in the upper-levels where pitchers have a better handle on their control. I’ve included an excerpt of what KATOH spits out for modern-day players in low-A who logged at least 250 plate appearances through July 7th. The full list of qualifying players can be seen here.

Over the next couple of weeks, I plan to repeat this exercise for all levels of minor league play. As I climb the minor league ladder, it will be interesting to see when — or even if — a hitter’s walk rate starts to be predictive of whether or not he’ll make it to the majors. Keep an eye out for the next iteration, which will look at high-A stats and slap probabilities on current high-A players.

Statistics courtesy of FanGraphs, Baseball-Reference, and The Baseball Cube; Pre-season prospect lists courtesy of Baseball America.

The Charleston RiverDogs, the Yankees’ low-A affiliate, has rostered several of the team’s more interesting prospects this year, with Luis Severino, Ian Clarkin, Aaron Judge, Abiatal Avelino, Miguel Andujar, Luis Torrens, Gosuke Katoh, and Tyler Wade all having spent time in Charleston thus far. A few of these players are still teenagers, and despite having promising potential, are very raw in terms of their overall development. Despite being just 19-years-old, infielders Avelino, Andujar, Katoh, and Wade spent the entire first half in Charleston with varrying degrees of success. Avelino (108 wRC+) hit fairly well before going down with injury, but Andujar (78 wRC+), Katoh (79 wRC+), and Wade (98 wRC+) have looked a bit over-matched at the plate so far.

These players have been facing pitchers two or three years older than them, so it’s hard be too critical of their poor batting lines; and the fact that they’re even playing in full season ball as teenagers is an accomplishment on its own. Still, performance obviously matters, and you’d prefer to see them hit well than not. But it’s hard to know how much weight should be put on their stat lines. Should we be worried that Gosuke Katoh’s striking out 35% of the time? Or should we still be more focused on the tools that got him drafted in the second round last year? It’s a little hard to say.

To get a better idea of what to make of these guys’ performances, I turned to the reams of minor league data compiled over the last couple of decades. Below, you’ll find some heat maps representing the likelihood that a player will play in the majors based on his low-A stats as a teenager. “Average Power” refers to players with an ISO within .025 of their league’s average, and within each panel, walk rate above league average and strikeout rate above league average occupy the X and Y axes respectively. I considered all 321 player seasons where a teenager logged at least 400 PA’s from 1995-2008.

A couple things to keep in mind before I delve into the results:

1) This methodology measures the likelihood that a player made it to the majors and doesn’t take into account how well he played upon arriving. So a player with one big league game is counted the same as a player who went on to have a Hall of Fame-caliber career. A stat that predicts a player’s making the majors may also predict his level of big league success, but that’s not something I attempt to quantify here.

2) This methodology does not account for a player’s defensive skill or position. Obviously, a weak-hitting catcher or shortstop is more likely to crack the majors than a weak-hitting first baseman, but defensive skill is a little hard to quantify for minor leaguers. Prospects change positions all the time and there’s a good chance any given A-baller won’t stick at his current position as he navigates through three more minor league levels.

Overall, there’s not a ton of predictability here: There are examples of players who made it — or didn’t make it — from nearly every corner of every heat map. Players like Rocco Baldelli, Austin Jackson, Jhonny Peralta, and Pablo Sandoval, turned into fine hitters despite scuffling as teenagers, yet plenty of others hit for good power and put up healthy plate discipline numbers, only to flop at the higher levels. Jeff Goldbach, Nick Weglarz, and Mike Whitlock all raked in A-ball, but never made it to the show. Stats alone can’t tell us everything, but there are definitely some obvious trends. Most notably, players who hit for power appear to be much more likely to play in the majors than those who don’t. Completely ignoring strikeouts and walks, 70% players from the high power group made it to the bigs compared to 65% of players with average power and just 44% from the low power demographic. Plate discipline stats seem to matter a little, but power is clearly king.

The heat maps give a nice visual of what’s happening, but don’t really give us a precise estimate of how likely these players are to make it. To better quantify each player’s chances, I ran a probit regression analysis on this group of players. In a nutshell, a probit tells us how a variety of inputs can predict the probability of an event that has two possible outcomes. In this case, it shows that hitter’s strikeout rate, isolated power, and BABIP are predictive of whether or not he’ll play in the majors.

It’s worth pointing out that there are some obvious flaws in this model. As previously mentioned, it doesn’t consider defense, so if an elite defensive shortstop and a lumbering first baseman had the same batting line, they would receive the same probability, which obviously doesn’t seem right. It also doesn’t take scouting reports into account. We all know that there’s more to a player’s potential than his stat line, especially for minor leaguers; and in some cases, a good scouting report is worth more than a dog’s age of statistical regressions. Still, I think it does a good job of slapping an unbiased probability on a player’s MLB chances. For those interested, here’s the R output from my model:

Without getting too technical, the “Estimate” column basically tells us (in Z-scores) how a change in each stat affects a player’s MLB likelihood. As you’d expect, players with higher strikeout rates are less likely to crack the majors, while players with higher power and higher BABIPs have a better shot. Interestingly, walk rate was not statistically significant in predicting whether or not he’ll reach the big leagues. This might be partly due to the relatively small sample of players, but it’s probably safe to say that a player’s walk rate isn’t a make-or-break. Several players — including Erick Aybar, Michael Barrett, Engel Beltre, and A.J. Pierzynski — managed to reach baseball’s highest level despite walking around 3% of the time in their first tastes of full-season ball, while Mike Whitlock and Nick Weglarz fizzled after walking over 15% of the time.

That’s well and good, but what does it tell us about today’s prospects? Here’s what we get by applying my model to all low-A teenagers with at least 200 PA’s (I also included Abi Avelino, who’s logged 131). What stands out to me is how few players are true long-shots. Of the 36 players, two thirds are more likely than not to make it to the bigs and only one player gets less than a 27% chance. If a player’s talented enough to play in full season ball at 19, there’s a good chance he’ll make it to the majors one way or another.

There are some highly-touted prospects on this list, but other than J.P. Crawford, they aren’t among the names listed near the top. Reese McGuire, Dominic Smith, and Clint Frazier all graced top 100 lists in the pre-season, but have had disappointing power outputs this year, which has lead to such mediocre probabilities. Instead, most of the top ranked players are relatively fringy prospects who have broken out in a big way this year.

As for the Yankees’ prospects, the model thinks Avelino has a pretty good shot at making it, but is relatively low on the others. Even so, Andujar and Wade both have around a 50-50 chance, which isn’t too bad — especially when you consider the model ignores their defensive skills. Things don’t look as promising for Katoh, who’s struck out a ton and hit for only modest power. The lone bright spot in Katoh’s line is his 12% walk rate, which unfortunately for him, proved un-predictive of a player’s big league future.