Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Around SBN: Indy 500: Coverage of the 'Greatest Spectacle In Racing'

Evaluating SF's Pitchers by RE24 Average


I've been giving a lot of thought to the whole question of who the Giants keep when Lopez meets Affeldt in the Thunderdome this winter (though the Mota vs Zito fight also looks like a good show).

While thinking about this, I came across the RE24 statistic for pitchers. It's a very useful measure that asks: "Given the 24 base/out states, how many runs did the pitcher save in the resulting play?"

I thought to myself: "There's got to be a way to use this number."

As fate would have it, there is, and it's brilliant.

Star-divide

The problem with ERA and relief pitchers is that it doesn't measure unearned runs. A relief pitcher typically inherits runners. As it is a relief pitcher's job is to get out of a sticky situations, it's nice to have a stat like RE24 that counts a run as a run and not as a free pass because you didn't let the runner on base.

There are other problems with ERA that are solved by RE24, like the fact ground ball pitchers have an advantage over strike out / fly out pitchers, but that's beyond the scope of my post (mostly).

What is needed, however, is a way to view a pitcher's RE24 as an average across 9 innings so that it can be compared to his ERA. In other words, we want to be able to look at the difference between a pitcher's earned runs an his total runs allowed. Finally, instead of using raw RE24, we want to use RE24 divided by the base/out leverage in order to get a context neutral number, since a pitcher coming in at the start of the inning faces significantly less pressure than a pitcher who comes in with one out and two on. Thus, it's a good thing RE24/boLI is an easy stat to look up.

As I explain in the comments: For pitchers, the deleveraged RE24 average (I need a TLA for that) ultimately tells us how well a pitcher prevents runs from scoring regardless of how those runners got on base

So how do we turn RE24/boLI into a 9 inning average for comparison to ERA?

I came across one Sabermetrician's happy little formula. It works as follows:

RE24 is measured as positive or negative deviations from MLB average, so to be able to directly compare it to ERA, we need to add back in the MLB-average runs. For Stephen Strasburg for example, multiply his innings pitched (18) times the league average runs per game, (4.28/9), then subtract his RE24 (3.52) to give a number (5.04) that’s directly comparable to his runs allowed (5). But this is on a scale of R/9 rather than ERA, so to convert it to an ERA scale I multiply by the MLB ratio of ERA to R/9 (3.94/4.28). Finally, we divide by Strasburg’s IP and multiply by 9, giving us an "RE24 average" of 2.32, which can be compared directly to his ERA of 2.00.

Feel free to let your eyes glaze over as I've done the hard part.

Let's see how the SF Giants relief pitching staff looks based on their neutralized RE24 average vs earned run average.

Name RA24 Average Earned Run Average
Sergio Romo 0.75 1.50
Santiago Casilla 2.10 1.74
Ramon Ramirez 2.34 2.62
Javier Lopez 2.36 2.72
Jeremy Affeldt 2.93 2.63
Brian Wilson 3.09 3.11
Guillermo Mota 3.46 3.81

 

Whoa! Wait, what???

Yes, you read that right. In a world where relief pitchers are judged not only by their ability to get their own batters out but to keep their inherited runners from scoring as well, suddenly  the way we feel about our bullpen in 2011 makes sense... the intuitive order of skill fits.

  1. Lopez beats Affeldt
  2. Mota beats Zito (more on that in a minute)
  3. Someone needs to pay Ramirez a bonus
  4. Romo executes a fatality

 

So do we have Zito handle middle relief or is he fifth starter material?

I've gone and tabulated the starting pitchers the same way in order to correct for ERA bias towards ground ball pitchers and include unearned runs. Here's how it comes out:

 

Name RA24 Average Earned Run Average
Matt Cain 2.37 2.88
Tim Lincecum 2.85 2.74
Madison Bumgarner 3.06 3.21
Ryan Vogelsong 3.13 2.71
Jonathan Sanchez 4.68 4.26
Barry Zito 4.89 5.87
Eric Surkamp 5.82 5.74

 

Feel free to discuss that too. The short version is (a) Matt Cain really was better than Tim Lincecum, (b) There was little real difference between Sanchez and Zito, and (c) There is a reason you always felt a little less comfortable watching Ryan Vogelsong than his ERA would indicate.

This FanPost is reader-generated, and it does not necessarily reflect the views of McCovey Chronicles. If the author uses filler to achieve the minimum word requirement, a moderator may edit the FanPost for his or her own amusement.

Comment 19 comments  |  6 recs  | 

Do you like this story?

Comments

Display:

This stat seems a lot more useful for relievers than starters

Since starters typically aren’t dealing with inherited runners. Still, most of the reliever numbers make a lot of sense. Could be something to consider for sure, but I’m not entirely sure how we apply it.

I'm just a simple Giants fan trying to make my way in the universe.

by Tim Lincecum's Bong on Oct 11, 2011 6:27 PM PDT reply actions  

Two bits

With relief pitchers, it’s easy enough to cite – it’s just not a readily available statistic. You more or less have to go….

[(IP x .426) – RE24]

This gets you an RE24 by R9, which you can compare to earned runs

To compare to ERA you then multiply that figure by .92, divide by innings pitched, and multiply by 9.

…and just like that you have a much better picture of a relief pitcher’s true performance. It’s a bit like comparing RE24 to wRAA to understand situation hitting. Kind of.

In terms of what RE24 does, I wasn’t crystal clear.

It assigns run expectancy at the time of the play – so the starter gets his credit and the reliever gets theirs. Ultimately, starters get to subtract a poor relief performance using this measure.

In addition, for reasons that you can Google elsewhere, ERA is a stat that tends to favor ground-ball pitchers, so they get an unfair boost.

Finally, I like dividing the RE24 by leverage because it creates a neutral baseline for comparison.

It’s still a useful stat for starters but it doesn’t replace ERA. For relievers, it’s vastly superior.

by Ian A on Oct 11, 2011 11:01 PM PDT up reply actions  

I found this very tasty, thank you

Madison RE:24 was higher then i would have guessed, adfellts better. As for Mota i wonder how much that was result of being used as “long” man. Still fun stuff. thanks again.

The Giants are 2010 World Series Champs. … And in other news the forecast calls for a rain of toads, heavy at times, with moderate to strong swarms of locust and a high likelihood of a world quake. Details at 11.

by daveinexile on Oct 12, 2011 8:47 AM PDT reply actions  

There is no stat

That’s going to make me want Zito as a 5th starter or long reliver, unless they are in Fresno.
Cain would have a CY by now if he were on the Phils.
Bum’s scary good. He’ll have a CY within 3 seasons.
Romo should close.
I think Affeldt’s more valuable than Lopez.

Matt Cain: throwing complete game shutouts since 06'. No big deal.
Giants Baseball: increase the dosage, count back from 10.

by cain1rstballothof on Oct 12, 2011 12:28 PM PDT reply actions  

Why do you think Affeldt is more valuable than Lopez?

"He has maybe one of the best arms I've ever seen; he could be playing by the concession stand and he's not out of position." - Andy Skeels, talking about 3B Chris Dominguez.

by Lyle on Oct 12, 2011 12:51 PM PDT up reply actions  

His contract terms are more favorable (as in he's still under one, and it's way less than Lopez will get).

Also, his peripherals are comparable (arguably better, depending on how much faith you put in Lopez sustaining a 0 HR rate), and being respectable against platoon is a nice bonus.

VAE PVTO DEVS FIO

by Bhaakon on Oct 12, 2011 4:14 PM PDT up reply actions  

Affeldt goes up and down. His control seems to dictate if he is dominant or average.

Lopez is always nasty vs LH and a weird gamble vs RH hitters.

I would rather have both (sad face) but if you are going to have one, I think Affeldt’s ability to chew a whole inning all the time, is his biggest advantage.

by Myemail21479 on Oct 14, 2011 10:41 AM PDT up reply actions  

So what does RE24 do?

Does it assign a weighted value of each PA outcome to an accumulative score?

Why is it better than other stats?

It doesn’t seem like it diverges from ERA by that much, given how flukey ERA is to PA data even before you worry about inherited runners and so on. Why is it better the FIP or some other stat? Just because it loves Matt Cain?

ERA loves GBs (says google), but does RE24 also love some outcome more than others?

Get Better Travis! Ishikawa - 2009 Tops All-Star Rookie and World Champ 2010!

by kennv on Oct 13, 2011 1:36 AM PDT reply actions  

Understanding the stat

In order to really grasp RE24, one first has to understand what run expectancy is and what the 24 base/out states are. I’d recommend reading the opening pages of The Book at Amazon using the Look Inside feature.

Essentially, a base/out state describes what is happening on the diamond with the batter in the box. No outs and no one on is the first base-out state. Three outs is the 25th but we don’t use it. In the middle you have things like two outs with runners on first and third. In total, there are 24 possible base/out states.

Run expectancy is derived by looking at the number of runs that a team scores in an average game over a five year time span and dividing it by 9. This number is accepted to be at .555 runs per inning. Therefore, when the first batter comes up in an inning, the run expectancy is .555 for that base-out state.

Let’s say the first batter gets to first. We have now transitioned to the first base/out state: a runner at first with no outs. Using a similar calculation, we look at the 5 year average for run expectancy in this base-out state. As it turns out, that number is .953. In making this transition, the rune expectancy changed by .398. It doesn’t matter how the batter reached first, just that he did.

RE24, using similar math, assigns a value to each one of the events that can occur in a game during a base/out state based on how likely it is to produce a run. The difference in RE during each transition is charged to the hitter and the pitcher. When taken as a whole, this gives us a player’s RE24. For batters, RE24 indicates the likelihood that they will produce runs with their at bats given their run expectancy across all 24 states. For a pitcher, it shows the likelihood that they will prevent or allow those runs to score.

A caveat here – be careful with Fangraphs because it shows a pitcher’s offensive RE24 in the player page and does not show the pitching calculation. You have to use baseball-reference.com for that.

So what we have done with the calculation above is apply a little math to get an RE24 average the same way we would turn earned runs into an ERA. This is why the first easily understood conversion takes us to RE24 expressed as an R/9, which compares to earned runs as R/9.

A quick note on leverage: Leverage looks at what high pressure situations do to players so dividing a player’s RE24 by his base/out leverage (boLI) levels the playing field and lets us look at players as though they all faced the same 50% pressure in every at bat. The resulting stat here is bo/LI – which I suppose could be applied to ERA as well, though I haven’t seen it done.

For pitchers, the resulting RE24/boLI tells us how often they allow batters on base and how often they pitch out of that situation. For batters, it tells us what the likelihood is that they will drive in a run. As I alluded to earlier, comparing RE24 to wRAA gives us a player’s situational hitting numbers. Aubrey Huff in 2011 was pretty decent when he was at the plate solo but fell apart with runners on.

As a statistic, RE24 is a holistic look at how likely a player is to contribute to runs during a game across all the 24 base/out states instead of just the ones that we like to measure. Even if a player reaches on an error, a pitcher like Cain or Romo has the ability to get that runner out, as seen by the RE24 average being lower than the earned run average. Without RE24, you wouldn’t know that.

So while the RE24 average is an especially well pronounced metric for relief pitchers due to the fact they inherit base runners, it also works well to look at a starting pitcher’s performance across all situations over a full 5-7 innings of work. In this sense, it is a nice compliment to FIP, which seeks to take fielding out of the equation completely.

One final note – RE24 can also be expressed as REW, or a player’s contribution to a team’s wins over the 24 base/out states. This has some interesting comparisons to WPA but I’ll let you Google that one for yourself.

by Ian A on Oct 13, 2011 10:04 AM PDT up reply actions  

Correction

I said “For pitchers, the resulting RE24/boLI tells us how often they allow batters on base and how often they pitch out of that situation”

I meant “For pitchers, the resulting RE24/boLI tells us how well they prevent runs regardless of how they get on base”

It’s difficult to write that much with a clear head in this small space…

by Ian A on Oct 13, 2011 10:08 AM PDT reply actions  

this is wonderful work

and a really excellent way to look at the bullpen, I think. Very interesting read.

Adopted Giant: Mike Fontenot
He's like Grant, but fun size.
Occasionally, I tweet.

by TGOH on Oct 14, 2011 1:26 AM PDT reply actions  

Thanks T

I’m glad people enjoyed this.

I’ll re-build my situation hitting analysis when I figure out why Excel barfed on all my averages last week. Gosh, that was embarrassing.

Either way, RE24 is a very useful statistic and in a lot of ways the least artificial because it is based on sample sizes of around 5000.

by Ian A on Oct 19, 2011 10:49 AM PDT up reply actions  

A very interesting idea that needs a better name. RExA (Run Expectancy Allowed)? That’s probably not an accurate name, but at least it’s easy to say!

2010 World Series Champions!
Adopted 'nephew' to the ever avuncular and always awesome Jon Miller

by Johnny Disaster on Oct 14, 2011 11:18 AM PDT reply actions  

So here is my next question...

If we accept that Romo is the better closer and that Ramirez, Lopez, and Casillia are all capable bullpen arms… where does that leave Wilson?

Will Brian Wilson’s ego allow him to start behind Romo?

The sentimentalists will want to keep “The Beard” on the team at all cost.

A strategist will see previously unthinkable trade options during the winter meetings.

by Ian A on Oct 19, 2011 10:59 AM PDT reply actions  

Will Brian Wilson’s ego allow him to start behind Romo?

I think the bigger questions are: Will Botchey adjest he views of Wilson has his skill mature/decline?
And do we realy want him to move Romo out of the higher leverage situations that come beofre the 9th?

To the last I can say I rather the best reliever be ready to deploy any time after the 5th ( say 11 outs or less left in a game) when getting out of control. This is even more critical in the squad that can’t score many runs with an annoying frequency. I am not saying turn a team willing to over pay ( which I doubt exists in this case) but look what Sabean usually buys in position player help $6mm -$8mm (belch obp, not much iso) then look at the ability to reliably count on getting the last 6 outs with giving up a run in 2 games of the 3 game series and that is pretty reasonible return on cost.

The Giants are 2010 World Series Champs. … And in other news the forecast calls for a rain of toads, heavy at times, with moderate to strong swarms of locust and a high likelihood of a world quake. Details at 11.

by daveinexile on Oct 20, 2011 5:25 AM PDT up reply actions  

Sorry I missed this when it was posted.

Really great food for thought.

Giants baseball: So hollow, so empty.

"You don't go out with the pressure that you've gotta be perfect. It's more, 'I know I'm capable of throwing a shutout, so I should probably strive for that every time I go out. And if I don't, then I bite myself in the ass, not everybody else.' "--Tim Lincecum discussing how he deals with the shitty Giants offense.

by Sabean's_Folly on Oct 29, 2011 1:42 PM PDT reply actions  

Glad you enjoyed it

Better seen than not at all. I’ve actually written a couple of the big sites and suggested RE24 AVG (I’d call it R2A) as a stand alone statistic. It’s a much more sensible way to evaluate the bullpen and it’s got a lot of value for starters too.

by Ian A on Nov 6, 2011 3:05 PM PST up reply actions  

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation blog about San Francisco Giants.
Yahoo_full_count

Manager

174246766_ea2fd78204_small Grant Brisbee

Moderators

Sbzito_small Natto

Fawlty_small WalrusMan

Goofus_small Goofus

Howtheyscoredcat_small howtheyscored

Det_7193_small jponry

Authors

09_small JT Jordan

Small steve S

E6dmccicon_small Every6thDay