On the Bust Rate of First and Second Round NFL Draft Picks

by Cleveland Frowns on May 14, 2012

@rodofdisaster is the author of our in-season “Xs and Os with the Bros” feature. Here he is with some thoughts on expectations for first and second round NFL draft picks. Enjoy.

—————

There isn’t an NFL fan around who doesn’t at some level enjoy the strategy involved in the game, and I’d suggest that the chess match that takes place between the teams in each matchup is what keeps most of us glued to the TV on fall weekends. But of course, it helps a lot to have better players with which to execute these schemes, and nothing makes for easier second-guessing than NFL draft picks, which is why more people tune in to the NFL Draft than regular season baseball or playoff hockey.

Like many of you, I frequently listen to sports radio (NFL Radio to be exact) but I won’t listen for the two weeks before the Super Bowl and at least a week before the draft when the overanalysis and hyperbole are maddening. I don’t pay much attention to mock drafts, either. But retrospective analysis of previous drafts is another story.

Last week, I was listening to The Opening Drive with Bob Papa and Ross Tucker (weekdays 7-11 am EST) and they went through the 2008 first and second rounds. (Under the new CBA, there is an option for a fifth year on rookie contracts and this group would be up for that option under the current arrangement.)

The analysis of the second round of that draft really caught my attention. 

Check out this recap at Scout.com and tell me if you can count any more than 12 of these 32 guys as successful picks five years after the fact. Also note that TEN wide receivers were picked in the second round, with only two (DeSean Jackson and Jordy Nelson) classifiable as undebatable successes. Read some of those accolades showered on these other guys and tell me if it doesn’t make you laugh or cry.

And think: Why is it that teams covet these draft picks so much? How many times have we heard of a team not wanting to trade that second or third rounder to move up and get the guy they really want? This might be six of one, half dozen of the other, but I believe teams are less concerned with the caliber of the player they’d be losing than they are with lessening the number of chances to mitigate the poor odds. At this point it’s easy enough to say that Travis Benjamin was a worthwhile fourth-round pick, but based on historical success of fourth-round draft picks alone, his chances of being a solid #2 receiver are remote.

If you have time, I’d ask you to do what I did last week, which is go back to the 1999 draft when the new era Browns returned to the NFL, go through all of the first rounds of the draft for the ten years through 2008, and give each player an analog “yes” or “no” grade for success. There were 316 players drafted in the first round over that time. By my judgment, 155 of them (49.1%) were busts. It’s a largely subjective exercise so I am not going to tell you who the players were or what criteria I used but even if I was too harsh and off by a pair of players per year, that would remove just 20 guys and the percentage of busts would still be 43%. One would think that first round draft picks give better odds than a coin flip given the way they’re so harshly judged on a micro level, but that just doesn’t seem to be the case at all.

Food for thought amidst so much excitement over a weekend of practice without pads.

  • BIKI024

    good lord was that 2008 draft class weak or what?? if there ever is a player to prove your bust rate theory it’s Vern Golston.. i’m still baffled how he made it through Mangini’s intense pre-draft interview and evaluation?? oh wait, that was the one draft Mangini was a part of that Tannenbaum actually played the role of GM..

    interesting stuff on the 50% bust rate of 1st rounders since 99, are you going to do the same test for the latter rounds as well? would be interesting to confirm my assumption that the bust rate increases by the round..

    as far as the 2nd round receivers from 08, sadly, Eddie Royal would probably be our #1 WR…

    • Bellh001

      Ho-Hum – Revis-Ferguson-Mangold-Mack-B.Smith-D. Harris-D. Woodhead..they don’t count..just Gholston..never mind every team had him in the top 5 picks including all the experts..Ho-Hum

      • BIKI024

        it was a joke buddy. but for the record, Mike Tannenbaum was and is their GM..

        • bupalos

          Bikisan. Please to behave more respectfully at hallowed honorable site of veneration. Pointers for you to behaving.

          • BIKI024

            hai, sensei. however, you’re focusing on one part of my comment, overlooking that i had lit some osenko giving homage to Eddie Royal

      • ClevelandFrowns

        Generally could not agree with you more, Bell, and do remember that Gholston was in almost everyone’s top 5, but it should be noted that there was at least one guy who saw this bust coming: http://www.clevelandfrowns.com/2008/06/mr-bubble-goes-pop/

        • BIKI024

          i remember seeing Big Vern in the French Quarter just a short couple hours after losing the championship game.. he didn’t seem the least bit upset, quite the opposite actually. wonder if his work ethic was an issue once he got that big paycheck.

        • actovegin1armstrong

          Well played Frownie,
          You kids in the salt mines for completely inexplicable reason seem to know some stuff about arguing.

  • https://twitter.com/jimkanicki jimkanicki

    >>>I’d ask you to do what I did last week, which is go back to the 1999 draft when the new era Browns returned to the NFL, go through all of the first rounds of the draft for the ten years through 2008, and give each player an analog “yes” or “no” grade for success. >>>

    got you covered rod and one better. here is a google docs spreadsheet with every first round pick going back to 1985. i went with a binary criterion for washout: 5 years or less in league.

    my purpose was to identify the riskiest position to draft in the first round (RB by a wide margin at 34% washout rate) and the safest (OG-C at 15% washout).

    the other research project i did was to review tom heckert’s ‘magic’ since he has a reputation as a good draft guy. to me, hitting for 1st and 2nd round picks are the bogey for GMs.

    heckert was dir of player personnel from 2001 on; VP of player personnel in 2003. so if you start in 2004* and look at his ‘hits’ in rounds 3 and on.. i’m not sure the draft wizard reputation fits. i’d give him:

    nice picks in round 3 and later: jason avant, chris gocong, brent celek.

    *if the 2002 eagles draft accrues to heckert, then his record looks much better by adding brian westbrook and raheem brock to his nice pick list.

    • bupalos

      Kanick it’s worth noting in your formula that the “washout” criteria penalizes positions that have less roster spots league wide. So the higher rate for QB and RB may be partially explained by this factor vis a vis DB or OL where there is greater quantity and flexibility in spots. Teams will still gamble there because these limited spots are also higher impact. Great work though.

    • ClevelandFrowns

      Great stuff, Jim.

      So what’s the difference between Kanicki’s “washouts” and Rod’s “busts” and how do we account for the 27-percentage-point gap? Safe enough to assume that Rod’s criteria were more stringent than “last more than 5 years in the league,” but I’m interested to know more about what they were.

      • Beeej

        “last more than 5 years in the league,”

        So Gerard Warren wasn’t a bust…

        • bupalos

          Right, but that brings in my point on the position by position. If Warren was a QB or RB and similarly underperformed expectations, he would have probably gone out of the league. Compare the trajectories of Warren and Couch or Green.

          • actovegin1armstrong

            Bupa,
            I love you, but I feel the need to quote Theodore Ottaviano on this one….
            “I think you think too much”.

        • actovegin1armstrong

          I have seen Warren make some great plays since he left the bleak Lake Erie tundra

          • Beeej

            Bust/no bust is largely an issue of semantics. Warren was definitely a “bust” for Cleveland, I don’t think he has ever been to a Pro Bowl (not even bothering to research, so feel free to prove me wrong), but he has 10 years in the league. Guys like JaMarcus Russel, Ryan Leif, and…Kijana Carter are easy to label busts; others i.e. Warren, not so much. On the other hand, for where he was drafted and what he has done in the league, I wouldn’t put him down as a success story either.

          • actovegin1armstrong

            That makes sense Beeej, he was definitely a bust for the Browns and he did not deserve his lofty draft status.

    • rodofdisaster

      I’ll dive into that spreadsheet in more detail a little later on. Longevity in the league is certainly one measure of success but let’s be honest, by virtue of merely being a first round pick…that gives you some degree of staying power. Your original team (especially before the rookie wage scale) was far less likely to cut you and many times a second team that had you highly rated coming out might give you a shot thinking that they could salvage you.

      That’s not a knock just an observation that might help point us to areas of refinement. For my purposes, my main criteria were these (and they aren’t scientific either):

      1) 4+ years in league. Had to at least play out the rookie deal.
      2) Had to have worked your way in as a significant starter at some point
      3) Injuries count. No mulligans. Since this is a “yes”/”no” exercise there’s no “incompletes”.
      4) Off field issues count too. These guys have a ton of interview/background info at their disposal making the picks.
      5) Top 10 guys (for better or worse) are held to a higher standard. By definition these guys need to be impact players.
      6) I tended to be a little more lenient with offensive linemen as there aren’t a lot of measurable criteria to determine their success.

      • https://twitter.com/jimkanicki jimkanicki

        absolutely agree that bust/washout rate is a subjective thing. pro-football-reference offers a handy ‘years in league’ column that gave me a lazy way to get my arms (kinda) around the subject.

        switching gears… hey doc i have seen pretty much zero discussion on this: is weeden’s rupture of an extensor tendon in his thumb a couple years ago anything to keep an eye on?

        • BIKI024

          shouldn’t be anymore more to keep an eye on than the torn ligaments in TRich’s ankle. the human body does a pretty amazing job of rehealing itself, but the miracle of modern medicine technology certainly helps as well. Trent’s procedures were done by the infamous Dr. James Andrew while in high school.. (wonder who footed the bill?)

          but these dudes def don’t come without their scars from surgery, BW3′s been under the knife 2 or 3 times..

          • rodofdisaster

            THIS is a more compelling medical history to worry about. While Dr. Andrews is a phenom all his own, I think there are likely several dozen orthopedists in the country who are equally as good. Everybody wants to go to THE guy. Not to say his reputation isn’t deserved but there’s good sports orthopedists in most parts of the country especially if you are near a major city. It should also be noted that Andrews’ great contributions to the science have been regarding the care of knees, shoulders and elbows. Notice there’s nothing in there about ankles. Most orthopedists have alternate training for hand or foot specialties.

            Not to fret however as Dr. Andrews does accept most insurances and you can pay by credit card here:

            http://www.andrewscenters.com/getpage.php?name=insurance&sub=Patient+Info

          • BIKI024

            i’m not sure if it was Dr. Andrews or one of his previous doctors, but i do believe he was told he could never play football again. obviously they were wrong, at least for the time being.. but it’s yet another reason for the folks to fret about taking a RB that high, especially when you’re a franchise in a cursed sportstown..

          • actovegin1armstrong

            Rod’o,
            I hope that you took my last tongue in cheek diatribe in the evil spirit that it was intended. I still love you.
            I have a Dr buddy here in Austin who rips Andrews whenever Andrews drops his scope of focus below the tibial tuberoisty.

            My buddy is fantastic with the feet and ankles.
            I would put him up against the best with a Potts fracture as well.
            I am certain that you could figure it out in a minute, but I have a “guy” I prefer over Dr Andrews for knees anyway.

        • rodofdisaster

          Aside from some stiffness of the thumb, I don’t think that’s going to be much trouble. He’s got the best physical therapists in the world so I can’t imagine he’s going to be limited at this point.

  • zarathustra

    As always I am so envious of Rod’s insightfulness. I don’t follow the draft quite as closely as I used to (I was obsessed) but this all still seems very spot on to me, as I suspect it does for most with more than a passing interest on the subject. But yet, after day one most fans were desperate for a receiver. To my mind 2nd and 3rd picks were much better spent on what I perceive to be positions with much lower bust probability–rt and a rotational d-lineman. Take the project Wr with speed later as his potential may not be that significantly lower that a 2nd or 3rd rounder. (Odds are few of the many picked will make it anyway–though I suspect a closer look will reveal that a good qb substantially increases the probability for success).
    I think this stems from our tendency to vastly overestimate our own forecasting abilities. Ultimately, in these cases we are not only overestimating our own ability to evaluate players, but then ascribe shaman-like powers to the experts ability to do so. From what I can tell the best organizations are the ones that seem to play the odds better and don’t try to hit home runs with every pick.

    • bupalos

      >>>I think this stems from our tendency to vastly overestimate our own forecasting abilities. >>>

      DingDingDing.

  • Bellh001

    They all look great in helmets and shorts. Can you get off press coverage, can you recognize coverages. (Which NFL players should do) and then of course coaching comes into play..after round 1 its a 50/50 propostion..excellent post Rod

  • bupalos

    Definitely food for thought Rod. I don’t think I’m competent to really judge a lot of those picks because I frankly just don’t pay enough attention, but offhand 40-50% first round busts (or at least non-plus players) sounds right to me. I’d like to see it broken down tier by tier, like top-5, 6-10, 11-20, etc. to see what the difference is there, and if it would correlate to the way teams assign value to that additional move-up/move-back pick.

    Then you just graft that over the top of a monetary analysis, and three years down the line you’ve got Aaron Sorkin and Brad Pitt paying you for the movie rights.

    • https://twitter.com/jimkanicki jimkanicki

      fun fact — when you look at ‘top-10′ washouts by position, DE moves to the top with a 32% washout rate followed closely by RB. OT and LB are safest top-10 picks at 6 and 7% respectively.

      • bupalos

        Kuechley!!

        • jpftribe

          Junkin!!!

          Sorry, couldn’t resist, I wish no ill will on the guy.

  • Beeej

    I’d be curious to see the draft year/round for the offensive and defensive starters for teams that have made the playoffs since 99′.

  • actovegin1armstrong

    Who is this Rod’o guy?
    He is a fool as far as I am concerned, those past drafts obviously had inferior players and coaches.
    We need to put our behinds in the past and forget easily explainable, previous drafts.

    Benjamin can catch ten passes in a row through a post with his eyes closed.
    Weeden can throw an out pattern and every clay pigeon in Ohio just moved south for the duration.
    Richardson is too muscular to tackle and too short too see.
    John Hughes can stop the run, sack the QB and start an entire movie genre.

    Rod’o is crazy, the Browns got all of the good picks.

  • CleveLandThatILove

    I give Frowns an A+ for drafting Rod and Kanicki.

  • GrandRapidsRustlers

    Lerner says “compelling play and results that instill a sense of confidence that Villa is on the right track have been plainly absent.”

    You got to give the guy credit…he has fired a lot of coaches…or hired people to fire them…forget it. I’ll just drink.

  • rodofdisaster

    Another consideration that I did not mention is that when you look back on a draft class, you aren’t often going to have one where you hit on every player so defining success for the team as a whole is also elusive (obviously). Sometimes, it only takes one really solid draft to start the wheels rolling in a positive direction.

    Consider Dallas’ draft from 2005:

    1st round – OLB DeMarcus Ware
    1st round – DE Marcus Spears
    2nd round – LB Kevin Burnett
    4th round – RB Marion Barber
    4th round – DE Chris Canty
    6th round – DB Justin Beriault
    6th round – OT Rob Petitti
    7th round – DT Jay Ratliff

    That’s six solid guys who all started and contributed at some point.

    Another example is the Jets from 2006:

    1 D’Brickashaw Ferguson LT
    1 Nick Mangold C
    2 Kellen Clemens QB
    3 Anthony Schlegel LB
    3 Eric Smith S
    4 Brad Smith QB
    4 Leon Washington RB
    5 Jason Pociask TE
    6 Drew Coleman CB
    7 Titus Adams DT

    I would argue that they hit on six of these guys and Clemens is still floating around as a backup-sometime starter.

    The way I see it, if the Browns are successful with their first three picks in this draft (TRich, Weeden and Schwartz) they’re already markedly improved. If they get production out of Benjamin, James-Michael Johnson and either John Hughes or Winn…this could be a tremendous draft class which is the kind of thing that turns franchises around.

    The only thing that is worrisome to me in this logic is that to really stand a chance of sustained improvement you have to match up against your division. As an example, for all of his faults, Michael Vick is 8-2 vs the NFC East. Yes, these Browns may be better than what we have before them but are they going to threaten the AFC North?

Previous post:

Next post: