SB Nation - Login for mobile commenting

A Sea Of Blue

College Basketball: How the DSS is created and some early SEC Results

Anthony Davis and Terrence Jones showing you some defense.

Andy Lyons - Getty Images

Anthony Davis and Terrence Jones showing you some defense.

The last time I wrote a DSS post I asked if people would find it useful to see a more in-depth description of the process and the response was in favor of such an explanation. So this will be mostly dedicated to describing how I take the action on the court and translate it into the defensive results posted in the DSS. I have the results for UK's first 4 SEC games to offer by way of example and they should be of interest even if you don't want to read the rest of the piece.

The concept of the Defensive Score Sheet began with Dean Oliver and his book Basketball On Paper. Oliver at the time was working in WNBA and organized an effort to provide a more complete description of the defensive results from a game.

In a regular box score you can see who attempted every shot, every free throw, grabbed every rebound, and committed every turnover. The other side of those plays is incomplete at the individual level however - the players who forced misses are only partially available through blocks and the players who force turnovers is only partially available through steals. The players who committed the fouls that led to free throws is not available in the box score, but can be found in the play-by-play record of the game. beyond those problems, NO information is recorded regarding who (if anyone) allowed made field goals.

The goal of the DSS is to fill in this missing information.

Star-divide

Plays Recorded

There are 4 events that I determine which players were engaged defensively: free throws, turnovers, missed field goals, and made field goals. For the latter three, the defender can be a single player, multiple players, or no players if the shot was undefended or the turnover unforced. When multiple players are involved the event is evenly distributed to all of them. So for example, if 2 players challenge a shot (such as in the above picture) and it misses, they each get 0.5 of a forced miss.

  1. Free Throws: These are easy as the player who committed the foul is listed in the play-by-play record.


  2. Forced Turnovers: These are usually pretty straightforward to determine as it is typically easy to determine who applied the pressure or took the action which resulted in the turnover occurring. In order for a player to be credited with forcing a turnover they have to do something more active than simply be in the right place at the right time.


  3. Forced Missed Field Goal: These are also typically straightforward. I determine this by which player(s) were actively guarding the shot when it was taken - by getting a hand up, forcing the shooter to move to get the shot away, or some other action that hindered the shooter.

  4. Made Field Goal: These are sometimes difficult to determine exactly which players were engaged defensively on the shot. I have adopted the rule of "Who did the scorer have to beat in order to score" in order to determine which players should be legitimately charged with a made field goal allowed.

It is not always obvious which players should be considered engaged defensively on a given play. For example, if Joe Pointguard blows past Donny Defender to get to the rim and score, is Donny a defender on the shot even though he wasn't actually at the basket when it was attempted? I think he was and so he gets charged with a made field goal allowed.

What if Joe, after getting past Donny also drives past Sammy Smallforward who is guarding his own man - is Sammy a "defender" on this play since he was in physical proximity to Joe? In this case I say no, unless Sammy takes some substantial action that Joe has to avoid, such as trying to draw a charge or trying to block the shot.

This gets to a subtle point of what the DSS is trying to do: as I fill in the blanks I am *not* trying to determine if a particular player did the "right thing" or the "wrong thing" on a play. I am only trying to determine "who was engaged defensively when the play occurred." So I am not trying to judge what Sammy "should" have done - only the coach can do that - but only what he "did" do. This is similar to how the regular box score will not tell you if a player took a "good" shot or if the offensive set was run properly - only whether the shot went in or not.

Having said that, there are places where I have to make a judgment call that sometimes drift into what "should" happen.

Some Specific Situations

  • Layups: As mentioned already, when a defender gets beat for a layup, he is charged with a made field goal even if he wasn't physically present at the basket when the shot was made.
  • Offensive putbacks: To the best of my ability I try to figure out who had the block-out responsibility on the player who attempted the putback. This is usually the initial defender when the play started. If this can't be easily figured out - for example if the initial defender comes over to give help defense - then the outcome is listed as an "Undefended" play.
  • Fast breaks: One of the principle rules for defending a fast break is to first stop the ball. So in a 2-on-1 or 3-on-2 type situation, if the defenders force the initial ball handler to give up the ball then they have done their job and a made basket will be listed as an "Undefended" play.
  • Closing out on a 3 point shooter: This is by far the most difficult play to determine - it is hard to know if a defender was able to close out quickly enough to actually affect a shot attempt or not. In general I tend to attribute a forced miss when the defender is taller/longer than the shooter. Attributing made shots is harder, but I typically (though not always) list them as "Undefended" under the assumption that playing off a shooter is part of the overall defensive plan rather than a lapse by the defender.

As you can tell, there is quite a bit of subjectivity to this exercise. I think that most people would agree on roughly 85% of the defensive plays that occur in a game though. Back in November when David Hess and I each charted the UK-Kansas game, we arrived at very similar results.

Defense Box Score

After watching the game and filling in the missing information, I create a defense version of the box score. Here is one for UK's game against Arkansas.

Kentucky Defense Box Score: UK vs Arkansas
Name Min FGM FGA 3PTM 3PTA FTM FTA Def Rb Blocks TO Steals Points Fouls
T. Jones 31 2.83 7.33 0 0 3 6 8 5 1 1 8.66 3
M. Kidd-Gilchrist 24 3.5 6 1 1 0 0 3 1 0 0 8 2
A. Davis 36 2.33 12.83 0 3 0 0 10 7 0.5 0 4.66
D. Miller 21 1.5 3.5 0 0 4 6 1 0 0 0 7 4
M. Teague 36 2.34 9.84 0 4 2 2 4 0 3 3 6.68 2
D. Lamb 31 1.5 4 0 0 2 2 2 0 0.5 0 5 1
T. Beckham 4 1.5 1.5 0 0 0 0 1 0 1 1 3
E. Vargas 2 0 0.5 0 0 1 2
0 0 0 1 1
K. Wiltjer 15 1.5 1.5 1 1 0 0
0 2 0 4
Undefended 40 6 10 3 6 0 0

3
15














Totals 200 23 57 5 15 12 18 29 13 11 5 63 13

Each column corresponds to its offensive equivalent. Using Marquis Teague's line as an example:

  • Teague defended on 9.84 of Arkansas's 57 field goal attempts. The fractional part comes from when Teague and other UK players defended the same shot attempt. Of these 9.84 shot attempts, 2.34 made baskets were scored against Teague.
  • Of the 9.84 attempts, four were 3 point shots and no Arkansas player was able to hit a long distance shot over Teague.
  • Teague committed 2 fouls that resulted in 2 free throws, both of which were made.
  • Teague grabbed 4 defensive rebounds, didn't block any shots, and had 3 steals. Overall he forced 3 turnovers.
  • Teague's steal count doesn't match up with the official box score because he had a clear steal that was somehow attributed to Doron Lamb.
  • Overall, Arkansas players scored 6.68 points against Teague.

Defensive Ratings

From the defensive box score I calculate some defensive metrics that help put some context around an individual player's defensive results. Below are the composite results for UK's first 4 SEC games.

Kentucky
Ratings
Name Opp eFG% Opp TO% FTRate Stops Scores Plays Stop% DPoss% Def Rtg Opp Eff
A. Davis 31.4 15.4 12.0 35.8 21.2 57.0 0.63 0.26 90.4 76.6
M. Teague 26.3 24.0 29.5 17.2 7.7 24.9 0.69 0.11 90.7 62.9
M. Kidd-Gilchrist 36.2 23.8 8.5 16.7 9.0 25.7 0.65 0.12 91.4 74.0
T. Jones 37.4 27.6 39.6 23.0 15.6 38.6 0.60 0.20 92.5 82.0
E. Vargas 22.2 18.9 44.4 2.2 1.5 3.7 0.60 0.13 92.7 80.8
D. Lamb 59.4 14.4 43.8 11.1 11.4 22.5 0.50 0.11 95.4 111.2
D. Miller 50.0 15.4 106.3 11.2 11.8 22.9 0.49 0.16 96.6 113.3
Undefended 64.1 21.7 4.3 21.6 24.5 46.1 0.47 0.18 97.6 130.2
K. Wiltjer 80.0 25.3 66.7 4.9 6.9 11.9 0.42 0.20 100.3 126.5











SEC Totals 44.2 20.4 26.8 150.0 110.0 260.0 0.58
93.1 93.1
  • The first 3 columns are based on the 4 Factors. Staying with Marquis Teague, opponents are shooting 26.3 eFG% against him, he is forcing turnovers on 24.0% of his individual defensive possessions, and sends people to the line at a rate of 29.5 times for every 100 field goals they attempt.
  • Overall, Teague's plays have contributed to 17.2 stops and 7.7 scores allowed. Fractional values reflect that credit for stops is usually distributed among several players - one forces a miss and another grabs the rebound for instance.
  • Plays are just the sum of scores and stops, this represents the number of defensive possessions an individual was directly involved in.
  • Stop% is the percentage of time that an individual prevents the opponent from scoring any points on a possession. Teague has prevented his man from scoring and gotten the ball back for UK on 69% of his plays in SEC games.
  • Defensive Possession % (DPOSS%) is the percentage of the team's defensive possessions that a player was engaged in while he was on the floor. Teague is directly engaged on 11% of the defensive possessions the team faces when he is on the floor.
  • Defensive Rating (Def Rtg) takes an individual's total defensive effort and places it in context of what their teammates did on average. You can think of it like this: If Marquis Teague is on the floor with 4 players who are playing "UK-average" defense, this is what the overall Team Defensive Efficiency would look like if Teague was involved on 11% of all defensive possessions and stopped his man 69% of the time.
  • Opponent Efficiency: Unlike Def Rtg, this is a purely individual rating. It is simply the points allowed by the player divided by the number of defensive possessions they are engaged in, so it is like the Team Efficiency found at KenPom or StatSheet.

If you made it through all that then good for you! There are number of other people taking an interest in charting defense this way and I've included links below for some who are doing so.

1 recs  |  16 comments

Comments

I am going to sound really ignorant here, but does this thing show that Teague

was the best defender on the court yesterday?

Am I understanding that right?

No, it does not.

First of all, the bottom box is for the first four SEC games. Now, over the first four games, Teague does have the lowest Opp. Eff. (good), but he was only involved in 11% of the defensive possessions. Compare this to AD who was involved in 26% of the defensive possessions. Also, AD has the lowest Defensive Rating (good). So, the best defensive player (lowest Def. Rtg. at 90.4) is involved in the most defensive plays (26%). This is GREAT and exactly what you want. So, although Teague has the best Opp. Eff., AD has the best Def. Rtg. (that is, on the defensive side, if you could have AD plus four AD clones, that would be best). :) :) :) :)

But they are both good defenders, and Teague is obviously getting better over time.

DPoss% is a tough thing to evaluate

Big men – Jones, Davis, Vargas, etc – will by the very nature of where they play on the floor have a much higher engagement rate than guards. It is also influenced by who each player is guarding, since guarding a player who does not take part in a lot of offensive plays will lower the defender’s own rate, but obviously they will still be doing their job defensively.

not ignorant at all

Against Arkansas, when Teague engaged the player with the ball, he did a very good job at forcing missed shots, not sending players to the line, and getting some turnovers. That is all good stuff. Overall for the first 4 SEC games his individual numbers are pretty good.

We don’t know if Teague is missing some things that he is supposed to be doing, but when he does make a play he has been getting good results. Obviously there is a lot about defense that takes place away from the ball and that is not reflected here – only on-the-ball defense is recorded.

One reason why it might not match up with what you remember from games is that Teague has only been involved in 11% of the plays which is a low number.

I have found that a good rule of thumb when trying to decipher the defense box score is to imagine what the line would look like from an offensive player’s perspective. If going 3 for 10 from the field in 36 minutes and scoring 8 points with 3 turnovers would be a bad game for the offensive player, then the defender probably did a good job. (that’s using some rounded values for Teague’s line)

I'd say it shows Davis is the best

Both in the individual Arkansas box score and through 4 games of SEC play. Even though Teague has impressive numbers (his man has an eFG% of 26% and a turnover % of 24!), Davis has defended more than twice as many plays so far in conference. Apart from the numbers, I’m sure Marquis himself would credit Davis with allowing him to play tight defense on his man.

There’s not one stat above that tells you who the best defender is. JL can give you his take, but I’d pay most attention to OppTO%, DPoss%, and Def Rtg. Def Rtg is the closest thing to an all encompassing stat, if that’s what you’re looking for, but TO% lets you see how many turnovers someone is creating and DPoss% tells you how often their involved on D.

Defense is just a tough thing to evaluate

It’s hard to know how many legitimate opportunities each player has to make plays because so much of that depends on what the offense chooses to due. And beyond that it can be hard to determine just what players actually were involved.

One of the reasons I wanted to outline some of the specific situations above is to show how even seemingly simple plays such as a layup can lead to questions about who actually should be considered a “defender” on a shot.

I think your idea of picking a few categories that you like and paying attention to them is the right way to go – there just isn’t ever going to be a perfect (or even very good) all-in-one defensive rating so looking at a variety of indicators and putting them together is the best way to go.

For me, I tend to look at Stop%, eFG%, and how much better or worse the DRtg is relative to the overall Team Rating.

Thanks for all the hard work, JL

Your DSS is pretty much my favorite thing on the internet. Through your hard work, UK fans get to be on the cutting edge of basketball analysis.

Come tournament time, your stats will be extremely helpful in trying to predict which opponents might present the toughest match-ups for UK. Right now it looks like a team with two good wing scorers could be trouble, but I think Darius has got a small sample problem right now and is better than he’s shown so far. It’s entirely possible that by the end of the year this team will have no defensive weakness. Which would be entirely awesome.

Thanks KDH

I agree with you re: Miller – his SEC numbers are way out of whack with his overall numbers right now and I think most of the problem has been sending players to the line and some tough luck on shots.

Terrific description of the process you go through to make these evaluations.

I enjoy the stats and metrics – and I appreciate the time you took to explain it.

Glad you like it Griffin!
Been waiting on this but have alot of questions

I’ve been charting the UK SEC games as well using this process and I’ve been waiting to compare. Surprisingly, my chart vs Arkansas is very similar to yours. I do have some questions.

1) Could you provide more detail on the bottom chart particularly the “ratings” section with Stops, Scores Plays etc etc. I’ve read Basketball on Paper by Dean Oliver but I’m still a little lost in the specific calculations. So I have a bunch of games charted but have been unable to get to the Def Rating part.

2) Could you maybe provide charts for the other SEC games? I like to compare just to see if I have the right idea as far as charting goes.

3) So say player A drives by Teague and finishes at the hoop over Davis, Do you credit teague with a made FG or split that half-half with Davis? Conversely if player A drives past Teague and Davis comes over to block the shot do you credit Davis with a forced miss completely?

4) Another situation I was having trouble with was when a team sets a pick. Is it the players responsibility to try and fight through the pick or should the switching defender get the blame for a made fg?

5) Lastly what do you do if a player drives past one of our guys and misses? To me, that would go in the “undefended” category……I don’t think a player should get credit if their man goes by them but misses…..they should however get the blame on made shots.

Just a couple of things I was thinking about.

For 1 & 2 send me an email

3) The made field goal will get split between Teague and Davis since Player A had to beat both of them to score. Davis will get full credit for a miss since Teague did not take any action to disrupt the shot. However, if Teague stays with his man when he drives and Davis comes over to block the shot, then Davis and Teague will split the credit for the miss.

4) Picks are tricky and I haven’t figured out a rubric for handling them that I am entirely happy with. For now it usually depends on how far away the pick is from when the shot is attempted – if they are relatively close then the defender who gets picked will get charged with the outcome. If the shot takes place away from the pick and the defender can’t get to it in time then it usually goes as an “Undefended” result. This is one of the toughest things to separate what “should” happen from what “did” happen.

5) That would be an “undefended” missed shot, same as a wide open jump shot.

Cats #1! Says Who?

Jay Bilas Index.

Doug Gotliebb (sp?) thinks not. Pfttt. :-P
Correction.....Doug Gottlieb does not think.......

if he did, he might not say some of the stupid stuff he does…..lol

Great explanation, as always

Loved the read. Now, if you could explain basic calculus to me. I’ve been meaning to relearn and can barely remember limits…

You must Login with your SB Nation account and be a member of A Sea Of Blue to post a comment.