Skip to content

Toward a culture of tolerating ignorance

June 13, 2016
by

Lately I have seen an increasingly honest, and increasingly public discussion about the feelings of inadequacy that come with trying to be a scientist.

For example, here Anshul Kogar writes about the “Crises in Confidence” that almost invariably come with trying to do a PhD.

In this really terrific account, Inna Vishik tells the story of her PhD in physics, and the various emotional phases that come with it: from “hubris” to “feeling like a fraud”.

I might as well add my own brief admissions to this discussion:

  • More or less every day, I struggle with feeling like I am insufficiently intelligent, insufficiently hardworking, and insufficiently creative to be a physicist.
  • These feelings have persisted since the beginning of my undergraduate years, and I expect them to continue in some form or another throughout the remainder of my career.
  • I often feel like what few successes I’ve had were mostly due to luck, or that I “tricked” people into believing that I was better than I actually am.

I have gradually come to understand that these kinds of feelings, as dramatic as they seem, are relatively normal.  Some degree of impostor syndrome seems to be the norm in a world where intellect is (purportedly) everything, and where you are constantly required to “sell” your work.  And I should probably make clear that I am not a person who lacks for confidence, in general.  (If you asked my wife, she might even tell you that I am an unusually, perhaps frustratingly, confident person.)

I have also come to understand that there is a place for a person like me in the scientific enterprise.  I have very real shortcomings as a scientist, both in talent and in temperament.  But everyone has shortcomings, and in science there is room for a great variety of ability and disposition.

 

There is one practice that I have found very helpful in my pursuit of a scientific career, and which I think is worth mentioning.  It’s what I call fostering a “culture of tolerating ignorance.”

Let me explain.

As a young (or even old) scientist, you continually feel embarrassed by the huge weight of things you don’t know or don’t understand.  Taking place all around you, among your colleagues, superiors, and even your students, are conversations about technical topics and ideas that you don’t understand or never learned.  And you will likely feel ashamed of your lack of knowledge.  You will experience some element of feeling like a fraud, like someone who hasn’t studied hard enough or learned quickly enough.  You will compare yourself, internally, to the sharpest minds around you, and you will wonder how you were allowed to have the same profession as them.

These kinds of feelings can kill you, and you need to find a way of dealing with them.

I have found that the best strategy is to free yourself to openly admit your ignorance.  Embrace the idea that all of us are awash in embarrassing levels of ignorance, and the quickest way to improve the situation is to admit your ignorance and find someone to teach you.

In particular, when some discussion is going on about a topic that you don’t understand, you should feel free to just admit that you don’t understand and ask someone to explain it to you.

If you find yourself on the other side of the conversation, and someone makes such an admission and request, there are only two acceptable responses:

  1. Admit that you, also, don’t understand it very well.
  2. Explain the topic as best as you can.

Most commonly, your response will be some combination of 1 and 2.  You will be able to explain some parts of the idea, and you will have to admit that there are other parts that you don’t understand well enough to explain.  But between the two of you (or, even better, a larger group) you will quickly start filling in the gaps in each others’ knowledge.

A culture where these kinds of discussions can take place is a truly wonderful thing to be a part of.  In such an environment you feel accepted and enthusiastic, and you feel yourself learning and improving very quickly.  It is also common for creative or insightful ideas to be generated in these kinds of discussions.  To me, a culture of tolerating ignorance is almost essential for enjoying my job as a scientist.

 

The enemies of this kind of ideal culture are shame and scorn.  The absolute worst way to respond to someone’s profession (or demonstration) of ignorance is to act incredulous that the person doesn’t know the idea already, and to assert that the question is obvious, trivial, and should have been learned a long time ago.  (And, of course, someone who responds this way almost never goes on to give a useful explanation.)  An environment where people respond this way is completely toxic to scientific work, and it is, sadly, very common.  My suggestion if you find yourself in such an environment to avoid the people who produce it, and to instead seek out the company of people with whom you can maintain enthusiastic and non-scornful conversations.

I have personally benefited enormously from those kinds of people and that kind of culture. At this point in my career, I would hope that I could tolerate a colleague admitting essentially any level of scientific ignorance, and that I would respond with a friendly explanation of how I think about the topic and a declaration of the limits of my own understanding.

As I see it, ignorance to essentially any degree is not a crime.  There is simply too much to know, and too many perspectives from which each idea can be understood, to shame someone for admitting to ignorance.  The only crime is professing to understand something that you don’t, or making claims that are not supported by your own limited understanding.

Good enough for me

April 16, 2016
by

Today, April 16, is the one day in the year when I use this blog for very personal purposes.  In particular, I reserve the day for remembering Virginia Tech and my time there.  (Past years’ writings are here: 1, 2, 3, 4, 5).

If you’re here for physics-related content, just hold on; a new post should be up within a few days.


On the afternoon of May 12, 2007, I almost did something terrible.

That particular Saturday was the day of my college graduation.  The physics department was holding a warm and enthusiastic ceremony for the seventeen of us who were graduating, with plenty of food and lots of cheer spread among the hundred or so people in attendance.

The dangerous part was that our valedictorian was an unusually generous person, and had offered to split the valedictory speech with me.  I probably should have declined, but I was apparently neither sufficiently polite nor sufficiently humble to do so.  And so I was slated to give a short speech as part of the ceremony.

What made this dangerous was that late April and early May of 2007 were confusing times for those of us at Virginia Tech.  During the week or so before the ceremony, as I sat down to try and draft my graduation speech, I found that I kept coming back to the themes we were all facing after the Virginia Tech shooting: loss, grief, anxiety, community, etc.

With those themes ever-present in my mind, I wrote something that was predictably awful.  Most of the specifics of what I wrote have been (graciously) lost to my memory, but you can probably imagine it easily enough: a painfully over-earnest speech that betrayed a deficit of self-awareness.  It would have been the sort of thing that drips with a sense of how moved the speaker is by himself.

To this day I still have nightmares where I find that I have become like “Mike”, the guy who threw me into an unreasonable rage by writing a terrible poem.  I guess I almost did the same thing.

But a very fortunate thing happened to me on the morning of Saturday, May 12:
I woke up feeling happy.

As it so happens, on the day of my graduation, surrounded by my family members and friends, I was happy.  I wasn’t “confused” or fragile or maudlin.  It was much more simple.  I was just happy.

And so I made the fortunate decision to ditch that terrible speech in favor of something more straightforward.

I decided to sing a song.

During college I had actually made a minor habit of writing parody songs about being a physics major and about the VT physics department. So I guess I was sufficiently well-practiced to be able to put together a song pretty quickly, in time for the ceremony.

The lyrics are reproduced below.

Now, I should probably warn you in advance that this is not a good song.  It’s full of overzealous dorkiness and now-incomprehensible inside jokes.  But I treasure the memory of standing in front of that audience and singing this song.  Because it is a memory of being happy; of feeling yourself surrounded by people who like you and care about you; and of being unashamed of who you are, and unafraid of the future.

I should mention, by the way, that our valedictorian’s half of the speech was awesome.  It was more or less entirely made up of jokes and impressions of our professors, and the whole afternoon was baked in geekish enthusiasm.

 



Good enough for me

A song for the Virginia Tech physics class of 2007

[sung to the tune of “Me and Bobby McGee”, as performed, for example, by Janis Joplin]

Standing in my cap and gown
waiting to hear my name
I’m feeling near as divided as a triplet state.
So many things I never learned,
so many tests where I got burned,
but at least I beat the high physics dropout rate.

Well my education has served me well.
It taught me some important skills,
and it taught me to avoid what I can’t do.
From Tauber’s quantum purgatory
to Mizutani’s rambling stories
I’ve mislearned more science than most people ever knew.

Well a diploma’s just a way of saying
“you’re good enough to leave
but hey, we’re not making any guarantees.”
And I may never solve a single problem
in a rotating reference frame…
But inertial frames are good enough for me.
Good enough for me to get my degree.

From the sub-basement physics lounge
to our campouts in the woods
just think of all the nerdy things we’ve done.
Text Twist games that last for months,
telling awful science puns,
yeah we’ve invented a language of our own.

Some of us can obfuscate with pictures,
but all of us speak math,
And if you say it sounds like Greek,
then I’ll have to agree.
And while we may sound pretty smart,
I’ll tell you a secret truth:
none of us know what quantum mechanics means.

Well a diploma’s just a way of saying
“you’re good enough to leave
no matter what score you got on the GRE.”
I may not know how to solve the time-dependent Schrodinger equation…
But time-independent is good enough for me.
Good enough for me to get my degree.

Well a diploma’s just a way of saying
“you’re good enough to leave
but if you want respect you’ll still need a PhD.”
And though my time here has seemed short
and it’s hard for me to leave…
Well, I guess five years were good enough for me.
Good enough for me to get my degree.

 

good_enough

 

surveyor

February 15, 2016

There used to exist a really wonderful webcomic called Pictures for Sad Children.  A few years ago its creator, John Campbell, grew tired of the project and removed all of it from the internet.  But the comic was hugely influential, and you can find most of its pieces reproduced online if you do a Google search.

Lesser known is the author’s smaller follow-up comic that was (somewhat bizarrely) themed around a fictionalized recounting of the life of the actor Michael Keaton.  This comic has also been taken down completely, and it is much harder to find any of its pieces online.

There was one of the Michael Keaton comics that I loved in particular, though, and which I managed to find using a lot of patience and the Internet Archive site.  I am reproducing it here not because I have any right to do so, but because it was too sad for me to think that it might get lost to humanity.

 

tumblr_mj90gz0Kv81rngbhio1_500 tumblr_mj90hkGYKz1rngbhio1_500 tumblr_mjaovmGylb1rngbhio1_r3_500

Game theory of vaccination

February 9, 2016

How unreasonable is it to not vaccinate your children?

I ask this not as a rhetorical question, but as a mathematical one. How do we describe, mathematically, the benefits and risks of vaccination? What does this description tell us about the reasonableness (or unreasonableness) of not vaccinating?

These days, most of the debate about vaccination is centered around questions of misinformation, misunderstanding, delusion, and conspiracy. But all this shouting obscures an interesting and very real mathematical question.

So let’s consider the dilemma of a perfectly well-informed and perfectly rational person faced with the decision of whether to vaccinate their child against some particular disease. Making this decision involves weighing issues of risk and reward, and thinking about selfishness and altruism.

Luckily for us, there is an entire mathematical science devoted to addressing these kinds of questions: the science of Game Theory.

In this post I want to take a game-theoretical look at the problem of vaccination. In particular, we’ll ask the questions: under what conditions is a disease dangerous enough that you should vaccinate? And is doing what’s best for your child different from doing what’s best for society as a whole?

kid_shot

 

Risk and Reward

The key idea in this analysis is as follows. When you vaccinate your child, you provide them with the benefit of immunity against a disease that they might encounter in the future. This benefit is potentially enormous, and life-saving.

However, if your child lives in a population where nearly everyone already has the vaccine, then the benefit of the vaccine to your child is greatly reduced. After all, if everyone around is effectively immune to the disease already, then the group’s “herd immunity” will greatly reduce the chance that your child ever gets exposed to the disease in the first place.

You might therefore be tempted to decide that even a very small risk inherent in the vaccine would make it not worthwhile. And, certainly, such risks do exist. For example, there is a very small chance that your child could have a serious allergic reaction to the vaccine, and this reaction could lead to things like deafness or permanent brain damage. If your child is already getting “herd immunity” from everyone else’s vaccination anyway, then why risk it?

Let’s consider this question in two steps. First, we’ll ask what is the optimal vaccination rate. This is the rate that maximizes the safety and well-being of the whole population. Then, we’ll ask the more pointed question: which is the decision that is best for your child alone, given that as a parent your concern is to minimize the chance of harm to your child, and not to the world as a whole.

Let’s discuss these ideas in a completely theoretical sense first, and then we’ll put some numbers to them to see how the real world compares to the theoretical ideal.

 

The optimal behavior

Imagine, first, a population where everyone is vaccinated against a particular disease except for some fraction x of non-vaccinators. Now suppose that a randomly-chosen individual gets exposed to the disease.

If the vaccine is highly effective, then the chance that this person will contract the disease is the same as the chance that they are not vaccinated: x. In the event that this person does contract the disease, then they will expose some number n of additional people to the disease. This wave of second-hand exposures will lead to a wave of third-hand exposures, and so on. At each wave there is a multiplication by n in the number of potentially exposed people, and a (hopefully small) probability x of the disease being communicated.

You can diagram the spread of the disease something like this:

epidemic

This picture illustrates the case n = 4 (i.e., every infected person exposes an average of four other people). Each branch labeled “x” shows the probability of the disease being spread at that step.

If you add up the expected number of infected people, you’ll get

(\text{total infected}) = x( 1 + n x (1 + nx(1 + ... ) ) )

(\text{total infected}) = x \sum_{i = 0}^{\infty} (n x)^i

(\text{total infected}) = x/(1 - n x)

This last equation already suggests an important conclusion. Notice that if the rate of non-vaccination, x, gets large enough that n x \geq 1, then the total number of infected people blows up (it goes to infinity).

In other words, if n x \geq 1 then the population is susceptible to epidemics. There is a very simple way to interpret this condition: n x is the average number of new people to whom a given sick person will pass their infection. If each sick person gets more than one other person sick, then the disease will keep spreading and you’ll get an epidemic.

If this condition is met, then there is no question about vaccinating. A population that is susceptible to epidemics is one where you need to get vaccinated. End of story.

But let’s assume that you live somewhere where this particular disease doesn’t cause epidemics anymore. (Like, say, mumps in the USA – more on this example below.) An absence of epidemics generally implies n x < 1, and any flare-up in the disease will be relatively small before it dies off.

Let’s say that every so often someone within the population is exposed to the disease. We’ll call this the rate of exposure, E, which can be defined as the number of initial exposures in the population per year. Combining this rate with the equation above means that

E x/(1 - n x)

people will be infected per year.

This rate of disease-induced sickness should be compared with the rate of vaccine-induced sickness. If a fraction x of people are not vaccinated, that means that N (1- x) people do get vaccinated, where N is the total number of people in the population. As a yearly rate, N(1-x)/T people are vaccinated per year, where T is the average lifetime of a person (or, if the vaccine requires periodic boosters, T is the time between successive vaccinations). Let’s suppose, further, that the vaccine makes a child sick with some probability v.

What this all means is that there are

(1-x) N v/T

vaccine-induced illnesses in the population every year.

(If you’re getting lost keeping track of all these variable names, don’t worry. Only two will matter in the end.)

From a population-wide standpoint, the optimal rate of vaccination is the one that minimizes the total amount of illness in the population per year:

F = E x/(1 - nx) + (1-x) N v/T.

Taking the derivative dF/dx of the function F and setting it equal to zero gives a solution for the optimal non-vaccination rate:

x = 1/n - \sqrt{R}/n.                                                                    (1)

Here, the variable R can be called the “relative disease risk”, and it is a combination of the variables introduced above:

R = ET/Nv.

You can think of R as the relative risk of the disease itself, as compared to the risk associated with getting the vaccine.

(The variable v should be considered to be the probability of getting sick from the vaccine, multiplied by its relative severity, as compared to the severity of the disease itself. More on this below.)

You can notice two things about the theoretically optimal non-vaccination rate, equation (1). First, the non-vaccination rate x is always smaller than 1/n. This guarantees that there are no epidemics.

Second, the rate of non-vaccination declines as the relative disease risk R increases, and at R > 1 the optimal non vaccination rate goes to zero. In other words, if the risk of the disease is large enough, and the risk of the vaccine is small enough, then the optimal thing is for everyone to get vaccinated.

 

Rational self-interested behavior

The analysis in the previous section was only concerned with the question “what is best for the world at large?” If you are asking the more limited question “what is best for my child?”, then the answer is slightly different. For this decision, you only need to weigh the probability of getting the disease against the probability of getting sick from the vaccine. The risk of conveying the illness to others doesn’t enter the analysis.

To figure out the probability of your child getting the disease, you can repeat a similar analysis to the one above: drawing out the tree of possibilities for each instance of infection. That analysis looks a lot like the picture above, except that there is one possible branch (representing your unvaccinated child) that has no protection against infection, and the rate of contracting the disease upon exposure is 1 instead of x.

The corresponding probability of your child being infected after a given initial exposure is therefore

\frac{1}{N} \sum_{i = 1}^{\infty} (x n)^i = 1/[n(1-xn)].

Since we have assumed that there are E initial exposures per year, the probability of your child getting the disease in their lifetime is E T/[N(1-xn)].

As a rational, self-interested parent, you should only vaccinate if this probability is greater than the probability v of your child getting sick from the vaccine. This means the condition for vaccination is

E T/[N (1-xn)] > v.

You can call this condition a “Nash equilibrium”, using the language of game theory. When the inequality is satisfied, vaccination is a good idea. When it is not satisfied, vaccination is a bad idea, and self-interested individuals will not do it. As a consequence, a population of rational, self-interested people will settle into a situation where the inequality is just barely satisfied, which is equivalent to

x = 1/n - R/n.                                                                           (2)

This result actually has a lot of features in common with the optimal result for vaccination. For one thing, it implies that you should always vaccinate if x > 1/n, which is the same lesson that has been repeated above: always vaccinate if there is any chance of an outbreak.

More pointedly, however, you should also always vaccinate any time the relative risk of the disease, R, is larger than 1.

In this sense the self-interested behavior is pretty closely aligned with the globally optimal behavior. The disagreement between them is a relatively mild quantitative one, and exists only when the relative disease risk R < 1.

 

Confident self-interested behavior

Now, it’s possible that you don’t accept one of the central premises of the analysis in the preceding section. I assumed above that an essentially healthy population is subject to occasional, randomly-occurring moments of “initial exposure”. In such moments it was assumed that a person is chosen at random to be exposed to the disease. Presumably this exposure has to do with either traveling to a foreign location where the disease is endemic, or with meeting someone who has just come from such a location.

You might think, however, that it is very unlikely that your child will ever be such a “primary exposure point”. Perhaps you know that your child is very unlikely to travel to any place where the disease is endemic, or to meet anyone who has come directly from such a place. If you have this kind of confidence, then the calculation changes a bit. Essentially, one needs to remove the probability of being the initial exposure point from the analysis above.

Under these assumptions, the resulting risk of contracting the disease becomes E T x n/[N(1-xn)], which is smaller than the one listed above by a factor x n. Consequently, the Nash equilibrium shifts to a higher rate of non-vaccination, given by

x = 1/[n(1+R)].                                                                           (3)

This equation satisfies the same “no epidemics” rule, but it is qualitatively different in the way it responds to increased disease risk R. Namely, there is never a point where the population achieves complete vaccination.

In other words, a population of “confident” self-interested individuals will always have some finite fraction x of vaccination holdouts, no matter how high the disease risk or how low the vaccine risk. If enough of their fellow citizens are vaccinated, these individuals will consider that the herd immunity is enough to keep them safe.

The three possible non-vaccination rates can be illustrated like this:

vaccination_graph

 

Real data: the MMR vaccine

The above discussion was completely theoretical: it outlined the ideal rate of vaccination according to a range of hypothetical decision-making criteria. Now let’s look at where the present-day USA falls among these hypotheticals. As a case-study, I’ll look at one of the more hotly-discussed vaccines: the measles-mumps-rubella (MMR) vaccine.

First of all, it is sadly necessary for me to remind people that there is absolutely no evidence for any link between MMR (or any other vaccine) and autism.

But that’s not to say that there is zero risk inherent in the MMR vaccine. In very rare cases, a vaccination can lead directly to a runaway allergic reaction, which can produce seizures, deafness, permanent brain damage, or other long-term effects. The CDC estimates these side effects to occur in at most one person per million MMR vaccinations. (In terms of the variables above, this means v = 10^{-6}.

Compare this to the combined rate of measles, mumps, and rubella infections in the USA. The average rate of occurrence of these diseases during the past five years has been something like 1200 cases per year. Given that the MMR vaccine coverage in the United States is about 92%, this implies a rate of “initial exposure” of something like 1200/0.08 = 15000/year across the entire US. (Most exposures do not lead to infection.)

Of course, most people who contract measles, mumps, or rubella recover without any permanent side effects – they just have to suffer through an unpleasant illness for a few weeks. So to make a fair comparison, I’ll discount the exposure rate by a factor that approximates only the risk of acquiring a permanent disability due to the disease. For example, about 0.3% of measles cases are fatal. For mumps, about 10% of cases lead to meningitis, and something like 20% of those result in permanent disability (such as hearing loss, epilepsy, learning disability, and behavioral problems). Finally, the main danger of rubella is associated with congenital rubella syndrome, a terribly sad condition that affects infants whose mothers contract rubella during the middle trimester of pregnancy.

Even discounting this last one, a low-side estimate is that about 1.7% of people who get measles, mumps, or rubella will suffer some form of permanent disability as a consequence. So I’ll discount the “primary exposure” rate to only E = 0.017 \times 15000 \approx 260/year.

This number should be compared to the rate of vaccine-induced disability, which is something like 4 instances/year (given that about 4 million people get the MMR vaccine per year, and about one per million gets a permanent disability from it).  Comparing these rates gives an estimate for the relative disease risk:

R \approx 70.

Pause for a moment: this is a large number.

It implies that the risk associated with actually contracting measles, mumps, or rubella is at least 70 times larger than the risk from the vaccine.

This is true even with the relatively low incidence of cases in the US, and even with the relatively robust “herd immunity” produced by our 92% vaccine coverage. R = 70 is also a low-side estimate – there are a number of other disease-related complications that I haven’t taken into account, and I haven’t made any attempt to account for the unpleasantness of getting a disease that you eventually recover from without permanent disability.

Given this large value of relative risk, we can safely conclude the current non-vaccination rate in the USA, x \approx 8%, is way too high. At such a large value of R, both the altruist and the self-interested person will agree that universal vaccination is the right thing to do.

Even the “confident self-interested” person, who believes that their child has no chance of being a point of primary exposure to the disease, will agree that the current vaccine coverage is too low to justify non-vaccination. Only at x less than 1% could such a calculation possibly justify non-vaccination in the present-day USA.

 

Conclusion

I went through this analysis because I believe that, at a theoretical level, there is room for a conversation about weighing the risks of vaccination against the benefits. It is true that in a relatively healthy population that is herd-immunized against outbreaks, a vaccine’s side effects can be a more real risk than the disease itself. It is also worth understanding that in such situations, the incentives of the altruist (who wants to minimize the risk to the world at large) are not perfectly aligned with the incentives of individual parents (who want to minimize the risk to their own child).

But in the present-day USA, these choices do not appear to be at all difficult, and there are no thorny theoretical issues to worry about. Our vaccines remain safe enough, and the disease risks remain large enough, that any level of rational quantitative thinking, self-interested or altruistic, leads to the same conclusion.

Vaccinate your kids.

 

(Unless, of course, you know that your child has some pre-existing medical condition that makes vaccination unsafe.)

What we know about the theory of optimal strategy in basketball

January 8, 2016
by

A few months ago I was asked by Mark Glickman to write a book chapter about optimal strategy in basketball.  (Mark is a senior lecturer in the Department of Statistics at Harvard, and is currently in the process of setting up a sports analytics laboratory.)

That was a sort of daunting task, so I recruited Matt Goldman as a co-author (Matt is currently working in the chief economist’s office at Microsoft, and has done some great work on optimal behavior in basketball), and together we put together a review that you can read here.  The Chapter will appear in the upcoming Handbook of Statistical Methods for Design and Analysis in Sports, one of the Chapman & Hall/CRC Handbooks of Modern Statistical Methods.

Of course, it’s likely that you don’t want to read some academic-minded book chapter.  Luckily, however, I was given the opportunity to write a short summary of the chapter for the blog Nylon Calculus (probably the greatest of the ultra-nerdy basketball blogs right now).

You can read it here.

A few things you might learn:

  • An optimal team is one where everyone’s worst shots have the same quality.
  • An optimal strategy does not generally lead to the largest expected margin of victory
  • NBA players are shockingly good at their version of the Secretary Problem

(Long-time readers of this blog might see some familiar themes from these blog posts.)

 

The value of improved offensive rebounding

January 5, 2016

In case you haven’t been paying attention to this sort of thing, the best NBA writer right now is Zach Lowe.  (Even if he has been forced by the tragic Grantland shutdown to post his columns on the super-obnoxious ESPN main site).

In a column today, Zach considered the following question: How valuable is it to try and get offensive rebounds?

Obviously, getting an offensive rebound has great value, since it effectively gives your team another chance to score.  But if you send too many players to “crash the boards” in pursuit of a rebound, you leave yourself wide open to a fast-break opportunity by the opposing team.

So there is some optimization to be done here.  One needs to weigh the benefit of increased offensive rebounding against the cost of worse transition defense.

In recent years, the consensus opinion in the NBA seems to have shifted away from a focus on offensive rebounding and towards playing it safe against fast-breaks.  In his analysis, however, Zach toys with the idea that some teams might find a strategic advantage to pursuing an opposite strategy, and putting a lot of resources into offensive rebounding.

This might very well be true, but my suspicions were raised when Zach made the following comments:

There may be real danger in banking too much on offensive rebounds. And that may be especially true for the best teams. Good teams have good offenses, and good offenses make almost half their shots. If the first shot is a decent bet to go in, perhaps the risk-reward calculus favors getting back on defense. This probably plays some role in explaining why good teams appear to avoid the offensive glass: because they’re good, not because offensive rebounding is on its face a bad thing.

Bad teams have even more incentive to crash hard; they miss more often than good teams!

Zach is right, of course, that a team with a high shooting percentage is less likely to get an offensive rebound.  But it is also true that offensive rebounds are more valuable for teams that score more effectively.  For example, if your team scores 1.2 points per possession on average, then an offensive rebound is more valuable to you than it is to a team that only scores 0.9 points per possession, since the rebound is effectively granting you one extra possession.

Put another way: both the team that shoots 100% and the team that shoots 0% have no incentive to improve their offensive rebounding.  The first has no rebounds to collect, and the second has nothing to gain by grabbing them.  I might have naively expected that a team making half its shots, as Zach mentions in his comment above, has the very most incentive to improve its offensive rebounding!

So let’s put some math to the problem, and try to answer the question: how much do you stand to gain by improving your offensive rebounding?  By the end of this post I’ll present a formula to answer this question, along with some preliminary statistical results.

 

The starting point is to map out the possible outcomes of an offensive possession.  For a given shot attempt, there are two possibilities: make or miss.  If the shot misses, there are also two possibilities: a defensive rebound, or an offensive rebound.  If the team gets the offensive rebound, then they get another shot attempt, as long as they can avoid committing a turnover before the attempt.  Let’s say that a team’s shooting percentage is p, their offensive rebound rate is r, and the turnover rate is t.

Mapping out all these possibilities in graphical form gives a diagram like this:

possession_tree

The paths through this tree (left to right) that end in x’s result in zero points.  The path that ends in o results in some number of points.  Let’s call that number v (it should be between 2 and 3, depending on how often your team shoots 3’s).  The figures written in italics at each branch represent the probabilities of following the given branch.  So, for example, the probability that you will miss the first shot and then get another attempt is (1-p) \times r \times (1-t).

Of course, once you take another shot, the whole tree of possibilities is repeated.  So the full diagram of possible outcomes is something like this:

possession_tree-long

Now there are many possible sequences of outcomes.  If you want to know the expected number of points scored, which I’ll call F, you just need to sum up the probability of ending at a green circle and multiply by v.  This is

F-offensive_rebounding

(A little calculus was used to get that last line.)

So now if you want to know how much you stand to gain by improving your offensive rebounding, you just need to look at how quickly the expected number of points scored, F, increases with the offensive rebound rate, r.  This is the derivative dF/dr, which I’ll call the “Value of Improved Offensive Rebounding”, or VIOR (since basketball nerds love to make up acr0nyms for their “advanced stats”).  It looks like this:

VIOR

Here’s how to interpret this stat: VIOR is the number of points per 100 possessions by which your scoring will increase for every percent improvement of the offensive rebound rate r.

Of course, VIOR only tells you how much the offense improves, and thus it cannot by itself tell you whether it’s worthwhile to improve your offensive rebounding.  For that you need to understand how much your defense suffers for each incremental improvement in offensive rebounding rate.  That’s a problem for another time.

But still, for curiosity’s sake, we can take a stab at estimating which current NBA teams would benefit the most, offensively, from improving their offensive rebounding.  Taking some data from basketball-reference, I get the following table:

VIOR_table

In this table the teams are sorted by their VIOR score (i.e., by how much they would benefit from improved offensive rebounding).  Columns 2-5 list the relevant statistics for calculating VIOR.

The ordering of teams seems a bit scattered, with good teams near the top and the bottom of the list, but there are a few trends that come out if you stare at the numbers long enough.

  1. First, teams that have a lower turnover rate tend to have a higher VIOR.  This seems somewhat obvious: rebounds are only valuable if you don’t turn the ball over right after getting them.
  2. Teams that shoot more 3’s also tend to have a higher VIOR.  This is presumably because shooting more 3’s allows you to maintain a high scoring efficiency (so that an additional possession is valuable) while still having lots of missed shots out there for you to collect.
  3. The teams that would most benefit from improved offensive rebounding are generally the teams that are already the best at offensive rebounding.  This seems counterintuitive, but it comes out quite clearly from the logic above.  If your team is already good at offensive rebounding, then grabbing one more offensive rebound buys you more than one additional shot attempt, on average.
    (Of course, it is also true that a team with a high offensive rebounding rate might find it especially difficult to improve that rate.)

VIOR-ORR

 

Looking at the league-average level, the takeaway is this: an NBA team generally improves on offense by about 0.62 points per 100 possessions for each percentage point increase in its offensive rebound rate.  This means that if NBA teams were to improve their offensive rebounding from 23% (where it is now) to 30% (where it was a few years ago), they would generally score about 4.3 points more per 100 possessions.

So now the remaining question is this:  are teams saving more than 4.3 points per 100 possessions by virtue of their improved transition defense?

 


Footnotes:

  1. There are, of course, plenty of ways that you can poke holes in the logic above.  For example: is the shooting percentage p really a constant, independent of whether you are shooting after an offensive rebound or before?  Is the turnover rate t a constant?  The offensive rebound rate r?  If you want to allow for all of these things to vary situationally, then you’ll need to draw a much bigger tree.

    I’m not saying that these kinds of considerations aren’t important (this is a very preliminary analysis, after all), only that I haven’t thought deeply about them.

  2. Much of the logic of this post was first laid out by Brian Tung after watching game 7 of the 2010 NBA finals, where the Lakers shot 32.5% but rebounded 42% of their own misses.
  3. I know I’ve made this point before, but I will never get over how useful Calculus is.  I use it every day of my life, and it helps me think about essentially every topic.

Field theory of swords

December 10, 2015

Note: The following is the last in a series of blog posts that I contributed to the blog ribbonfarm.  The series focused on qualitative descriptions of particles and fields, and this one finally brings the topic to a human level.  You can go here to see the original post, which contains some additional discussion in the comments.

 

I don’t mean to brag, but if you’ve been following this sequence of posts on the topic of particles and fields, then I’ve sort of taught you the secret to modern physics.

The secret goes like this:

Everything arises from fields, and fields arise from everything.


Go ahead.
You can indulge in a good eye-roll over the new-agey sound of that line.
(And over the braggadocio of the author.)

But eye-rolling aside, that line actually does refer to a very profound idea in physics. Namely, that the most fundamental object in nature is the field: a continuous, space-filling entity that has a simple mathematical structure and supports “undulations” or “ripples” that act like physical particles. (I offered a few ways to visualize fields in this post and this post.) To me, it is the most mind-blowing fact of modern physics that we call particles are really just “ripples” or “defects” on some infinite field.

But the miraculousness of fields isn’t just limited to fundamental particles. Fields also emerge at much higher levels of reality, as composite objects made from the motion of many active and jostling things. For example, one can talk about a “field” made from a large collection of electrons, atoms, molecules, cells, or even people. The “particles” in these fields are ripples or defects that move through the crowd. It is one of the miracles of science that essentially any sufficiently large group of interacting objects gives rise to simple collective excitations that behave like independent, free-moving particles.

Maybe this discussion seems excessively esoteric to you.  I can certainly understand that objection. But the truth is that the basic paradigm of particles and fields is so generic and so powerful that one can apply it to just about any level of nature.

So we might as well use it to talk about something awesome.

Let’s talk about swords.

Read more…

Follow

Get every new post delivered to your Inbox.

Join 2,665 other followers