EMPTY STATISTICS

Narratives without statistics are blind, but statistics without narratives are empty.

(Steven Pinker, The Better Angels of Our Nature)

Reasonable people have said that one should pay attention when Nassim Taleb speaks. I don’t understand why. Some have even put him on a par with the venerated scientist and science writer Steven Pinker, calling both ‘intellectual titans’. The designation is well-deserved for Pinker, but much less so for Nassim Taleb, as his recent tactics in his war against the former prove.

A couple of years ago, Steven Pinker wrote a thoroughly researched and carefully argued book on the decline of violence, backing his theses by tons of data, virtually all pointing strongly to the same conclusion: yes, violence has declined throughout the centuries and keeps declining.

The conclusion may surprise us, given the daily reports of murder, terrorist attacks and other indiscriminate killing on TV, internet and in the newspapers; providing us with unmistakable proof of the dark side of humanity. What’s usually left out of these reports is the violence committed by our ancestors. People seem to forget that ‘violence has declined’ doesn’t mean ‘violence has gone’. It means that, whatever the current level is, it used to be much worse. And that’s what Steven Pinker, in line with historians and other scholars before him, amply demonstrates.

Keep in mind Pinker isn’t just talking about war. Violence can be in any form and on any scale. In addition to military conflict, Pinker discusses human sacrifice, homicide, torture, capital punishment, slavery, dueling, the treatment of homosexuals and ethnic minorities, wife battery and child abuse, animal cruelty,… Yes, bullfights are still cruel and pointless (and increasingly controversial), but did you know that cats were burned alive for popular entertainment in the Middle Ages? You get the idea…

Also important to note, Pinker discusses a number of parallel trends that may help explain the decline in violence. Our forefathers’ culture of honor and glory has gone out of fashion in the developed world. Democracy has gained a strong foothold. The global economy has turned international peace into a positive-sum game. The Enlightenment, humanism and the success of civil rights movements have made a lasting impact on contemporary law and morality. Technological innovation – not just the internet and TV, but much earlier: mass production of books after the invention of the printing press in the 15th century – enabled humans to gradually widen their circle of empathy from next of kin or small neighborhood to just about any being that’s capable of suffering.

In sum, the decline of violence is not a statistical fluke captured by a small number of catchy but otherwise insignificant charts. It’s a coherent theory explaining not only the charts but also our contemporary mindset and moral sensitivities; and it’s based on political realities like international law and organizations. Is the [more than 70-year] absence of war between France and Germany a freakish streak of luck, Pinker asks in a rebuttal to Taleb, or could the Long Peace be more than a statistical illusion? Even if you can’t put a number to it, the decreased probability of war inside the European Union should be obvious to everyone with an elementary knowledge of politics and history. Is it that reckless an extrapolation, then, to propose that strong international ties, be they political, economic, cultural or other, are likely to have a similar effect on a global scale? What about the freezing of national borders by international law? The abolishment of military conscription? Article 9 in the Japanese constitution, banning the use of war as a means to settle international disputes? And similar constitutional restrictions on military intervention in Germany? Is all of that, and much more, irrelevant?? To Nassim Taleb it is, apparently.

Let me first give an overview of the hostilities between Taleb and Pinker, then I’ll elaborate on Taleb’s recent statistical smokescreen.

Act one: After he – sort of – read Pinker’s The Better Angels of Our Nature, Nassim Taleb ( The “Long Peace” is a Statistical Illusion) accuses Pinker of ‘not having a clear idea of the difference between science and journalism, or the one between rigorous empiricism and anecdotal statements’, of ‘using mechanistic techniques of statistics without understanding the properties of the statistical claims’. Taleb gives a confused explanation of ‘the difference between M* and M’ (sample mean and true mean, respectively), and uses ‘journalism’ as a term of abuse for science writing that purportedly ignores the difference. He says ‘Working with M* cannot be called “empiricism”‘. Hmm, should we “work” with the unobserved M instead? And use a philosophical argument to estimate it? But Taleb is convinced that ‘what I just wrote is at the foundation of statistics’.

His comments about M and M* are quite revealing; they expose his dilettantism as well as his muddled mind. But his characterization of bland factual statements as ‘statistical fallacies’ borders on the insane. For example, in one of his Facebook posts on the “Pinker fallacy”:

‘This afternoon, to kill time on a long flight I decided to look for scientistojournalistic fallacies so I went to Steven Pinker’s twitter account. I immediately found one there. (Heuristic: go to Pinker). He promotes there a WSJ article to the effect that “Terrorism kills far fewer people than falls from ladders”; the article was written by a war correspondant [sic] […]Now let’s try a bullshit-detecting probabilistic reasoning.

A- Falls from ladder are thin-tailed, and the estimate based on past observations should hold for the next year with an astonishing accuracy.[…]

B- Terrorism is fat tailed. Your estimation from past data has monstrous errors. A record of the people who died last few years has very very little predictive powers of how many will die the next year, and is biased downward. One biological event can decimate the population.

May be “reasonable” to claim that terrorism is overhyped, that our liberty is more valuable, etc. I believe so. But the comparison here is a fallacy and sloppy thinking is dangerous.’ (emphasis added)

To a normal person, the statement ‘terrorism kills far fewer people than falls from ladders’ means a purely factual statement about the number of casualties over a specified period in the past. But Taleb immediately detects a prediction about the future and calls the “inference” a fallacy. Sloppy thinking is dangerous, I agree with him on that point. His penchant for reading things that aren’t said can lead to hilarious lecturing such as this (emphasis added):

‘[I]n the thesis by Steven Pinker that the world is becoming less violent, we note a fallacious inference about the concentration of damage from wars from ^Kq
(quantile contribution estimator, JV) with minutely small population in relation to the fat-tailedness.’ (The Long Peace is a Statistical Illusion, p.8)

Wow, did you note that inference too?? If not, you’re obviously not a member of Taleb’s cult, so consider yourself lucky.

Act two: Pinker defends himself in a rebuttal on his website. If you seriously think that Taleb has, or may have, a point against Pinker, then you should really read that paper. In it, Pinker exposes Taleb’s confusions and denies his false attributions. Regarding the purported fallacious extrapolations to the future, Pinker reminds us what he literally wrote:

As mentioned, from reading Taleb one might think that Better Angels misused complex statistics to extrapolate confident predictions about an Age of Aquarius in which major wars are impossible. […] The book explicitly, adamantly, and repeatedly denies that major violent shocks cannot happen in the future; this reticence is stated in the book’s opening paragraph and echoed in every summation.

Let me give his defense more force by quoting directly from the book (The Better Angels, p. 361-362) (emphasis in original):

I am sometimes asked, “How do you know there won’t be a war tomorrow (or a genocide, or an act of terrorism) that will refute your whole thesis?” The question misses the point of this book. The point is not that we have entered an Age of Aquarius in which every last earthling has been pacified forever. It is that substantial reductions in violence have taken place, and it is important to understand them.[…] If the conditions reverse, violence could go right back up.[…]

The statistics of power-law distributions and the events of the past two centuries agree in telling us that a small number of perpetrators can cause a great deal of damage. If somewhere among the world’s six billion people there is a zealot who gets his hands on a stray nuclear bomb, he could single-handedly send the statistics through the roof. But even if he did, we would still need an explanation of why homicide rates fell a hundredfold, why slave markets and debtors’ prisons have vanished, […]

The goal of this book is to explain the facts of the past and present, not to augur the hypotheticals of the future. […] My point […] is that the concept of scientific prediction is meaningless when it comes to a single event […] The truth is, I don’t know what will happen across the entire world in the coming decades, and neither does anyone else.

Either Taleb didn’t read these (and many other) pages, or his deliberate dyslexia is a symptom of his bellicosity.

Act three: Taleb adds a note to his ‘Long Peace’ paper about Pinker’s reply, calling it ‘ad hominem blather’. Why ad hominem? Because it was too long!! These are his exact words:

Pinker has written a rebuttal (ad hominem blather, if he had a point he would have written something 1/3 of this, not 3 x the words)

Act four: Taleb teams up with Pasquale Cirillo (Who is he? Presumably one of the many bright and hard-working fellows who’re happy to put aside scientific rigor and integrity in exchange for the opportunity to ride on Taleb’s coattails). Their joint paper ‘On the statistical properties and tail risk of violent conflicts‘ is supposed to give mathematical support to Taleb’s incriminations.

I can understand Taleb’s admirers are impressed by the obscure mathematical formulas; it’s not easy to assess the paper on its merits without a solid background in statistics. But they’d better not celebrate the triumph of their idol too soon. The more so because there are a number of strong clues that Taleb & Cirillo (TC) cut a lot of corners in arriving at their conclusion; clues that require no mathematical expertise to see them. Merely reading Pinker’s book should make one suspicious of the claims attributed to him in TC’s paper.

But if you do have a background in statistics, it’s easy to understand why Taleb shuns the formal peer-review process (‘research mafia’, as he calls it). His work contains so many flaws it wouldn’t stand a chance of getting accepted to any peer-reviewed journal that respects itself. Let’s turn to the Taleb & Cirillo (TC) paper now.

First of all, it suffers from ambiguous, flexible and inconsistent definitions. Most notably: how do you define violence? Without motivation, TC narrow the debate down to an argument about armed conflicts. They don’t say a word about any of the other manifestations of violence discussed by Pinker (see above). In the beginning of their paper, they narrow the topic further down to ‘events with more than 3000 casualties’. Why? Because of availability and reliability of historical records, they say, but also because:

‘the object of our concern is tail risk. The extreme value techniques we use to study the right tail of the distribution of war casualties imposition [sic] of thresholds, actually even larger than 3000 casualties.

That seems to be the main reason: TC love to ride their fat-tailed hobbyhorse so much that more mundane events like homicide rates, for example, aren’t worthy of their attention. Not just that, further on in the paper, they even raise the bar to 25,000 (or 145,000) casualties, for technical reasons (briefly, it allows them to introduce a ‘novel approach to apply extreme value theory’, the dual distribution). All of that is fine, but then they shouldn’t present their conclusions as a refutation of a broad thesis covering violence on many scales.

Another ambiguity involves the distinction between the likelihood of wars and their magnitudes (number of casualties). TC are vague about what exact claims are made by the cited books or articles. They devote several pages to showing that the distribution of casualties forms a power law (there’s a large number of small wars, a small number of big wars; for increasing number of casualties N, the probability of wars with more than N casualties decreases much slower than N increases, so that the probability of a highly destructive war never vanishes). They could have spared themselves the trouble, because Pinker already demonstrated and explained exactly the same pattern in great detail (‘Statistics of deadly quarrels, part 2’). TC fail to mention that, making it seem as if everything they demonstrate contradicts Pinker.

Similarly for the statistics involving the timing of wars (onset and duration). Pinker shows that wars start and stop at random – they follow a Poisson process, i.e. a random process characterized by independence between successive events: the probability that a war starts today doesn’t depend on, for example, how long we haven’t had a war anymore (independence thus refutes the naïve ‘hydraulic’ view of war, that a long bout of peace increases the likelihood of a new war). Thus, a Poisson process is said to be ‘memoryless’. A further distinction can be made between a stationary (homogeneous) or non-stationary Poisson process. When the probability (of a war starting or stopping) remains constant, the process is said to be stationary.

So, what are TC’s conclusions?

One cannot observe any specific trend in the number of conflicts, as large wars appear to follow a homogeneous Poisson process. This memorylessness in the data conflicts with the idea that war violence has declined over time, as proposed by [Pinker].’

OK, no disagreement about the Poisson process then – not sure if that’s clear to the reader. In the second sentence they confuse stationarity (= homogeneity) with memorylessness. As said, all Poisson processes share the property of memorylessness, whether they are stationary or not. Thus, the fact that the process is shown to be memoryless doesn’t contradict anything Pinker said, on the contrary. They make a similar mistake near the end of their paper: the autocorrelogram shows no time dependence among interarrival times, which they see as evidence for a homogeneous Poisson process. A more or less flat autocorrelogram indeed suggests a Poisson distribution (because it confirms the memorylessness property), but it says very little about stationarity. Pinker ‘the journalist’ makes the distinction very clear in his book, but our Distinguished Professor of Risk Engineering is confused.

Let’s put aside this technical comment of minor importance, and turn to the main point of disagreement: is the process stationary or not? By saying violence has declined, Pinker implies it’s not. Before I discuss the evidence (from Pinker) and counterevidence (from TC) on that point, I’d like to give one further indication of how sloppy TC are in their citations. In section VII, Frequency of Armed Conflicts, they say (emphasis added):

‘our data support the findings of [Brian Hayes, not Hayek as TC cite him] and [Lewis Richardson], contra [John Mueller] and [Pinker], that armed conflict are [sic] likely to follow a homogeneous Poisson process, especially if we focus on events with large casualties.’

For ease of reading, I’ve replaced the numbers in the square brackets by the author names of the cited books or articles. I’m aware that citation by numbered references isn’t unusual in the academic literature, but I can’t help noticing here it adds to the obfuscation of who said what about what. If you read Pinker’s book, then it looks very strange to see him juxtaposed with Hayes and Richardson, because Pinker cites both (but especially Richardson) in support of his theses. It was Richardson, namely, who first described the ‘statistics of deadly quarrels’ in his book by the same name. The Poisson distribution for the timing of war, and the power law for the distribution of the number of casualties: both are due to Richardson. Again, no “contra” here. What about the stationarity of the Poisson process? Now it gets a little bit complicated, but also very interesting.

Richardson did test the hypothesis of nonstationarity, and indeed, the result was negative: the data didn’t show a trend in the probability of war. It seems TC are right then, doesn’t it? Not so fast. Did Pinker overlook this? Not at all! Pinker even praises Richardson as a ‘great scientist’, for his ‘willingness to let facts and reason override casual impressions and conventional wisdom’. It’s important to know Richardson’s dataset covered a rather short time period: from about 1820 until 1950. In contrast, TC’s dataset covers 2000 years until the present, another difference (next to the restrictions on the number of casualties) that makes comparison troublesome. As Pinker notes, Richardson’s dataset was biased to show an increase in the probability of war, given that it started just after the bloody Napoleonic Wars, and finished just after World War II. The conventional wisdom right after World War II was that the chances of war had increased. But Richardson wrote this:

‘There is a suggestion, but not a conclusive proof, that mankind has become less warlike since AD 1820. The best available observations show a slight decrease in the number of wars with time. But the distinction is not great enough to show plainly enough among chance variations.’ (emphasis added)

And Pinker agrees with that conclusion. So again, where’s the “contra”? Only in Taleb’s quarrelsome mind, as usual.

However, Pinker continues, Richardson later found a statistically significant contrast between small wars and larger wars. Small wars were becoming less frequent, but larger wars, while fewer in number, were (!) becoming somewhat more frequent. Still no shred of disagreement between Richardson and Pinker, in spite of TC’s juxtaposition. The least you can say is that TC’s rendering of the cited books or articles, whether they support or criticize them, is quite disingenuous. If they refuted anything, it’s their professional integrity.

Wrapping up, the only issue left is this: what happened after 1950, i.e. outside Richardson’s dataset? As Pinker shows in the chapters ‘The Long Peace’ and ‘The New Peace’, the fall in wars between great powers and developed states after 1945 is spectacular and unquestionable (Richardson never lived to see the Long Peace). Pinker lists many other aspects of war that show a statistically significant downward trend in the post-war era.

There is only one way to ignore them all, and TC have found it: you throw away the majority of the variables that show a significant trend, and drown the others in a sea of data such that recent trends become difficult to detect. TC perform that trick by taking a 2000-year history. Under a naïve view, using a longer period of time may seem to allow more powerful and more general conclusions. But when the whole discussion revolves about what happened in a small subset of history, namely the last 70 years, then adding 1800 years of earlier data serves little more purpose than washing away recent declines by earlier increases – yes, Pinker also draws attention to the increases in earlier periods – or statistical significance in the small subset by insignificance overall.

When I say ‘recent trends become difficult to detect’, I don’t mean impossible to detect. That brings me to yet another TC trick.

As it turns out, TC bend the rules of statistical inference in their favor in yet another respect. They assume a general form for the probability distribution, estimate the parameters, verify that the model fits the data acceptably well, and then… simply rule out all competing models. Someone who’s never done any statistical modelling might ask: What’s wrong with that? Someone who learnt the basics of statistical modelling will reply: Everything!

If your model fits the data, it means just that. It doesn’t mean competing models won’t fit. What do you do if you have more than one candidate model? Simply comparing goodness-of-fit is not the answer, because the more complicated model will almost always show a better fit. There is a much better way: test the two hypotheses directly against each other. For example, split the dataset in two parts, before and after 1945, and test the hypothesis that p2 (probability of war after 1945) is less than p1 (probability before 1945). One way to do it was suggested by David Roodman: introduce a post-1945 dummy variable (a variable that has value 0 for events before 1945, and 1 after – JV) in the model and test whether its coefficient is statistically different from zero. Roodman also points out (emphasis added):

[TC’s] applications of EVT models (Pareto/power law, Lomax, Generalized Pareto) dominate the paper. But these assume rather than show that the aggregate casualty rate of warfare has held steady over the centuries. EVT models can allow for time trends but the ones used here don’t.

TC can’t be bothered; they present goodness-of-fit as evidence against competing theories. You could argue that the multinomial distribution test reported at the end of the paper is, in a way, such a test. However, it’s a very roundabout way of testing nonstationarity. Because it tests so many things at once (p1 = p2 = p3 = ….pn; pi is the probability corresponding to each subinterval), it’s probably the weakest test you can think of, if all you’re interested in is the question whether p1 = p2.

Picture this:

It’s midnight. Steven Pinker and Nassim Taleb are resting in the desert. Pinker suddenly prods Taleb:

– There’s a wild beast over there, at less than 100 feet.

– I don’t see it.

– Take your pistol, aim it at 12 o’clock, and shoot. It’s really big, you can’t miss it.

Taleb takes a handful of sand, throws it in the opposite direction (6 o’clock), and says:

– You see? I didn’t hit anything! You must be deluded, you – (expletives removed).

Anyway, if you reduce your scope to increasingly large wars, you decrease the size of your dataset, and statistical tests become weaker and weaker. Pinker himself points out the difficulties in estimating the frequencies of very rare events, and he emphatically denies that his assessment of a lower probability of large wars in the period after World War II is exclusively based on statistics. That’s why he switches to a different type of argument, namely narratives, completely ignored by TC. The political realities mentioned earlier are an example of a narrative: when someone says war between France and Germany is much less likely now than 100 years ago, they’re usually not leaning on some sort of naïve statistical inference from the number of years without war.

It’s quite ironic that Taleb, while being the first to denounce experts of any stripe for their purported ivory-tower mentality, is also the first to take the debate into a rarefied atmosphere devoid of earthly reality. The question as to whether violence has declined is an abstract probability distribution issue to him. It doesn’t occur to him that probabilities can also be modeled by relating them to explanatory variables (e.g. size of armies, level of foreign trade, political union,…). As a nice illustration of their stubborn refusal to accept any other argument, TC draw this remarkable conclusion in their paper (emphasis added):

The consequence of this analysis is that the absence of a conflict generating more than, say, 5 million casualties in the last sixty years highly insufficient to state that their probability has decreased over time, given that the average inter-arrival time is 93.03 years, with a mean absolute deviation of 113.57 years! Unfortunately, we need to wait for more time to assert whether we are really living in a more peaceful era,: present data are not in favor (nor against) a structural change in violence, when we deal with war casualties.

Their tunnel vision hasn’t escaped the attention of other bloggers. As Michael Spagat noted:

[T]he only channel that Cirillo and Taleb implicitly empower to potentially knock their war-generating mechanism off its pedestal is the accumulation of historical data on war sizes and timings. Since they focus on extreme wars, however, it will take a very long time before it is even possible for enough evidence to accumulate to seriously challenge their assumption of an unchanging war-generating mechanism.

In short, the authors declare that the risk of huge wars hasn’t really changed over two millennia of war and that they will stick with this belief until enough of one particular type of slowly accumulating evidence appears to refute it. This stance may be fine for them but other people will wish to incorporate other evidence into their judgments of the risks we face.

TC’s criteria of evidence are very similar to the gaps-in-the-fossil-record argument of anti-evolutionists, who happily brush aside an abundance of supporting data from different scientific disciplines in favor of Darwinian evolution, and yell, ‘You see, no beast!’, when a paleontologist isn’t able to produce a fossil of every ‘transitional species’ in the evolutionary tree.

David Roodman wrote an excellent summary of the fundamental flaws in TC’s paper, in a follow-up of his earlier mentioned blog post:

if you are going use statistics to show that someone else is wrong, you should 1) state precisely what view you question, 2) provide examples of your opponent espousing this view, and 3) run statistical tests specified to test this view. Cirillo and Taleb skip the first two and hardly do the third. The “long peace” hypothesis is never precisely defined; Pinker’s work appears only in some orphan footnotes; the clear meaning of the “long peace”—a break with the past in 1945—is never directly tested for.

[…]

It looks as though Cirillo and Taleb have never checked for a trend break at 1945, even though that is the clear meaning of the “long peace” assertion they claim to challenge. Perhaps they see themselves as testing for some other pattern in the time domain. But that gets back to my first point: I can’t really tell what assertion they are challenging and who, if anyone, espouses it.

And he adds:

Taleb is comically arrogant. I am a “BSer” on whom Cirillo is “wasting your precious dinner time.” Apparently Taleb often behaves this way, so I shouldn’t feel special about the attention.

                                                       ***************

The logic of academic warfare

  1. Scholar says A.
  2. Taleb hears B, takes offense and declares war.
  3. After firing a first salvo of noisy blanks and stray bullets, Taleb decides it’s time to hire a mercenary.
  4. Looking forward to fighting at the side of a famous warlord, mercenary accepts the mission.
  5. Taleb & mercenary pull out an impressive arsenal of missiles, and launch them in an all-out attack against their enemy.
  6. When the dust settles, it turns out they’ve been bombing an undisputed patch of land in the desert. None of their missiles ever came close to the target.
  7. Impressed by the huge clouds of smoke, Taleb’s followers cheer at their leader’s glorious victory.

******************

That said, my best wishes to everyone who reads this: Peace on Earth, and let the Age of Aquarius begin!!

For the twitter addicts I have one last message: be careful these days, alcohol on twitter may lead to serious injury.

Edit 01/02/2016: a reader pointed out an error in my comment about how Bayesians interpret ‘M’ (the ‘true’ mean; in the passage about the difference between M and M*). I removed the sentences containing the mistake. See the comment section for more details.

40 thoughts on “EMPTY STATISTICS

    • So you assumed a distribution based on 1 data point (and filled the lack of data with a loose analogy) then predicted the future based on that?
      Well I guess my main question is do you want to buy some magic beans?

    • Steven Pinker is also skeptical about whether nuclear deterrence is the reason for the absence of nuclear war. He notes that there have been wars between nuclear and non-nuclear powers (e.g. US vs Vietnam, Iraq,…), but no nuclear weapons were used. The US didn’t have to be afraid of retaliation, but it refrained from using them nonetheless. The most plausible explanation is the world-wide taboo on weapons of mass destruction. It’s very difficult to squeeze such arguments into a probabilistic model; nevertheless it’s fair to say that the probability of nuclear war is much smaller than the probability of war, without adopting the naive optimism that nobody will ever use them anymore.

      • Obviously the probability of nuclear war can’t be higher than the probability of war, so my last sentence may sound a bit stupid. Let me put it this way: there’s is a strong reluctance to use nuclear weapons, but the reluctance isn’t likely to be due to deterrence (although deterrence might have an effect on a small number of unpredictable nations – North Korea perhaps?). These observations may lead to the tentative, informal conclusion that a nuclear war is probably less likely than fearful people think.

        • All very good except the use of “reticent” and “reticence”. The latter is “not revealing one’s thoughts or feelings readily”. Do you mean reluctance?

          • Yes, that was what I meant. I’ve corrected it, thanks for pointing this out.

  1. “…homicide rates, for example, aren’t worthy of their attention”. Because just as a thousand yellow beluga wales dancing in the rain with pink Hello Kitty umbrellas in downtown Bangalore would be thermodynamically very expensive and so infinitesimally improbable, so too is the probability of all your co-workers going spontaneously mad and each stabbing you in the throat with their coffee filter straws one fine Monday morning. Something about our Universe doesn’t quite allow that. Anyway, global armed conflict seems more reasonable.

    I think Taleb assumes that when a notable public intellectual writes a meticulous empirical book detailing reasons for reductions in violence, this is counterproductive because it contents us into thinking the future will indisputably be okay. True, those conclusions are never drawn by Pinker. What Taleb is doing is taking advantage of the benign Better Angels as a political launchpad to prove he has something more important to say. It’s a common tactic for gaining notoriety.

    I think that’s about all you can really say about this debate. Frankly, the “Logic of academic warfare” bullet points above say it best.

  2. A stronger rebuttal by Pinker would involve writing a book about the possibility of catastrophe which ends up selling more copies than the Black Swan (because presumably he doesn’t fully disagree with Taleb). Ultimately, I see nothing wrong with Taleb’s basic premise even though I don’t quite understand the mathematics. Increasing levels of global economic complexity seem to engender extreme possible levels of both calamity and prosperity, but at least in this instance both Pinker and Taleb are yelling past each other. Fortunately, this doesn’t make the debate any less valuable as a marketing device for either party.

    • If I ever have to summarize the story in 3 words, then, with your permission John, I will quote you! 🙂 Thanks, mate!

    • I know nothing about Cirillo, I was only talking about Taleb. Taleb himself has shown his contempt for peer refereeing on many occasions. I’m not sure what you mean by ‘peer reviewed’ papers, but what I’m talking about is the formal peer review process. It’s not the same as asking a friend to read your paper. It’s submitting your paper to a journal where the editor will appoint a referee (usually anonymous) who reviews it. But I think in Taleb’s case it won’t even get sent to a referee, because his aggressive tone would disqualify it from the start.
      If you can give me the titles of (genuine) peer-reviewed papers by Taleb, I’ll be happy to temper my judgment.

  3. Essentially the writer of blog isn’t one statistician. But it turned out it is not one scientist. Plenty of mistakes.

  4. I don’t have a strong grounding in statistics, but doesn’t this come down to a counting problem? Pinker tries to count and Taleb says counting is impossible. Taleb is “right” if he says a really big war could come and swamp Pinker’s statistics, but Pinker is “right” if he says he has found a counting principle that makes that war improbable. Taleb sounds “righter” than Pinker because the mechanism that would validate his argument is easy to see: it is trivially true that we have nuclear weapons now and an “average” war could could have annihilating results. Pinker is “righter” because he is trying the hard thing, which is identifying and counting the statistics (variables?) that are systemic and thus predictive. I read a Mandelbrot book recently and it seems to me that Taleb may be overfocusing on the power laws and fat tails, and forgetting the fractal part of long term persistence of outcomes different from what randomness (or our understanding of the concept of randomness) predicts. Isaac Newton lost money in markets and said human processes were less predictable than the movements of planets and stars, but Max Weber said that human processes should be easier to explain scientifically than natural science because we have the tool of introspection available to us. We are part of the system and so are the other actors in it so we can have an insiders knowledge that renders prediction easier. Taleb is with Newton and Pinker with Weber. Does the arc of history bend toward justice as Martin Luther King said, or is history just one damn thing after another? I lean Pinker.

    • I like the contrast between Weber and Newton, but I think Pinker would strongly resist having his theses reduced to slogans. When he takes a certain position, he usually accompanies it by a great deal of nuances and qualifications. Pinker acknowledges that a nuclear war is not impossible, and may have devastating results. But for events that rare, counting/statistics is an almost futile exercise, also something he acknowledges. Trying to calculate a probability is so pointless that he doesn’t even try. But by means of a narrative (e.g. worldwide taboo on nuclear weapons), you can still list a number of good reasons why the likelihood might not just be so high as people would think, when all they consider is the vast number of nukes spread over the globe.

  5. I was wondering if you ever thought of changing the page layout
    of your website? Its very well written; I love what youve got to say.

    But maybe you could a little more in the way of content so people could connect with it better.
    Youve got an awful lot of text for only having 1 or 2 images.
    Maybe you could space it out better?

  6. “To a normal person, the statement ‘terrorism kills far fewer people than falls from ladders’ means a purely factual statement about the number of casualties over a specified period in the past. But Taleb immediately detects a prediction about the future and calls the “inference” a fallacy.”

    Define normal. Take a look around at how “normal” people cite these articles. They absolutely are using it as both a statement about a specified period and a prediction of the future. A simple google search for the phrase “You are MORE LIKELY TO die from X than from terrorism” reveals that you full of it. I’m going to need a solid pair of hip boots in order to wade through this bullshit blogpost.

  7. Taleb is throwing a tantrum over this; it would be amusing if it weren’t so disappointing. His ability to comprehend what Pinker is saying has been swamped by what appears to be an amygdala hijack (possibly linked to Pinker’s attack on his buddy Gladwell a few years ago). As predictable as clockwork, Taleb will be flooded with more emotionalism and cognitive dissonance and he will double down. If he had any character, of course, he would admit his hasty errors, but all evidence points to him being an emotionally immature man.

  8. I haven’t read either Pinker or Taleb, so I’ll trust that you’ve related their respective positions reasonably accurately. From what I can tell, your “logic of academic warfare” summary is fair. This being the internet, though, I’m going to pass over all of the good stuff in your post (in particular, your excellent point that goodness-of-fit cannot in and of itself be used to rule out alternatives) and bitch about a few small details that made me grit my teeth.

    Hmm, I always thought Bayesians look upon M as another random variable, so this talk of ‘convergence’ between M* and M sounds pretty nonsensical.

    You are wrong and you should feel bad. There’s a variety of philosophical stances about randomness and uncertainty among Bayesians, but this is always true: a Bayesian will feel free to assign a probability distribution to a quantity whose value is (modeled as) fixed but unknown (a.k.a. a parameter) and this does not mean that the Bayesian thinks the quantity is “truly random”, whatever that means. Convergence of the posterior distribution to the truth is a thing, and proofs of it generally look a lot like proofs of the consistency of the ML estimator, so “this talk of ‘convergence’ between M* and M” is an entirely reasonable thing to think about even for a Bayesian.

    To a normal person, the statement ‘terrorism kills far fewer people than falls from ladders’ means a purely factual statement about the number of casualties over a specified period in the past. But Taleb immediately detects a prediction about the future…

    I can’t agree with you here. To a normal person, generalities written in the present tense pertain to some interval centered on the present moment. It’s entirely reasonable for Taleb to read this as some kind of prediction or statement of expectation about the near future.

    • What blogger wouldn’t welcome a critic like you, Corey?

      As to your first point, I stand corrected. Since I’d rather feel bad about making a mistake (however serious) than about making a mistake and refusing to admit it, I’m going to leave it here.
      Lest Taleb or his fans read too much into my admission: it’s still nonsensical to say ‘Working with [the sample mean] cannot be called “empiricism”’. Somebody might come up with the following defense: ‘Taleb is trying to say that the sample mean isn’t a good estimator for a specific type of probability distributions’, but then he should just say that. And he should certainly not imply that Pinker said something different, given that Pinker points out exactly the same thing in his book.

      As to your second point, it’s a very good one too. But let’s take a step back for the moment and look at the context in which these statements are made. I don’t think any of the people behind them would rule out the possibility of a devastating terrorist attack. Steven Pinker, for example, literally wrote this:

      ‘There will certainly be wars and terrorist attacks in the decades to come, possibly large ones. […] Perhaps at this very moment terrorists from some liberation movement no one has heard of are plotting an attack of unprecedented destruction […]’ (The Better Angels)

      And yet, i.m.o. it still makes sense to compare the number of casualties from terrorist attacks with falls from ladders. The fact that there are (or were, if you insist) fewer in the first category will come as a surprise to a lot of people. It might even persuade them to turn their attention to their ladders rather than abandoned luggage in a railway station. Would that be a mistake? Pinker again:

      ‘Taleb is surely right to urge us to think about the magnitude of events with non-negligible probabilities, and to caution us about our inability to assess such probabilities with confidence. Yet he does not acknowledge the problems […] with the implication that if we can imagine a catastrophic outcome we should assume that it is a realistic possibility. Finite resources have to be allocated across many foreseeable risks, and we have no choice but to assess which of them are most worth worrying about. The dangers go both ways; it would be rash to dismantle the military on the assumption that war was no longer possible, but it is just as rash to plan for every improbable catastrophe. The bloated American military budget is notoriously based on blackswan thinking […]’ (Fooled by Belligerence)

      If Taleb is consistent about the difficulties with estimating such worst-case probabilities, he must admit he can’t say whether terrorism is truly more dangerous than ladders. When it comes to practical risk assessment, the statistics on terrorism do reveal something, at least on the smaller scales of violence. Pinker has the final word:

      ‘Of course, no matter how many times predictions of catastrophe fail, worst-case advocates can always say, “Just you wait!,” but that makes their assessments permanently unfalsifiable.’ (Fooled by Belligerence)

  9. One thing Taleb misses completely is that the “long peace” (as formulated by Gaddis) is specifically referring to conflict between “Great Powers”. Simply showing the frequency of 10 million+ casualty events doesn’t really speak to this; a true test of that hypothesis would HAVE to include Franco-Prussian war, Crimean war, 1848, Seven Years war, etc…

    As a side note, it looks like a technical article where he took a swipe at pinker in a few sentences towards the end, was published in Physica A: http://www.sciencedirect.com/science/article/pii/S0378437115001429

    I get the feeling he’s not going to submit his pinker-attacking paper to a conflict studies/political science/international relations journal…

    • Aha! So that’s the loudly trumpeted article… A draft version has been on his website for quite some time: http://www.fooledbyrandomness.com/longpeace.pdf (starting on p. 5).
      It’s the one I took this quote from:

      For instance, in the thesis by Steven Pinker [10] that the world is becoming less violent, we note a fallacious inference about the concentration of damage from wars from a ^Kq with minutely small population in relation to the fat-tailedness.

      Indeed, it’s a general mathematical article on estimating quantile contributions of power law distributions. The violence debate is only obliquely referred to, in two sentences (one of which is the quote above) and one footnote, to be precise.

      I get the feeling he’s not going to submit his pinker-attacking paper to a conflict studies/political science/international relations journal…

      You can’t be sure with Taleb. But if when it gets rejected, he’ll let the entire world know that the ‘research mafia’ (his own words) are too retarded to see his extraordinary genius.

      • Another thought:

        It’s very possible that WERE a 10-million casualty war (or equivalent) to occur in the next 30-50 years, the bump in the deathrate would still be consistent with an overall downward trend due to the declining frequency of “smaller” wars. I’d still prefer for a huge war not to occur, but as I stated above, “catastrophic conflict” is only one aspect of Pinker’s thesis about war, which is itself only one aspect about decline-in-violence generally.

  10. Perhaps an issue worth perusing is the probability or timeliness of a war “coming home to roost”. The Europeans were shocked at the carnage coming home and hoped, naively, that their experience was the last such experience. But perhaps it took a generation to forget. WWII was a huge shock that Stalin worked to have his countrymen forget – perhaps to make them more amenable to future conflicts? Viet Nam did in a generation for foreign wars.

    At least that is how it is for the European-derived cultural groups ….

    What of the mid-East and Africa? Asia? Is there a “taste” for war, especially if there is a tribal/ethnic aspect to produce a strong “other” to destroy?

    Perhaps looking at a global situation is inadequate. Cultures at different stages of development socially may have different narrative arcs. But what if the problem for modern warfare is that it doesn’t stay “out there”? What if the terrorist actions that modern travel, education and technology allow, bring the foreign war back to the larger force and disturb the civilian population? Is death-on-your-block a deterrent for further war?

    As we go further into the 21st, I expect that the terrorist acts – really, the pushback by small forces against the larger, state-organized forces – will be a deterrent for the foreign adventures of post-WWII. If America understood – if Bush understood – Americans fighting in the mid-East would bring about the 9/11 event and other Islamist attacks in the continental US, would he have gone into Iraq and Afghanistan as he did?

    The death of Marines in Somalia brought the American troops home as the Beruit Marine deaths did in the Lebanon conflict. The North Vietnamese generals got the French out of their war by the numbers of French deaths, especially at Bien Dien Phu. American casualties were too politically harsh to maintain the US involvement there, also. The chickens coming home is a significant issue and the modern ease of this – Paris, December 2015 – is a new aspect.

    Asymmetric warfare has existed to the benefit of the larger force from the dawn of man until only recently. The British Empire could conduct all the wars they wanted and they stayed at a distance and involved only professional soldiers. (WWI and WWII were not asymmetric wars, and even Viet Nam may be considered a standard war.) The Russia-Chechen conflict brought some action back to Russia which disturbed the average Russian and may have lead to the semi-resolution of the war(s) there. A question is, how much violence will the distant country tolerate? Imperial needs or desires or ambitions are easier to support if none of the negatives end up on your doorstep.

    I’m not arguing that violence per se has decreased. Certainly it has in the gross social sense. Even in the last 40 years tolerance on internal social violence – domestic, rape, teen-fighting – has gone down in the European-derived cultural groups (I can’t speak for the non-European except what I see in the news is still not good in African, Indian or Asian developing places, though progress is definitely being made there at an optics level.) What I am saying is that formal armed conflicts may – perhaps should – decrease when the pain is more equally shared.

  11. Pinker is correct about the historical decline in violence, certainly of the everyday nonmass type. Taleb has a point (really the only point he ever has) about power laws with fat tails: basically, that only the tail really matters, because it swamps everything else when it happens, even if it is very unlikely and you haven’t seen it yet. And it is true that, in a sense, an event that wipes out half of humanity makes everyday concerns trivial. But in another, more accurate sense, it doesn’t. Even if I knew that the world would eventually end in a nuclear holocaust, I would still greatly prefer not to see human sacrifice and chattel slavery reinstated in the meantime.

  12. Not having read through all the commentary and so not sure if this has been raised, I have a simple proposition: the trends cited as the underlying impetus for decreasing violence are founded upon relatively cheap and easy-to-extract energy sources (fossil fuels) that have allowed increasing economic expansion and associated benefits for a larger swath of people, decreasing the violence required to expand (something most societies do); however, as the source of this energy is finite (and very likely has peaked), we are bound to see a return to more violent ways as societies begin fighting over the remaining resources. In other words, the trend is about to reverse…

    • Vince, it would be interesting to hear directly from the 20 scholars what they think of all this. Any links to that you can share with us? Being familiar with Taleb’s inclination to misrepresent, I wouldn’t be surprised if “the agreement was to not talk about [Pinker’s] thesis any further” actually means: “the audience wasn’t very much interested in my [Taleb’s] feud with Pinker”.
      And then this: “the organizer was told by Pinker that he did not wish to rebut our papers”. Hmm… is there anything new in the papers that Pinker didn’t already rebut? Can you blame him for refusing to become a slave to Taleb’s obsessions? Given Taleb’s breath-taking output of noise and distortion, rebutting each of his (often repetitive) papers would be a full-time job for any single individual.

  13. I happen to agree with your critique of Taleb. I am amazed at the following he gets. This ideas he spouts are not original, but he has a knack for naming things and making a lot of noise and hurling insults.

    Taleb did not invent fat tails; they have been known about and agonized over in finance for the full 20 years I have been in the field. All Taleb did is label it with “black swan” and popularize it, and claim his is smarter than his peers.

    His attacks on Pinker follows this same pattern–attack a fellow scholar over a strawman that Taleb himself invents.

  14. Pingback: We Hardly Understand the Dynamics of Progress - Maarten van Doorn

Leave a Reply

Your email address will not be published. Required fields are marked *

*