Friday, January 14, 2011

Complexity: It's Not as Simple as Bill Easterly Thinks It Is (It's Simpler)

Folks over at @aidwatch have been getting into writing about complex systems these days. I'm not sure I know what they're talking about. And I don't think they do either.

Here's Bill Easterly writing today in the Guardian's Poverty Matters blog:
A popular topic in the aid blogosphere this week was not about Haiti or Ivory Coast or south Sudan but about complex systems, i.e. systems that cannot be reduced to a simple mathematical or statistical model, where actions often have unintended effects. [Link included as in the post]
Now, admittedly, this is just one sentence. But still, it would be difficult to come up with a more poorly informed summary of the nature of "complex systems" than the one Easterly offers here. 

Why? The reason is that the core insight of the study of complexity--be it deterministic chaos, cellular automata (e.g. John Conway's marvelous "game of life") or agent-based modeling in general, to cite just a few of the many variants that loosely define this domain of study--is this: systems that are not just reduced to, but actually defined by, simple mathematical models, have the potential to generate extremely...well, complex behaviors. The classic example is the logistic map, an extremely simple function whose dynamics are highly complex:


Anyhow, the key point is that such complex systems, while entirely deterministic (that is, lacking any random element) generate behaviors that are indistinguishable from those of stochastic systems (systems driven by a random component). (When mapped in "state space" they also yield beautiful fractals...but that's another story.) Before the study of deterministic chaos (and with it "extreme sensitivity to initial conditions" a.k.a. the "butterfly effect"), determinism and randomness were understood to be opposites. So understanding that there were significants domains in which they were indistinguishable from one another was a pretty big deal.

The caricature of "complexity theory" that Easterly offers is in line with a body of work by Austrian economists that has sought, with greater and lesser desperation, to connect Friedrich Hayek's famous notion of "spontaneous order" in economics systems to that of "emergence" and "self-organization" in complex systems. This was a failed undertaking from the outset, nearly twenty years ago now. It is also one that I have some confidence Hayek himself would have judiciously avoided. The reason is that the problem that concerned Hayek (and von Mises before him) was not the emergence of  complexity in the absence of randomness, but rather the impossibility of calculation in the presence of randomness (and its siblings--noise, and informational decay). 

An illustration: In the "The Impossibility of Socialist Calculation," Hayek assails the now-forgotten Oskar Lange for making following assertion in an attempt at critiquing von Mises: "The administrators of the socialist economy will have exactly the same knowledge, or lack of knowledge, of the production functions as the capitalist entrepreneurs have." This is what Lange said; Hayek characterizes the claim, with his characteristic light touch, as "a blatant untruth, an assertion so absurd that it is difficult to understand how an intelligent person could ever honestly make it."

Now, let's pause to consider. If the essence of the problem faced by administrators of socialist economies was deterministic chaos as described above (the essence of unpredictability in complex systems) then Lange's statement would not be absurd. It would actually be correct: under circumstances of deterministic chaos there is no way the entrepreneur could have better information than the planner. But that's not Hayek's objection. He does not believe that Lange has failed to grasp the essence of extreme sensitivity to initial conditions. Indeed, his point is not fundamentally about dynamics at all. What Hayek is really talking about is the heterogeneity and localization of information. In other words, Lange is wrong because the entrepreneur has unique and specific information to which the planner does not have access:
The individual entrepreneur will not possess or require knowledge of general production functions, but he will currently learn from experience how at any given time variations in the qualities or the relative quantities of the different factors of production he uses will affect his output. This information relevant for and possessed by each entrepreneur will be very different from that possessed by others. To speak of the aggregate of such information dispersed among hundreds of different individuals as being available to the planning authority is pure fiction.
Given this, what do you think Hayek would say about a model of economic dynamics in which every economic actor not only possessed the same ability to observe local conditions, but followed the exact same deterministic rules? That is the essence of a complex system! But it is the opposite of a model built upon the heterogeneity of economic actors, and the impossibility of reducing their choices to simple models in the aggregate. In other words, a complex system is the opposite of "a system that cannot be reduced to a simple mathematical or statistical model, where actions often have unintended effects" (ref. above).

Now, since ours is a country in which liberty prevails, I suppose it's OK to employ the term "complex systems" to refer to things that are its opposite. Why not? It's all just silly science stuff anyway. So, henceforth, I am sure that Easterly will allow the same license to others who chose to reinvent technical terms--say "effectiveness," "confidence," "evidence"--in ways that similarly suit their fancy. Sound good?

6 comments:

  1. ...Very interesting post. I was left with the thought that a lot of this rhetoric and hyperbole could be easily be dashed, if those who write about entrepreneurship would walk out on the limb and engage in an entrepreneurial venture in order to balance some experience with success and failure with their beloved theory; rather than simply nest in the comfort of observation, supposition and mathematical formulas. But then, again, that's not how economists seem to do things....

    ReplyDelete
  2. I just found your blog. This is a comment on your blog, not this entry, which I enjoyed reading. It was pretty good.

    Now, about your blog, I don't see how you can be so optimistic about a future of prosperity. A single global economy will bring more prosperity to those who don't need it, and will bring poverty to those who don't have it. I have seen that in my lifetime, and history supports this view: integration of markets eliminates competition and reduces employment, which is the main form of wealth redistribution that we have today.

    The reduced competition then translates into more accumulation of money in a few people and companies, which they then use to control their national government to further consolidate their power and put barriers for competition.

    My main reference point for this is Mexico, where this happened; however, Mexico gets dismissed for being corrupt Mexico. Russia seems to have gone through a similar experience, yet corruption also tarnishes this example.

    Yet very similar dynamics of the erosion of the middle class, reduction of jobs, and stronger influence of big corporations is happening in the U.S. We lack the volume of outright bribes that Mexico has, but our electoral donation system is in a way a regulation of traffic of influence, and we have seen the impact that it has in our government.

    In fact, I would say that the system encourages corruption just because money buys access to power and these people have an excess of it. From a purely selfish point of view, spending money to influence politicians is a good investment.

    Now, I could be wrong, and I wish I am wrong, so maybe I am just missing something that you do see which makes you optimistic about the future. So if you wish to direct me to the links where you substantiate your optimism, I would be more than happy to read them.

    Thanks again for your site and this entry.

    ReplyDelete
  3. I think I can break this down into something simpler:

    1) Complex systems can emerge from both mathematically simple and mathematically irreducible starting points.

    2) Complexity Theory is the study of how a mathematically simple starting point an produce a complex system.

    3) Development is not a mathematically simple system

    4) Therefore do not use Complexity Theory as a term to describe the study of the complex system of development.

    5) Go on about your business talking about development being a complex system.

    Is that right?

    ReplyDelete
  4. @TimOgden Great summary!

    One caveat: At a later date I'll follow up with a post about computational complexity, which actually links more directly to Hayek's insights about information than does emergence in complex systems (which, as I note above, is the Complexity Theory connection most often made). Roy Radner--another NYU economist--wrote some great papers about organizing to deal w/ computational complexity a couple of decades ago (e.g. http://bit.ly/gkxaCg ). This is whole different thread with fundamental relevance both to economic theory (http://bit.ly/gayzl) and entrepreneurship (http://bit.ly/idY0kv).

    So that's just to say there's more to "complexity theory" than what I focus on in this post, but, so far as emergence in complex systems is concerned, your summary is excellent.

    ReplyDelete
  5. @Hugo Your analysis is very reasonable in my view and (believe it or not) quite consistent
    with the core argument in The Coming Prosperity. For the promise of
    prosperity to be realized, entrepreneurship is essential. Why? Because
    entrepreneurs are, by definition, those in the society who take the
    lead in pushing back against powerful incumbents. (Ref. work of Joseph
    Schumpeter from whom this argument derives.)

    ReplyDelete
  6. I'm enjoying your posts about the misuse of complexity and chaos in development rhetoric. It's become almost a mystical incantation, accompanied by much hand-waving and finger-wagging (incense coming, real soon now), and, of course: no actionable conclusions.

    ReplyDelete