A Hive Mind of One

My friend Mick alerted me that Carl Zimmer was featured in a recent episode of RadioLab dedicated to the subject of parasites (Abumrad, Jad and Robert Krulwich, “Parasites,” 7 September 2009). Despite being somewhat annoying in format and low-density in it’s information presentation, the show contains a number of points interesting to my project.

Hookworms

In the second part of the second segment (starting at 31:25), they deal with the symbiosis between hookworms and the human immune system. The segment consists of a profile of Jasper Lawrence, a man who had severe allergies and — having chased down a certain direction of research — decided to travel to Cameroon to infect himself with hookworms. The research in question is that of the hygiene hypothesis: the notion that many developed world afflictions, including allergies, result in part from the excessively sterile human environment. Asthma is 50 percent less likely in a person who has had a hookworm and in Africa allergies are almost entirely unknown. It is theorized that similar to the dependence of digestion upon a symbiotic relationship with non-human microflora of the digestive tract, the immune system is dependent on certain microorganisms for regulation and calibration of the immunoresponse. The complex chain of events that is the immunoresponse evolved in the constant presence of parasites, evolved around parasites; they have co-evolved to the point where their presence became necessary. “We function like rainforests; we’re ecosystems,” Mr. Lawrence says. This is the hypersea washing through humanity.

Toxoplasma Gondii

The final segment is on Toxoplasma Gondii (starting at 47:55), a parasite that lives in cats and makes their feces dangerous to pregnant women. Like many parasites, it has a multi-phase lifecycle that takes place in a multiple hosts. It only reproduces in members of the Felidae family (cats), but can live the remainder of its life in any warm-blooded creature. T. gondii is expelled by cats when they shit and the cat shit is ingested by other creatures (consumption of unwashed vegetables, inhaled while digging close to the ground — which is why pregnant women are advised against gardening). T. gondii needs to get back into the digestive tract of a cat to reproduce, so it wriggles its way to the amygdale, the part of the brain responsible for emotional reaction, and causes the host to become attracted to cats, thus, in the case of small mammals or birds, becoming easy prey for cats (it is Carl Zimmer’s argument in his book, Parasite Rex that in this way parasites are like ecological catalysts, spinning food webs ever more tightly together).

But then there is the question of humans. It is one thing to say that T. gondii might make a bird or a rat suicidal. But T. gondii infects humans too. What then?

The scientific interviewee for the segment is Robert Sapolsky, a professor of neurology at Stanford University. On the question of T. gondii altering human behavior, he declares it highly plausible:

Sapolsky: Pure speculation, but people who think about this stuff view it as not purely speculative. The notion that toxo can produce some sort of attraction to cats in humans: they don’t think it’s all that crazy.

That’s right: crazy cat lady is that way because she’s been body-snatched by toxoplasma gondii.

Less controversial than the idea that T. gondii might be making crazy cat people out of us is the idea that it can make people more prone to engage in risky behavior. Dr. Sapolsky mentions two independent studies that show that people infected with T. gondii are two to six times more likely to get in a car crash than those not infected. With this information in hand, host and guest make the larger point:

Ellen Horne: It might be possible — might be possible — that toxo is guiding our emotions, changing who we are in some basic way. And if you consider that toxo might just be one of thousands of tiny little parasites inside us, pulling our strings from the inside, well that thought is pretty creepy.

Sapolsky: Even if the entire lesson with toxo is that a small subset of infected people now have one half of one percent more likelihood of wanting to drive really recklessly, even lurking in that one half of one percent are some serious implications for thinking about free will. We haven’t a clue the biology lurking in the background that makes free will seem a little bit suspect.

I’m less concerned with that old philosophical saw of free will versus determinism, than with extending an idea from segment on the hookworms. Mr. Lawrence says, “We function like rainforests; we’re ecosystems.” Presumably he is referring to our bodies. But the implication of toxoplasma gondii is that we are ecosystems in out minds as well. To the naïve sort of homunculus, Herman’s Head notion of consciousness, we must now add a few animal spirits.

Update, 23 October 2009: For instance this woman must have a pretty severe infection of T. gondii.

Update no. 2, 5 June 2010: Parasitogenic felinophilia (Toxoplasma gondii) may be treatable with haloperidol, an antipsychotic (“A Game of Cat and Mouse,” The Economist, 3 June 2010). Repost from my twitter feed.

The Positive Side of the Fallacy of Composition

It’s one thing to recognize that the properties of the component aren’t those of the composite. But on the positive side and in the interstitiary of this seemingly commonplace observation lies an entire world. The fallacy of composition is perhaps the first and the most important recognition on the way to systems science. Characteristics don’t scale in a straightforward or linear way and emergent properties, complex systems, adaptation and evolution, ecology, intelligence and society1 are all the positive side of the recognition of the fallacy of composition.

I mention the notion of an interstitiary between components and composites because this distinction is often thought of as discreet and binary. That is, people imagine components and composites and no intermediate states. This is because when people think about the fallacy of composition, they tend think of a machine-type example, or one of substance and form, e.g. just because an ingot of metal is pretty durable doesn’t mean that a precision machine made of metal parts is too. But emergence-type phenomenon are a unique kind of composition not captured in the machine analogy of component and composition.

A machine is made of heterogeneous parts and that is misleading here. Each part is relatively property-thin and by themselves are just a collection of odd shapes. It is only when completely assembled that the function of the whole is manifest. Structure is everything in the machine. Intermediate states between parts strewn on the table and complete assembly accomplish nothing. Minor deviations from proscribed structure accomplish nothing. And the whole is efficient: that is, it is specifically designed to minimize emergent or any other extraneous characteristics. Design and emergence are at odds here.2

Emergence, complex systems, et cetera come about from collections of more or less homogeneous corpuscles interacting in a largely unstructured way.3 The major difference here is that while the machine has no or few remarkable intermediary states, scale is all-important in systems phenomena, which tend to display differing and unique behavior at various scales. And where the machine is highly structure sensitive, complex systems tend to be robust in their various states.4

Continuous variable change

The key is that more is different (nearly the motto of the discipline).5 The common sense imagining, prior to the fallacy of composition, is that things scale in a linear way. More means more of the same. Then there is second order sophistication about scale. People add in the notion of a discontinuity. Things scale until they reach a certain threshold, at which point there is a discontinuity. More is different. But this is still a relatively binary conception with simply two sides of the discontinuity: one side of the discontinuity where the logic of linear growth prevails and the other where that of emergence or complexity prevails. There is a third order sophistication about scale where the binary view of second order thinking is still too simple; where the relationship between scale and properties is continuously variable.

As opposed to these simpler first and second order notions, continuously variable growth and development happen through many phases distinguished by differing logics or marked by different epiphenomena (something more like the imaginary graph above). As a system or network gains in members or in interactions, one set of behaviors becomes strained and unstable as it approaches the upper-bound threshold of the given logic. The threshold crossed, the previous logic gives way to a new logic. The pattern repeats, with the new logic holding for a period, but it too petering out in favor of a subsequent logic. And so on. Or perhaps there are tiers of controlling logics operative simultaneously. There may be meta-epi-phenomena as the various transitions admit a pattern of cycling logics or a second order logic to their or relations.6 No behavior or sequence is fundamental to systems, or the process of growth or to any particular phenomenon. We should dispense with the idea of a sin qua non behavior of systems in favor of a continuum of potentially many different behaviors as a system grows and changes.7

I will make a few examples to demonstrate the changing relation of prevailing logic and a system phenomena under growth.

Bak-Tang-Wiesenfeld sandpile growth model

  1. Multiple logics. Consider that paradigmatic example of complexity: grains of sand falling onto a pile (a Bak-Tang-Wiesenfeld sandpile). As grains fall onto the pile, they tumble down the side, and come to a rest according to a standard distribution. Most come to a rest close to the drop point so the pile grows in height, but only a few roll all the way to the bottom so the base remains largely the same area resulting in the incline of the sides of the pile grow ever steeper. But there is a range of values for which the ratio of base to height is stable. When the pile reaches its upper bound of stability, the pile collapses. But it doesn’t collapse all the way to a layer of sand one grain thick. The collapse comes to a halt once the pile has reached the lower bound of the ratio of base to height (the lower bound being where the slope of the side of the pile is such that friction overcomes gravity and momentum). The pile recommences its growth in height. With a new, broader base having been established, it will achieve a greater height this time before reaching the critical threshold.

    The pile doesn’t grow continuously until collapse though. It is constantly experiencing local collapse. The sand pile demonstrates scale symmetry in so far as there are slides of all sizes starting with a single grain previously stable coming lose and tumbling a little further down a side. Single grains frequently start a chain reaction leading to larger slides. The collapse of the whole pile isn’t an phenomenon of it’s own, unrelated to the logic of local slides, as the catastrophic collapse of the pile is usually the result of a local slide running away to the scale of the entire pile.

    But fractal collapse isn’t a constant. Rather, its probability is a function of where the pile is in the growth-collapse cycle. At the lower bound of the range of stability any collapse is almost impossible. A single grain may break lose and tumble to a more stable location, but owing to the widespread state of stability, it is not likely to set off a chain reaction leading to a large slide. At the top end, catastrophic collapse approaches certainty. A growing proportion of sand grains are in unstable positions. More are likely to break lose and, having broken lose, collide with other unstable grains setting off chain reactions. As the pile goes through the positive phase of the growth-collapse cycle, it traverses a range of increasing collapse probability from almost impossible to almost certain and its fractal dimension grows.

    Tally the sheer number of logics at work in this seemingly unnoteworthy phenomenon. The overall pattern is linear growth — the pile grows in mass in equal units in equal time. The shape of the pile demonstrates an oscillating pattern, between a steep cone and a shallow cone. The height of the pile superficially demonstrates cyclical growth. Upon closer inspection, the growth of the height of the pile turns out to be fractal. But even that fractal growth isn’t constant, but one of increasing fractal dimension.

  2. A complicated interstitiary. A discontinuity is probably always preceded by some sort of turbulence, a breakdown in the previously prevailing relationship. A prevailing logic doesn’t yield instantaneously to its successor. In at least materials science this is well documented in the form of the microstructure of phase transitions.

    As a social scientific example, nuclear weapons represent a discontinuity in the growth of military power, but how much of one? Countries had already acquired “city-busting” and potentially civilization destroying capability using the regular old Newtonian technologies of modern air power and chemical explosives. The U.S. imagined “bombing Vietnam back to the stone age” employing conventional methods. So it would seem that military power (technology) had already crossed an inflection point and gone non-linear in a way that was necessitating major strategic reconsideration prior to the discontinuity of nuclear weapons.

  3. Many discontinuities. People have a tendency to conceptualize consciousness in the model of the binary discontinuity. Neural networks grow in size from tiny nerve bundles in nematode worms up to pre-hominids and then somewhere in the Pleistocene whamo, the discontinuity and consciousness and that’s the pinnacle. Some people imagine the difference between regular people and geniuses to be a little discontinuity, rather than a difference of quantity. Hence the obsession with Einstein’s brain, Descartes’s skull, and so on.

    But I imagine consciousness rather than a big bang being a development with perhaps a number of discontinuities and plateaus — the first reflex, the first pain, the first internal world model, the first declarative memory, the first language of discrete symbols, the first syntax, the first theory of mind — on the way to humans. But our intelligence is just another plateau on the path. There is the singularity somewhere beyond us and still more discontinuities, unimaginable to us even beyond that. As intelligence is not one thing, I imagine each of the many faculties having its own trajectory, each with multiple discontinuities of their own, as well as the synergy of the many faculties being of uneven development and their interplay subject to system effects.8

Instead of relying on the sort of intuitionism that says something like “We know that there has been a discontinuity in strategic thought because we read Thomas Schelling now instead of Helmuth von Moltke” we should dispenses with this intuitionistic approach in favor of systematic mathematical methods to analyze change — to determine when and where system effects are at work, which ones are at work, the extent of their range, the exact location of inflection points or discontinuities, where the logic of a tipping point takes over and the pace of accelerating assertion of the logic of the new régime, to study turbulence, islands of stability, equilibria, feedback and other patterns that can develop.9

Notes

  1. I am prone to write “collective intelligence” in place of “society,” but an ancillary point here is that all intelligence is collective (composite), whether it’s a society, so to speak, of individually dumb neurons in the brain of an individual or the more commonplace idea of a society, namely wisdom of crowds, invisible hand, social networking, superorganism type phenomena.

  2. Though not necessarily so: we are learning how to harness emergent properties to our purposes, to design them in.

  3. Though structure might be a concomitant emergent property, e.g. ecologies might exist in equilibrium, but that’s not because competition among species is well ordered.

  4. This category error of misconstruing different component-composition behavior types, or not even identifying the second type at all, is perhaps illuminating to the overarching issue of intelligent design’s constant irreducible complexity mongering. One of the favorite analogies from their rhetoric is that of the mousetrap: remove a single component and it isn’t a slightly less effective mousetrap, it isn’t an anything and natural selection can’t function on constellations that display no function. But notice how this relies entirely on the machine type of component-composition thinking. But if one sees phenotypic expression as an emergent property of genotypic change, than one might shift to the later version of the component-composition model. A heavily determined trait will be stable over many changes in the underlying genes, until a critical threshold is reached at which time rapid change in phenotype (the emergent property) could occur. A perfect example of the contrast between the two types of thinking that I am describing here is that version of evolution as the long, slow accumulation of mutation down through the millennia, which sees a more or less consistent, linear change, versus something like punctuated equilibrium which imagines different logics of change predominating under different circumstances. I would go further to say that punctuated equilibrium is only a theory of discontinuity. A more elaborate theory of the deep history dynamics of evolution, or a marcotheory of evolution, as opposed to the microtheory we have at present, is required.

  5. More is not binary, though more is frequently discrete — neural networks grow in whole neurons, societies grow in whole people. But not always. System happens as much in analog as in digital phenomena, e.g. strategy must adapt as power or capability increase, but power does not grow in discrete units.

  6. Meta-epi-phenomena would be something observable only over extremely long timeframes for most phenomena with which we are familiar. Kondratiev cycles (45-60 years) and Forrester waves (200 years) would be examples from economics and sociology. The existence of such long patterns, whose period is outside the scope of our limited record, is part of the explanation for black swan type phenomena. I imagine that there are small models, probably in physics and biology, where the dynamcs of such systems could be worked out in detail, then recognized in longer term examples based on partial data. As the patterns of systems theory are largely substratum independent, patterns discovered in one area are relevant to another. A well organized sub-discipline would better allow for the abstraction of higher-order patterns from their original fields of discovery and facilitate interdisciplinary transmission of knowledge. A pattern well characterized in observations of one phenomenon might be revolutionary to another area where the phenomenon is insufficiently well observed to know the entire continuum of behavior, but observed well enough to recognize that it is an instance of the former pattern. Systems-type phenomena are present throughout the various sciences. Just as mathematics is used throughout the sciences, but is consolidated into a discipline of its own, so too systems science should become a better organized and consolidated sub-discipline. As it involves such a diverse range of the sciences, it would be an interdisciplinary field, not one as autonomous as mathematics.

  7. While none fundamental, there are, presumably, a finite set of possible system patterns. I wrote on the possibility of cataloguing and organizing them on some sort of periodic table of logics in “Formal Cognition,” 1 January 2008.

  8. Animals have developed a variety of different types and levels of intelligence; there’s no reason to think that machine intelligence will be any different.

  9. The problem is that the data sets that we have aren’t big enough, granular enough and are riddled with bad data. With two points you can’t tell linear from geometric growth. With three points you can’t tell geometric growth from linear growth with noise. And of course it gets much worse than this. And we don’t even know how to operationalize a large segment of the really interesting phenomena. How would we quantify something as elusive as national power — something international relations theorists are trying to do all the time — when even the component statistics are a mess?

Emergence and Aufhebung (Hegel and the Swarm)

I like Charles Mudede’s scaled down explanation of emergence (“Interlace in Dubai,” SLOG, 3 December 2008):

In the theory of emergence it is understood that complexity has a limit. For example, when the population of an ant colony reaches a certain point, 80,000 or so, changes begin to happen. Army ants swarm another colony or lots of ants move out and wander or start a new colony. What is clear is one behavior ends and another one begins.

One controlling logic relinquishes to a subsequent controlling logic. Emergence is a discontinuity in growth.

I don’t know that he is right to characterize this as “complexity having a limit.” An emergent property is an aufhebung: a simultaneous preservation and transformation. The emergent property doesn’t sweep aside all previous behavior, but preserves the original behavior and builds a new layer or interpretive characteristics on top of it. I think of “the invisible hand” of capitalist markets here. People don’t stop bargaining when market clearing happens. People continue to negotiate, clip coupons, shop around, seek out sales, innovate, invest and compete. Market clearing is a second order interpretation of the ground level behavior that persists just under this interpretive overlay. Or in the example of the prisoners’ dilemma, the participants don’t cease to be rational outcome maximizes when the logic of suboptimum outcomes takes over. Their goals and reasoning stay the same. If anything, by preserving all the original complexity and adding a superstructure of new behavior, emergence is complexity unbound from its first order confines.