Seeing ourselves as eddies in the stream of entropy

Of the hundreds of essays written to commemorate the 200th anniversary of Charles Darwin's birth, I think one of the most engaging is offered by Matt Ridley in the Spectator magazine. A few clips:

Living beings are eddies in the stream of entropy. That is to say, while the universe gradually becomes more homogeneous and disordered, little parts of it can reverse the trend and become briefly more ordered and complex by capturing packets of energy. It happens each time a baby is conceived. Built by 20,000 genes that turn each other on and off in a symphony of great precision, and equipped with a brain of ten trillion synapses, each refined and remodeled by early and continuing experience, you are a thing of exquisite neatness, powered by glucose. Says Darwin, this came about by bottom-up emergence, not top-down dirigisme. Faithful reproduction, occasional random variation and selective survival can be a surprisingly progressive and cumulative force: it can gradually build things of immense complexity. Indeed, it can make something far more complex than a conscious, deliberate designer ever could: with apologies to William Paley and Richard Dawkins, it can make a watchmaker.

Malthus taught Darwin the bleak lesson that overbreeding must end in pestilence, famine or violence — and hence gave him the insight that in a struggle for existence, survival could be selective. But the notion that, with random variation, this selective survival could then generate complexity and sophistication where there had been none before, that it is a cumulative and creative force, is entirely his. It is also one that applies to more than the bodies of living beings.

Technology is a case in point. Although engineers are under the fond illusion that they design things, nearly all of what they do consists of nudging forward descent with modification. Every technology has traceable ancestry; ‘to create is to recombine’ said the geneticist François Jacob. The first motor car was once described by the historian L.T.C. Rolt as ‘sired by the bicycle out of the horse carriage’. Just like living systems, technologies experience mutation (such as the invention of the spinning jenny), reproduction (the rapid mechanisation of the cotton industry as manufacturers copied each others’ machines), sex (Samuel Crompton’s combination of water frame and jenny to make a ‘mule’), competition (different designs competing in the early cotton mills), extinction (the spinning jenny was obsolete by 1800), and increasing complexity (modern cotton mills are electrified and computerised).

Software inventors have learnt to recognise the power of trial and error rather than deliberate design. Beginning with ‘genetic algorithms’ in the 1980s, they designed programmes that would experiment with changes in their sequence till they solved the problem set for them. Then gradually the open-source software movement emerged by which users themselves altered programmes and shared their improvements with each other. Linux and Apache are operating systems designed by such democratic methods, but the practice has long spread beyond programmers. Wikipedia is a bottom-up knowledge repository and, though far from flawless, is proving easily capable, even in its first flush of youth, of matching expert-written encyclopaedias for accuracy and reach. It grows by natural selection among edits.

The internet is an increasingly Darwinian place, where decentralised, self-organising sophistication holds sway: swarm intelligence is the fashionable term. Trey Ratcliff, founder of a computer games company in Texas, tells me he feels more like a victim than a designer of technology’s evolution: ‘saying Edison invented the phonograph is like saying a spider invented silk’.