Showing posts with label consciousness. Show all posts
Showing posts with label consciousness. Show all posts

Monday, April 29, 2024

An expanded view of human minds and their reality.

I want to pass on this recent essay by Venkatesh Rao in its entirety, because it has changed my mind on agreeing with Daniel Dennett that the “Hard Problem” of consciousness is a fabrication that doesn’t actually exist. There are so many interesting ideas in this essay that I will be returning to it frequently in the future.  

We Are All Dennettians Now

An homage riff on AI+mind+evolution in honor of Daniel Dennett

The philosopher Daniel Dennett (1942-2024) died last week. Dennett’s contributions to the 1981 book he co-edited with Douglas Hofstadter, The Mind’s I,¹ which I read in 1996 (rather appropriately while doing an undergrad internship at the Center for AI and Robotics in Bangalore), helped shape a lot of my early philosophical development. A few years later (around 1999 I think), I closely read his trollishly titled 1991 magnum opus, Consciousness Explained (alongside Steven Pinker’s similar volume How the Mind Works), and that ended up shaping a lot of my development as an engineer. Consciousness Explained is effectively a detailed neuro-realistic speculative engineering model of the architecture of the brain in a pseudo-code like idiom. I stopped following his work closely at that point, since my tastes took me in other directions, but I did take care to keep him on my radar loosely.

So in his honor, I’d like to (rather chaotically) riff on the interplay of the three big topics that form the through-lines of his life and work: AI, the philosophy of mind, and Darwinism. Long before we all turned into philosophers of AI overnight with the launch of ChatGPT, he defined what that even means.

When I say Dennett’s views shaped mine, I don’t mean I necessarily agreed with them. Arguably, your early philosophical development is not shaped by discovering thinkers you agree with. That’s for later-life refinements (Hannah Arendt, whom I first read only a few years ago, is probably the most influential agree-with philosopher for me). Your early development is shaped by discovering philosophers you disagree with.

But any old disagreement will not shape your thinking. I read Ayn Rand too (if you want to generously call her a philosopher) around the same time I discovered Dennett, and while I disagreed with her too, she basically had no effect on my thinking. I found her work to be too puerile to argue with. But Dennett — disagreeing with him forced me to grow, because it took serious work over years to decades — some of it still ongoing — to figure out how and why I disagreed. It was philosophical weight training. The work of disagreeing with Dennett led me to other contemporary philosophers of mind like David Chalmers and Ned Block, and various other more esoteric bunnytrails. This was all a quarter century ago, but by the time I exited what I think of as the path-dependent phase of my philosophical development circa 2003, my thinking bore indelible imprints of Dennett’s influence.

I think Dennett was right about nearly all the details of everything he touched, and also right (and more crucially, tasteful) in his choices of details to focus on as being illuminating and significant. This is why he was able to provide elegant philosophical accounts of various kinds of phenomenology that elevated the corresponding discourses in AI, psychology, neuroscience, and biology. His work made him a sort of patron philosopher of a variety of youngish scientific disciplines that lacked robust philosophical traditions of their own. It also made him a vastly more relevant philosopher than most of his peers in the philosophy world, who tend, through some mix of insecurity, lack of courage, and illiteracy, to stay away from the dirty details of technological modernity in their philosophizing (and therefore cut rather sorry figures when they attempt to weigh in on philosophy-of-technology issues with cartoon thought experiments about trolleys or drowning children). Even the few who came close, like John Searle, could rarely match Dennett’s mastery of vast oceans of modern techno-phenomenological detail, even if they tended to do better with clever thought experiments. As far as I am aware, Dennett has no clever but misleading Chinese Rooms or Trolley Problems to his credit, which to my mind makes him a superior rather than inferior philosopher.

I suspect he paid a cost for his wide-ranging, ecumenical curiosities in his home discipline. Academic philosophers like to speak in a precise code about the simplest possible things, to say what they believe to be the most robust things they can. Dennett on the other hand talked in common language about the most complex things the human mind has ever attempted to grasp. The fact that he got his hands (and mind!) dirty with vast amounts of technical detail, and dealt in facts with short half-lives from fast-evolving fields, and wrote in a style accessible to any intelligent reader willing to pay attention, made him barely recognizable as a philosopher at all. But despite the cosmetic similarities, it would be a serious mistake to class him with science popularizers or TED/television scientists with a flair for spectacle at the expense of substance.

Though he had a habit of being uncannily right about a lot of the details, I believe Dennett was almost certainly wrong about a few critical fundamental things. We’ll get to what and why later, but the big point to acknowledge is that if he was indeed wrong (and to his credit, I am not yet 100% sure he was), he was wrong in ways that forced even his opponents to elevate their games. He was as much a patron philosopher (or troll or bugbear) to his philosophical rivals as to the scientists of the fields he adopted. You could not even be an opponent of Dennett except in Dennettian ways. To disagree with the premises of Strong AI or Dennett’s theory of mind is to disagree in Dennettian ways.

If I were to caricature how I fit in the Dennettian universe, I suspect I’d be closest to what he called a “mysterian” (though I don’t think the term originated with him). Despite mysterian being something of a dismissive slur, it does point squarely at the core of why his opponents disagree with him, and the parts of their philosophies they must work to harden and make rigorous, to withstand the acid forces of the peculiarly Dennetian mode of scrutiny I want to talk about here.

So to adapt the line used by Milton Friedman to describe Keynes: We are all Dennettians now.

Let’s try and unpack what that means.


As I said, in Dennettian terms, I am a “mysterian.” At a big commitments level, mysterianism is the polar opposite of the position Dennett consistently argued across his work, a version of what we generally call a “Strong AI” position. But at the detailed level, there are no serious disagreements. Mysterians and Strong AI people agree about most of the details of how the mind works. They just put the overall picture together differently because mysterians want to accommodate certain currently mysterious things that Strong AI people typically reject as either meaningless noise or shallow confusions/illusions.

Dennett’s version of Strong AI was both more robustly constructed than the sophomoric versions one typically encounters, and more broadly applied: beyond AI to human brains and seemingly intelligent processes like evolution. Most importantly, it was actually interesting. Reading his accounts of minds and computers, you do not come away with the vague suspicion of a non-neurotypical succumbing to the typical-mind fallacy and describing the inner life of a robot or philosophical zombie as “truth.” From his writing, it sounds like he had a fairly typical inner-life experience, so why did he seem to deny the apparent ineffable essence of it? Why didn’t he try to eff that essence the way Chalmers, for instance, does? Why did he seemingly dismiss it as irrelevant, unreal, or both?

To be a mysterian in Dennettian terms is to take ineffable, vitalist essences seriously. With AIs and minds, it means taking the hard problem of consciousness seriously. With evolution, it means believing that Darwinism is not the whole story. Dennett tended to use the term as a dismissive slur, but many, (re)claim it as a term of approbation, and I count myself among them.

To be a rigorous mysterian, as opposed to one of the sillier sorts Dennett liked to stoop to conquer (naive dualists, intelligent-designers, theological literalists, overconfident mystics…), you have to take vitalist essences “seriously but not literally.” My version of doing that is to treat my vitalist inclinations as placeholder pointers to things that lurk in the dank, ungrokked margins of the thinkable, just beyond the reach of my conceptualizing mind. Things I suspect exist by the vague shapes of the barely sensed holes they leave in my ideas. In pursuit of such things, I happily traffic in literary probing of Labatutian/Lovecraftian/Ballardian varieties, self-consciously magical thinking, junk from various pre-paradigmatic alchemical thought spaces, constructs that uncannily resemble astrology, and so on. I suppose it’s a sort of intuitive-ironic cognitive kayfabe for the most part, but it’s not entirely so.

So for example, when I talk of elan vital, as I frequently do in this newsletter, I don’t mean to imply I believe in some sort of magical fluid flowing through living things or a Gaian planetary consciousness. Nor do I mean the sort of overwrought continental metaphysics of time and subjectivity associated with Henri Bergson (which made him the darling of modernist literary types and an object of contempt to Einstein). I simply mean I suspect there are invisible things going on in the experience and phenomenology of life that are currently beyond my ability to see, model, and talk about using recognizably rational concepts, and I’d rather talk about them as best I can with irrational concepts than pretend they don’t exist.

Or to take another example, when I say that “Darwin is not the whole story,” I don’t mean I believe in intelligent design or a creator god (I’m at least as strong an atheist as Dennett was). I mean that Darwinian principles of evolution constrain but do not determine the nature of nature, and we don’t yet fully grok what completes the picture except perhaps in hand-wavy magical-thinking ways. To fully determine what happens, you need to add more elements. For example, you can add ideas like those of Stuart Kauffman and other complexity theorists. You could add elements of what Maturana and Varela called autopoiesis. Or it might be none of these candidate hole-filling ideas, but something to be dreamt up years in the future. Or never. But just because there are only unsatisfactory candidate ways for talking about stuff doesn’t mean you should conclude the stuff doesn’t exist.

In all such cases, there are more things present in phenomenology I can access than I can talk about using terms of reference that would be considered legitimate by everybody. This is neither known-unknowns (which are holes with shapes defined by concepts that seem rational), nor unknown-unknown (which have not yet appeared in your senses, and therefore, to apply a Gilbert Ryle principle, cannot be in your mind).

These are things that we might call magically known. Like chemistry was magically known through alchemy. For phenomenology to be worth magically knowing, the way-of-knowing must offer interesting agency, even if it doesn’t hang together conceptually.

Dennett seemed to mostly fiercely resist and reject such impulses. He genuinely seemed to think that belief in (say) the hard problem of consciousness was some sort of semantic confusion. Unlike say B. F. Skinner, whom critics accused of only pretending to not believe in inner processes, Dennett seemed to actually disbelieve in them.

Dennett seemed to disregard a cousin to the principle that absence of evidence is not evidence of absence: Presence of magical conceptualizations does not mean absence of phenomenology. A bad pointer does not disprove the existence of what it points to. This sort of error is easy to avoid in most cases. Lightning is obviously real even if some people seem to account for it in terms of Indra wielding his vajra. But when we try to talk of things that are on the phenomenological margins, barely within the grasp of sensory awareness, or worse, potentially exist as incommunicable but universal subjective phenomenology (such as the experience of the color “blue”), things get tricky.

Dennett was a successor of sorts to philosophers like Gilbert Ryle, and psychologists like B. F. Skinner. In evolutionary philosophy, his thinking aligned with people like Richard Dawkins and Steven Pinker, and against Noam Chomsky (often classified as a mysterian, though I think the unreasonable effectiveness of LLMs kinda vindicates to a degree Chomsky’s notions of an ineffable more-than-Darwin essence around universal grammars that we don’t yet understand).

I personally find it interesting to poke at why Dennett took the positions he took, given that he was contemplating the same phenomenological data and low-to-mid-level conceptual categories as the rest of us (indeed, he supplied much of it for the rest of us). One way to get at it is to ask: Was Dennett a phenomenologist? Are the limits of his ideas are the limits of phenomenology?

I think the answers are yes and yes, but he wasn’t a traditional sort of phenomenologist, and he didn’t encounter the more familiar sorts of limits.

The Limits of Phenomenology

Let’s talk regular phenomenology first, before tackling what I think was Dennett’s version.

I think of phenomenology, as a working philosophical method, to be something like a conceited form of empiricism that aims to get away from any kind of conceptually mediated seeing.

When you begin to inquire into a complex question with any sort of fundamentally empirical approach, your philosophy can only be as good as a) the things you know now through your (potentially technologically augmented) senses and b) the ways in which you know those things.

The conceit of phenomenology begins with trying to “unknow” what is known to be known, and contemplate the resulting presumed “pure” experiences “directly.” There are various flavors of this: Husserlian bracketing in the Western tradition, Zen-like “beginner mind” practices, Vipassana style recursive examination of mental experiences, and so on. Some flavors apply only to sense-observations of external phenomena, others apply only to subjective introspection, and some apply to both. Given the current somewhat faddish uptick in Eastern-flavored disciplines of interiority, it is important to take note of the fact that the phenomenological attitude is not necessarily inward-oriented. For example, the 19th century quest to measure a tenth of a second, and factor out the “human equation” in astronomical observations, was a massive project in Western phenomenology. The abstract thought experiments with notional clocks in the theory of relativity began with the phenomenology of real clocks.

In “doing” phenomenology, you are assuming that you know what you know relatively completely (or can come to know it), and have a reliable procedure for either unknowing it, or systematically alloying it with skeptical doubt, to destabilize unreliable perceptions it might be contributing to. Such destabilizability of your default, familiar way of knowing, in pursuit of a more-perfect unknowing, is in many ways the essence of rationality and objectivity. It is the (usually undeclared) starting posture for doing “science,” among other things.

Crucially, for our purposes in this essay, you do not make a careful distinction between things you know in a rational way and things you know in a magical or mysterian way, but effectively assume that only the former matter; that the latter can be trivially brushed aside as noise signifying nothing that needs unknowing. I think the reverse is true. It is harder, to the point of near impossible, to root out magical ideas from your perceptions, and they signify the most important things you know. More to the point, it is not clear that trying to unknow things, especially magical things, is in fact a good idea, or that unknowing is clarifying rather than blinding. But phenomenology is committed to trying. This has consequences for “phenomenological projects” of any sort, be they Husserlian or Theravadan in spirit.

A relatively crude example: “life” becomes much less ineffable (and depending on your standards, possibly entirely drained of mystery) once you view it through the lens of DNA. Not only do you see new things through new tools, you see phenomenology you could already see, such as Mendelian inheritance, in a fundamentally different way that feels phenomenologically “deeper” when in fact it relies on more conceptual scaffolding, more things that are invisible to most of us, and requires instruments with elaborate theories attached to even render intelligible. You do not see “ATCG” sequences when contemplating a pea flower. You could retreat up the toolchain and turn your attention to how instruments construct the “idea of DNA” but to me that feels like a usually futile yak shave. The better thing to do is ask why a more indirect way of knowing somehow seems to perceive more clearly than more direct ways.

It is obviously hard to “unsee” knowledge of DNA today when contemplating the nature of life. But it would have been even harder to recognize that something “DNA shaped” was missing in say 1850, regardless of your phenomenological skills, by unknowing things you knew then. In fact, clearing away magical ways of knowing might have swept away critical clues.

To become aware, as Mendel did, that there was a hidden order to inheritance in pea flowers, takes a leap of imagination that cannot be purely phenomenological. To suspect in 1943, as Schrodinger did, the existence of “aperiodic covalent bonded crystals” at the root of life, and point the way to DNA, takes a blend of seeing and knowing that is greater than either. Magical knowing is pathfinder-knowing that connects what we know and can see to what we could know and see. It is the bootstrapping process of the mind.

Mendel and Schrodinger “saw” DNA before it was discovered, in terms of reference that would have been considered “rational” in their own time, but this has not always been the case. Newton, famously, had a lot of magical thinking going on in his successful quest for a theory of gravity. Kepler was a numerologist. Leibniz was ball of mad ideas. One of Newton’s successful bits of thinking, the idea of “particles” of light, which faced off against Huygens’ “waves,” has still not exited the magical realm. The jury is still out in our time about whether quantized fields are phenomenologically “real” or merely a convenient mnemonic-metaphoric motif for some unexpected structure in some unreasonably effective math.

Arguably, none of these thinkers was a phenomenologist, though all had a disciplined empirical streak in their thinking. The history of their ideas suggests that phenomenology is no panacea for philosophical troubles with unruly conceptual universes that refuse to be meekly and rationally “bracketed” away. There is no systematic and magic-free way to march from current truths to better ones via phenomenological disciplines.

The fatal conceit of naive phenomenology (which Paul Feyerabend spotted) is the idea that there is privileged reliable (or meta-reliable) “technique” of relating to your sense experiences, independent of the concepts you hold, whether that “technique” is Husserlian bracketing or vipassana. Understood this way, theories of reality are not that different from physical instruments that extend our senses. Experiment and theory don’t always expose each other’s weaknesses. Sometimes they mutually reinforce them.

In fact, I would go so far as to suggest—and I suspect Dennett would have agreed—that there is no such thing as phenomenology per se. All we ever see is the most invisible of our theories (rational and magical), projected via our senses and instruments (which shape, and are shaped by, those theories), onto the seemingly underdetermined aspects of the universe. There are only incomplete ways of knowing and seeing within which ideas and experiences are inextricably intertwined. No phenomenological method can consistently outperform methodological anarchy.

To deny this is to be a traditional phenomenologist, striving to procedurally separate the realm of ideas and concepts from the realm of putatively unfactored and “directly perceived” (a favorite phrase of meditators) “real” experiences.

Husserlian bracketing — “suspending trust in the objectivity of the world” — is fine in theory, but not so easy in practice. How do you know that you’re setting aside preconceived notions, judgments, and biases and attending to a phenomenon as it truly is? How do you set aside the unconscious “theory” that the Sun revolves around the Earth, and open your mind to the possibility that it’s the other way around? How do you “see” DNA-shaped holes in current ways of seeing, especially if they currently manifest as strange demons that you might sweep away in a spasm of over-eager epistemic hygiene? How do you relate, as a phenomenologist, to intrinsically conceptual things like electrons and positrons that only exist behind layers of mathematics describing experimental data processed through layers of instrumentation conceived by existing theories? If you can’t check the math yourself, how can you trust that the light bulb turning on is powered by those “electrons” tracing arcs through cloud chambers?

In practice, we know how such shifts actually came about. Not because philosophers meditated dispassionately on the “phenomenology” with free minds seeing reality as it “truly is,” but because astronomers and biologists with heads full of weird magical notions looked through telescopes and microscopes, maintained careful notes of detailed measurements, informed by those weird magical theories, and tried to account for discrepancies. Tycho Brahe, for instance, who provided the data that dethroned Ptolemy, believed in some sort of Frankenstein helio-geo-centric Ptolemy++ theory. Instead of explaining the discrepancies, as Kepler did later, Brahe attempted to explain them away using terms of reference he was attached to. He failed to resolve the tension. But he paved the way to Kepler resolving that particular tension (who of course introduced new ones, while lost in his own magical thinking about platonic solids). Formally phenomenological postures were not just absent from the story, but would have arguably retarded it by being too methodologically conservative.

Phenomenology, in other words, is something of a procedural conceit. An uncritical trust in self-certifying ways of seeing based entirely on how compelling they seem to the seer. The self-certification follows some sort of seemingly rational procedure (which might be mystical but still rational in the sense of being coherent and disciplined and internally consistent) but ultimately derives its authority from the intuitive certainties and suspicions of the perceiving subject. Phenomenological procedures are a kind of rule-by-law for governing sense experience in a laissez-faire way, rather than the “objective” rule-of-law they are often presented as. Phenomenology is to empiricism as “socialism with Chinese characteristics” is to liberal democracy.

This is not to say phenomenology is hopelessly unreliable or useless. All methodologies have their conceits, which manifest as blindspots. With phenomenology, the blindspot manifests as an insistence on non-magicality. The phenomenologist fiercely rejects the Cartesian theater and the varied ghosts-in-machines that dance there. The meditator insists he is “directly perceiving” reality in a reproducible way, no magic necessary. I do not doubt that these convictions are utterly compelling to those who hold them; as compelling as the incommunicable reality of perceiving “blue” is to everybody. I have no particular argument with such insistence. What I actually have a problem with is the delegitimization of magical thinking in the process, which I suspect to be essential for progress.

My own solution is to simply add magical thinking back into the picture for my own use, without attempting to defend that choice, and accepting the consequences.

For example, I take Myers-Briggs and the Enneagram seriously (but not literally!). I believe in the hard problem of consciousness, and therefore think “upload” and “simulationism” ideas are not-even-wrong. I don’t believe in Gods or AGIs, and therefore don’t see the point of Pascal’s wager type contortions to avoid heaven/hell or future-simulated-torture scenarios. In each case my commitments rely on chains of thought that are at least partly magical thinking, and decidedly non-phenomenological, which has various social consequences in various places. I don’t attempt to justify any of it because I think all schemes of justification, whether they are labeled “science” or something else, rest on traditional phenomenology and its limits.

Does this mean solipsism is the best we can hope for? This is where we get back to Dennett.

Dennett, to his credit, I don’t think he was a traditional phenomenologist, and he mostly avoided all the traps I’ve pointed out, including the trap of solipsism. Nor was he what one might call a “phenomenologist of language” like most modern analytical philosophers in the West. He was much too interested in technological modernity (and the limits of thought it has been exposing for a century) to be content with such a shrinking, traditionalist philosophical range.

But he was a phenomenologist in the broader sense of rejecting the possible reality of things that currently lack coherent non-magical modes of apprehension.

So how did he operate if not in traditional phenomenological ways?

Demiurge Phenomenology

I believe Dennett was what we might call a demiurge phenomenologist, which is a sort of late modernist version of traditional phenomenology. It will take a bit of work to explain what I mean by that.

I can’t recall if he ever said something like this (I’m definitely not a completist with his work and have only read a fraction of his voluminous output), but I suspect Dennett believed that the human experience of “mind” is itself subject to evolutionary processes (think Jaynes and bicameral mind theories for example — I seem to recall him saying something approving about that in an interview somewhere). He sought to construct philosophy in ways that did not derive authority from an absolute notion of the experience of mind. He tried to do relativity theory for minds, but without descending into solipsism.

It is easiest to appreciate this point by starting with body experience. For example, we are evolved from creatures with tails, but we do not currently possess tails. We possess vestigial “tail bones” and presumably bits of DNA relevant to tails, but we cannot know what it is like to have a tail (or in the spirit of mysterian philosopher Thomas Nagel’s What is it Like to Be a Bat provocation, which I first read in The Mind’s I, what it is like for a tailed creature to have a tail).

We do catch tantalizing Lovecraftian-Ballardian glimpses of our genetic heritage though. For example, the gasping reflex and shot of alertness that accompanies being dunked in water (the mammalian dive reflex) is a remnant of a more aquatic evolutionary past that far predates our primate mode of existence. Now apply that to the experience of “mind.”

Why does Jaynes’ bicameral mind theory sound so fundamentally crackpot to modern minds? It could be that the notion is actually crackpot, but you cannot easily dismiss the idea that it’s actually a well-posed notion that only appears crackpot because we are not currently possessed of bicameral mind-experiences (modulo cognitive marginalia like tulpas and internal family systems — one of my attention/taste biases is to index strongly on typical rather than rare mental experiences; I believe the significance of the latter is highly overstated due to the personal significance they acquire in individual lives).

I hope it is obvious why the possibility that the experience of mind is subject to evolution is fatal to traditional phenomenology. If despite all the sophistication of your cognitive toolchain (bracketing, jhanas, ketamine, whatever), it turns out that you’re only exploring the limits of the evolutionarily transient and arbitrary “variety of mind” that we happen to experience, what does that say about the reliability of the resulting supposedly objective or “direct” perceptions of reality itself that such a mind mediates?

This, by the way, is a problem that evolutionary terms of reference make elegantly obvious, but you can get here in other ways. Darwinian evolution is convenient scaffolding to get there (and the one I think Dennett used), but ultimately dispensable. But however you get there, the possibility that experiences of mind are relative to contingent and arbitrary evolutionary circumstances is fatal to the conceits of traditional phenomenology. It reduces traditional phenomenology in status to any old sort of Cartesian or Platonic philosophizing with made-up bullshit schemas. You might as well make 2x2s all day like I sometimes do.

The Eastern response to this quandary has traditionally been rather defeatist — abandoning the project of trying to know reality entirely. Buddhist and Advaita philosophies in particular, tend to dispense with “objective reality” as an ontologically meaningful characterization of anything. There is only nothing. Or only the perceiving subject. Everything else is maya-moh, a sentimental attachment to the ephemeral unreal. Snap out of it.

I suspect Western philosophy was starting to head that way in the 16th century (through the Spinoza-vs-Leibniz shadowboxing years), but was luckily steered down a less defeatist path to a somewhat uneasy detente between a sort of “probationary reality” accessed through technologically augmented senses, and a subjectivity resolutely bound to that probationary reality via the conceits of traditional phenomenology. This is a long-winded way of saying “science happened” to Western philosophy.

I think that detente is breaking down. One sign is the growing popularity of the relatively pedestrian metaphysics of physicists like Donald Hoffman (leading to a certain amount of unseemly glee among partisans of Eastern philosophies — “omigod you think quantum mechanics shows reality is an illusion? Welcome to advaita lol”).

But despite these marginally interesting conversations, and whether you get there via Husserl, Hoffman, or vipassana, we’re no closer to resolving what we might call the fundamental paradox of phenomenology. If our experience of mind is contingent, how can any notion of justifiable absolute knowledge be sustained? We are essentially stopped clocks trying to tell the time.

Dennett, I think favored one sort of answer: That the experience of mind was too untrustworthy and transient to build on, but that mind’s experience of mathematics was both trustworthy and absolute. Bicameral or monocameral, dolphin-brain or primate-brain, AI-brain or Hoffman-optimal ontological apparatus, one thing that is certain is that a prime number is a prime number in all ways that reality (probationary or not, illusory or not) collides with minds (typical or atypical, bursting with exotic qualia or full of trash qualia). Even the 17 and 13 year cicadas agree. Prime numbers constitute a fixed point in all the ways mind-like things have experience-like things in relation to reality-like things, regardless of whether minds, experiences, and reality are real. Prime numbers are like a motif that shows up in multiple unreliable dreams. If you’re going to build up a philosophy of being, you should only use things like prime numbers.

This is not just the most charitable interpretation of Dennett’s philosophy, but the most interesting and powerful one. It’s not that he thought of the mysterian weakness for ineffable experiences as being particularly “illusory”. As far as he was concerned, you could dismiss the “experience of mind” in its entirety as irrelevant philosophically. Even the idea that it has an epiphenomenal reality need not be seriously entertained because the thing that wants to entertain that idea is not to be trusted.

You see signs of this approach in a lot of his writing. In his collaborative enquires with Hofstadter, in his fundamentally algorithmic-mathematical account of evolution, in his seemingly perverse stances in debates both with reputable philosophers of mind and disreputable intelligent designers. As far as he was concerned, anyone who chose to build any theory of anything on the basis of anything other than mathematical constancy was trusting the experience of mind to an unjustifiable degree.

Again, I don’t know if he ever said as much explicitly (he probably did), but I suspect he had a basic metaphysics similar to that of another simpatico thinker on such matters, Roger Penrose: as a triad of physical/mental/platonic-mathematical worlds projecting on to each other in a strange loop. But unlike Penrose, who took the three realms to be equally real (or unreal) and entangled in an eternal dance of paradox, he chose to build almost entirely on the Platonic-mathematical vertex, with guarded phenomenological forays to the physical world, and strict avoidance of the mental world as a matter of epistemological hygiene.

The guarded phenomenological forays, unlike those of traditional phenomenologists, were governed by an allow list rather than a block list. Instead of trying to “block out” suspect conceptual commitments with bracketing or meditative discipline, he made sure to only work with allowable concepts and percepts that seemed to have some sort of mathematical bones to them. So Turing machines, algorithms, information theory, and the like, all made it into his thinking in load-bearing ways. Everything else was at best narrative flavor or useful communication metaphors. People who took anything else seriously were guilty of deep procedural illusions rather than shallow intellectual confusions.

If you think about it, his accounts of AI, evolution, and the human mind make a lot more sense if you see them as outcomes of philosophical construction processes governed by one very simple rule: Only use a building block if it looks mathematically real.

Regardless of what you believe about the reality of things other than mathematically underwritten ones, this is an intellectually powerful move. It is a kind of computational constructionism applied to philosophical inquiry, similar to what Wolfram does with physics on automata or hypergraphs, or what Grothendieck did with mathematics.

It is also far harder to do, because philosophy aims and claims to speak more broadly and deeply than either physics or mathematics.

I think Dennett landed where he did, philosophically, because he was essentially trying to rebuild the universe out of a very narrow admissible subset of the phenomenological experience of it. Mysterian musings didn’t make it in because they could not ride allowable percepts and concepts into the set of allowable construction materials.

In other words, he practiced demiurge phenomenology. Natural philosophy as an elaborate construction practice based on self-given rules of construction.

In adopting such an approach he was ahead of his time. We’re on the cusp of being able to literally do what he tried to do with words — build phenomenologically immersive virtual realities out of computational matter that seem to be defined by nothing more than mathematical absolutes, and have almost no connection even to physical reality, thanks to the seeming buffering universality of Turing-equivalent computation.

In that almost, I think, lies the key to my fundamental disagreement with Dennett, and my willingness to wander in magical realms of thought where mathematically sure-footed angels fear to tread. There are… phenomenological gaps between mathematical reconstructions of reality by energetic demiurges (whether they work with powerful arguments or VR headsets) and reality itself.

The biggest one, in my opinion, is the experience of time, which seems to oddly resist computational mathematization (though Stephen Wolfram claims to have one… but then he claims to have a lot of things). In an indirect way, disagreeing with Dennett at age 20 led me to my lifelong fascination with the philosophy of time.

Where to Next?

It is something of a cliche that over the last century or two, philosophy has gradually and reluctantly retreated from an increasing number of the domains it once claimed as its own, as scientific and technological advances rendered ungrounded philosophical ideas somewhere between moot and ridiculous. Bergson retreating in the face of the Einsteinian assault, ceding the question of the nature of time to physics, is probably as good a historical marker of the culmination of the process as any.

I would characterize Dennett as a late modernist philosopher in relation to this cliche. Unlike many philosophers, who simply gave up on trying to provide useful accounts of things that science and technology were beginning to describe in inexorably more powerful ways, he brought enormous energy to the task of simply keeping up. His methods were traditional, but his aim was radical: Instead of trying to provide accounts of things, he tried to provide constructions of things, aiming to arrive at a sense of the real through philosophical construction with admissible materials. He was something like Brouwer in mathematics, trying to do away with suspect building blocks to get to desirable places only using approved methods.

This actually worked very well, as far as it went. For example, I think his philosophy of mind was almost entirely correct as far as the mechanics of cognition go, and the findings of modern AI vindicate a lot of the specifics. For example, his idea of a “multiple drafts” model of cognition (where one part of the brain generates a lot of behavioral options in a bottom-up, anarchic way, and another part chooses a behavior from among them) is basically broadly correct, not just as a description of how the brain works, but of how things like LLMs work. But unlike many other so-called philosophers of AI he disagreed with, like Nick Bostrom, Dennett’s views managed to be provocative without being simplistic, opinionated without being dogmatic. He appeared to have a Strong AI stance similar to many people I disagree with, but unlike most of those people, I found his views worth understanding with some care, and hard to dismiss as wrong, let alone not-even-wrong.

I like to think he died believing his philosophies — of mind, AI, and Darwinism — to be on the cusp of a triumphant redemption. There are worse ways to go than believing your ideas have been thoroughly vindicated. And indeed, there was a lot Dennett got right. RIP.

Where do we go next with Dennettian questions about AI, minds, and evolution?

Oddly enough, I think Dennett himself pointed the way: demiurge phenomenology is the way. We just need to get more creative with it, and admit magical thinking into the process.

Dennett, I think, approached his questions the way some mathematicians originally approached Euclid’s fifth postulate: Discard it and try to either do without, or derive it from the other postulates. That led him to certain sorts of demiurgical constructions of AI, mind, and evolution.

There is another, equally valid way. Just as other mathematicians replaced the fifth postulates with alternatives and ended up with consistent non-Euclidean geometries, I think we could entertain different mysterian postulates and end up with a consistent non-Dennettian metaphysics of AI, mind, and evolution. You’d proceed by trying to do your own demiurgical constructing of a reality. An alternate reality.

For instance, what happens if you simply assume that there is human “mind stuff” that ends with death and cannot be uploaded or transferred to other matter, and that can never emerge in silico. You don’t have to try accounting for it (no need to mess with speculations about the pineal gland like Descartes, or worry about microtubules and sub-Planck-length phenomena like Penrose). You could just assume that consciousness is a thing like space or time, and run with the idea and see where you land and what sort of consistent metaphysical geometries are possible. This is in fact what certain philosophers of mind like Ned Block do.

The procedure can be extended to other questions as well. For instance, if you think Darwin is not the whole story with evolution, you could simply assume there are additional mathematical selection factors having to do with fractals or prime numbers, and go look for them, as the Santa Fe biologists have done. Start simple and stupid, for example, by applying a rule that “evolution avoids rectangles” or “evolution cannot get to wheels made entirely of grown organic body parts” and see where you land (for the latter, note that the example in Dark Materials trilogy cheats — that’s an assembled wheel, not an evolved one).

But all these procedures follow the basic Dennettian approach of demiurgical constructionist phenomenology. Start with your experiences. Let in an allow-list of percepts as concepts. Add an arbitrarily constructed magical suspicion or two. Let your computer build out the entailments of those starter conditions. See what sort of realities you can conjure into being. Maybe one of them will be more real than your current experience of reality. That would be progress. Perhaps progress only you can experience, but still, progress.

Would such near-solipsistic activities constitute a collective philosophical search for truth? I don’t know. But then, I don’t know if we have ever been on a coherent collective philosophical search for truth. All we’ve ever had is more or less satisfying descriptions of the primal mystery of our own individual existence.

Why is there something, rather than nothing, it is like, to be me?

Ultimately, Dennett did not seem to find that question to be either interesting or serious. But he pointed the way for me to start figuring out why I do. And that’s why I too am a Dennettian.

footnote  1
I found the book in my uncle’s library, and the only reason I picked it up was because I recognized Hofstadter’s name because Godel, Escher, Bach had recently been recommended to me. I think it’s one of the happy accidents of my life that I read The Mind’s I before I read Hofstadter’s Godel, Escher, Bach. I think that accident of path-dependence may have made me a truly philosophical engineer as opposed to just an engineer with a side interest in philosophy. Hofstadter is of course much better known and familiar in the engineering world, and reading him is something of a rite of passage in the education of the more sentimental sorts of engineers. But Hofstadter’s ideas were mostly entertaining and informative for me, in the mode of popular science, rather than impactful. Dennett on the other hand, was impactful.

Wednesday, January 31, 2024

Thoughts on having a self - Deric's MindBlog as WebLog - January 2024

In the spirit of the original personal WebLogs of the 1990s that morphed into Blogs that enjoyed a golden era in the 2000s, I am offering readers a trial version of a putative series of posts containing selected and edited free standing clips from my personal  ‘mind journal’ - which is a subset of paragraphs taken from the larger personal journal that I have been maintaining for over 25 years.  Most of these paragraphs suggest perspectives on how our minds work, some are on random topics. I hope these perspectives might not seem too alien to readers, and possibly be found useful by a few.  Below are some mind journal paragraphs from January 2024.

The I* signifier,  (from a recent discussion) might be a good minimal token for expressing the space or process from which the present moment’s version of a self or I can appear. During moments of renewal or recharge,  when awareness first intuits this process, there can be an intense brief sense of naïveté, openness and joy - excitement at the prospect of novelty, experiencing new things. For original mind no activity is off the table.

Has my timing been right a second time?

In the early 1990s I decided that the cream had been skimmed with respect to discovering the basic molecular steps that turn photons of light into a nerve signal in our eyes. Some of the steps were revealed by experiments in my laboratory. I decided to switch my attention to studying how our minds work, not in direct laboratory experiments, but through studying, writing about, and lecturing on the work of others.

Moving from the early to mid 2020s I’m feeling a second ‘the cream has been skimmed’ sentiment with respect to the biology of mind:  There is a general understanding and acknowledgement by the scientific and educated lay community that our illusory predictive selves are generated by impersonal neuronal nerve nets. There is no 'hard problem of consciousness’ - it is an illusion like everything else in our heads - and the main function of counter theories (explanations at the level of quantum physics, etc.) is to sustain the continued academic employment of those espousing them.

I feel like my 2022 UT Forum lecture, “New Perspectives on how our Minds Work” may have been a last hurrah with respect to studying the Biology of Mind, just as the 1996 Brain and Behavioral Sciences article was a last hurrah in my vision research career.

It is feeling like it's time to let go, to move on…perhaps to art, music, AI, studying the emergence of trans-human forms…..

…if other people choose behaviors that will lead to their demise there is little one can do, even with physical restraint and medication, to compel them to choose otherwise. They are performing a version of their I or self that is self destructive, and that they are unable to escape. 

Some are able to escape to feel redemption in surrender to a higher power, being ‘saved by the Lord’ or a secular equivalent such as non-dual awareness. Both are defined by yielding ultimate agency to something other than the experienced I or self - allowing a return to feeling the sense of security and repose of the newborn infant feeling loving care. As that infant begins to develop an I or ego it loses awareness of how much of its well-being depends on powers beyond its control and generates an illusory sense of agency.  

A general rule is to see people as they are, not as you want them to be. However, if you treat people as you want or expect them to be, not as they are, sometimes they might begin to slowly conform to your expectations.  This would be the basis of the effectiveness of Gandhi’s advice to “Be the change you want to see in the world.”

1/8/24 When attention is at bay, the gremlins will play, letting one’s disposition and temperament be molded more by outside input and less by internal reflection. The ending slide of several of my talks is the simple phrase “pay attention.”  The ability to do that is a good assay of biological aging and a predictor of longevity.

Attention doesn’t have to be ‘at tension.’ Priors that have pre-tensed muscles for the most probable action to be taken can sometimes be let go.

Now that I know that I can go to the engine room and reboot the Deric-OS with relative ease, there is no compelling reason to emphasize remaining there. What is needed is an appropriate balance between the brain’s attentional and default mode (mind wandering or rumination) systems,  just as with sympathetic and parasympathetic autonomic nervous systems. Going to extremes interferes with remaining gently attentive to one’s states of arousal, valence, and agency (A/V/A) and in touch with value, purpose, and meaning (V/P/M).

The point of paying attention is not to be in some sort of constant blissful or calm state, but rather just to be a normal creature. This journal is a useful present centered tool that modulates appropriate function by enhancing recall of the recent past and projected future.

There wants to be a spontaneous dance between intentional and mind wandering modes in the present moment. That way, one might manage to break the pattern of having a morning high energy caffeine fueled attentional focusing, which with the fading of the chemistry turns into an overly aimless mind wandering in the afternoon. Perhaps, if both could be kept in check, one might have a more seamless moving through a day, particularly as one’s energy begins to wane towards its end.  

1/14/24 Trying to describe the 'new platform' (Deric-OS, self center of gravity, I*, where experienced self is coming from) doing frequent resets to zero in the midst of change that toggle the system to problem solving, matching input to appropriate output, like a learning newborn. Short circuiting blips of arousal or fear that are irrelevant, but still able to run from a lion attack. Going with the computer metaphor, ‘processing platform’ as a candidate for a bit of language that describes what is indescribable in words.

Mulling over how little of my self (I*, it)  experience is spent outside of my linguistic narrative self thread.
Arousal/Valence/Agency (real/real/imagined) are the deep structure of the whole show, and well being occurs to the extent that the sliders are the the direction of low/high/high.

Construing oneself as kind and caring caretaker of family and friends yields value, purpose, and meaning (V/P/M), and integrates it with the machine room viscera.. And, the kindness and positivity of the caretaker role nudges the valence part of A/V/A towards being more positive. This supports being a caring presence that observes, listens, asks questions. Wishing the best for others, while letting their experiences and issues be their own.

1/19/24 The pre-linguistic animal platform as experienced center of gravity with language bits that rise from the simmering caldron to enable connections with other humans experienced as ephemeral transient wisps or vapors, with the real biological creature being the vastly larger originating presence, the creature's experienced place of rest and residence.

A grandiose fantasy: The Imperial Poobah, secure in its belief in itself as master of the random, the surfer of uncertainty. Ready to face the  “There be dragons there” description sometimes written on unexplored areas depicted on ancient maps of the world.

1/21/24 There is so little to provide a sustaining narrative in the current social and geopolitical context that expanding awareness towards its interoceptive, prelinguistic, gestural and prosodic animal state becomes more appealing and sustaining, along with letting awareness focus on potential remedies rather than further detailed descriptions of dysfunctions. Being active in pursuing small sanities.

Mulling over the calm and equanimity offered by impersonality, being 'it', the animal, just resting, watching. Also able to be kind and caring in response to input from others, offering sympathy, empathy, and accepting that one might influence but can not  compel fixes to problems that are not one’s own.

Mulling over how I continue to spew out chunks of ideas, presenting them in the flow of the present moment, from which they then recede to become part of a largely lost and unrecognized archive, still accessible in principle by searches - but I frequently have difficulty finding them. My golden bonbons of the moment, finding their resting place among their previous instances. Think of Andrew Sullivan’s once prominent blog ‘The Daily Dish,’ mostly unknown to the present. It doesn’t matter. One still keeps banging out the material.

Monday, January 29, 2024

Mind blog’s first 18 years - what next? A space for discussions among MindBlog readers?

This is post number 5,537 of Deric's MindBlog, which will soon be celebrating its 18th birthday.  I started this blog on Feb. 6, 2006, in the middle of the golden age of Blogging, with a post titled “Dangerous Ideas.”  In the late 2000s the rise of social media like Facebook, Twitter, and Instagram shifted audiences towards shorter more engaging posts, and after 2010 multimedia platforms like YouTube, Twitch, and TikTok became popular. Max Read laments the increasing effort required to deal with the info sphere as millennials have ‘aged out’ and members of generation Z have become more eager early adopters of  ChatGPT than their elders.  The current digital landscape emphasizes content monetization, influencer marketing, and multi-platform presence, but here still  remains a vital role for niche blogs such as this one, where readers can find specialized content beyond the mainstream social media noise. 

I recently received an email from a MindBlog reader in Germany who lamented that MindBlog received very few comments from readers. I have  received numerous emails over the years from silent but loyal readers who express gratitude for effort I put into the blog, but there have been only a few extended discussion threads, such as those of anti-aging compounds and life optimization snake oil .

My German reader made the interesting suggestion that I consider initiating a platform for direct interactions and deeper engagement among MindBlog readers, perhaps a live video and text platform that might include both experts and educated laypeople outside the scientific community. This would be relatively easy for me to set up if sufficient interest is shown, so I invite readers interested in this prospect to email me at

Sunday, January 21, 2024

Titles and URLs for key MindBlog posts on selves

I pass on a chronological list of titles and URLs of MindBlog posts assembled in preparation for a video chat with a European MindBlog reader:

An "Apostle's Creed" for the humanistic scientific materialist?

Some rambling on "Selves" and “Purpose”

Self, purpose, and tribal mentality as Darwinian adaptations (or…Why why aren’t we all enlightened?)

MindBlog passes on a note: on the relief of not being yourself

Points on having a self and free will.

I am not my problem

The non-duality industry as a panacea for the anxieties of our times?

Enlightenment, Habituation, and Renewal - Or, Mindfulness as the opiate of the thinking classes?

A quick MindBlog riff on what a self is….

MindBlog paragraphs bloviating on the nature of the self ask Google Bard and Chat GPT 4 for help

A MindBlog paragraph on non-dual awareness massaged by Bard and ChatGPT-4

Constructing Self and World  

Anthropic Claude's version of my writing on the Mind - a condensation of my ideas  

A Materialist's Credo

How our genes support our illusory selves - the "Baldwin effect"




Wednesday, January 10, 2024

If psychedelics heal, how do they do it?

I pass on from a recent issue of PNAS this informative "News Feature" article by Carolyn Beans (open source).  It discusses studies trying to determine the brain mechanisms by which therapeutically effective psychedelics such as MDMA (3,4-methylenedioxymethamphetamine, commonly known as ecstacy), psilocybin, and LSD have their effect.  They all act on serotonin receptors.  

Friday, January 05, 2024

Capturing non-dual reality in language

For my own future reference and for MindBlog readers interested in my previous MindBlog posts on non-duality,  I want to pass on the start of a discussion thread in the Waking Up Community at written by Rish Magal, London, U.K, on the subject of capturing nondual reality in language. One of the discussants makes reference to the Laukkonen and Slagter article whose ideas were referenced in my recent lecture on New Perspectives on how our Minds Work.  

From Rish Magal,   London, UK

Prompted by a really great discussion in another thread, I thought it would be an interesting experiment to try and express some important nondual insights in English. Comments and responses would be very much appreciated 😀.
    1    Despite being a very long post (sorry!), this is only a very very rough outline. I’m cutting lots of corners, and it would take a book to explain and defend all these ideas.
    2    I needed to stretch some of our normal concepts. This is not surprising, since our concepts are integral to a misguided way of looking at the world. I’ve tried to explain the stretching, but I might not have succeeded to your satisfaction!
    3    This is only one attempt to describe nondual reality. I’m not claiming it’s The One True Way. The purpose of the exercise is to explore whether it’s possible to capture the essence of nondual reality. If this version looks at all promising, other versions are surely possible too.

I’ll label each step, in case anyone wants to respond to an individual piece.

A) What we call a “self” is a useful fiction. Humans use it to plan their interactions with each other, to hold each other accountable, to organise their own behaviour … and a host of other purposes.

B) The fictional “self” is created by the human brain, acting in concert with other human brains. From cognitive science comes the idea that the self is part of a predictive model used by the brain (e.g. Anil Seth). From philosophy comes the idea that a self is a ‘Centre of Narrative Gravity’ (Dan Dennett). Perhaps both of these can be accurate together.

C) From psychology, we know that the human brain does not understand itself very well at all. It has very limited understanding of its own reasons for acting (Michael Gazzaniga). In fact it can easily be mistaken about whether it has even acted at all (Daniel Wagner).

D) There is no ‘Free Will’ or responsibility for actions. (Sam Harris makes a strong case on this, but there are several ways to argue for this conclusion.) Causal chains move through human bodies in the same way that they move through billiard balls. There’s no agency in a human brain, much less a “self”.

E) Perhaps the biggest flaw in our language is the idea that objects cause events. We reify objects with nouns, and causing with verbs. It would be more accurate to say: reality is a succession of events. But even that is too dualistic. More accurate still: there is simply one continuously unfolding process. Events inside human brains are like tiny ripples in this huge universe-sized sea.

F) By various means*, a human brain can come to Realise** that its habitual way of looking at the world is badly flawed, and can grasp one or more of the preceding points.

G) Such a realisation is usually accompanied by a huge emotional sense of relief, release, and bliss — especially the first few times.

H) A human brain which doesn’t have access to a structure of revised concepts (such as the one outlined here) will struggle to interpret its own experience. It is likely to attach to the emotional content, and try very hard to recapture that.

I) Over the centuries, many human brains which have glimpsed these truths have struggled and failed to express them in language. (Until very recent advances in science, psychology & philosophy, it would have been almost impossible to fill out a plausible account of what's going on.) Over the centuries, it has become common to say that these insights cannot be expressed in language.

J) My first claim is that nondual insights can be expressed in language. These steps are one attempt to do so.

K) *My second claim is that describing nondual reality in language (however imperfectly) can be extremely helpful in triggering a brain to grasp these insights. And help it return to them reliably.

L) **By "Realise" I mean something beyond (but including) understanding and agreeing with a statement. "Realising" means deeply believing it to the point of feeling in my bones that it is true.

As an analogy: I understand and believe that I'm going to die one day. But in terms of my daily activities it doesn't really feel like it's true, and my behaviour is basically indistinguishable from someone who thought he was immortal 😁. If tomorrow a neurologist shows me a scan of a huge tumour in my brain, I will Realise the truth that I am going to die in an entirely different way, and my behaviour is likely to change radically.

Note that I already have all the concepts I need to understand this truth. I think the shift from simple understanding & cognitive assent, to what I'm calling Realisation, is a much more immediate and tangible kind of belief, with much more emotional content. I now feel it to be true, as well as simply agreeing with the statement intellectually. But the content of the belief is the same, and can be expressed in language and concepts.
M) In this brain, the experienced shift from understanding to Realising usually produces symptoms like laughter, releasing, euphoria, connectedness, presence, empathy, equanimity. But after many such experiences, their intensity varies (at least in this brain). Importantly (IMO): these feelings/experiences are not the point of meditation. The point is the insights themselves — to realise/recognise the nondual nature of reality.

N) These statements above are not an attempt to capture the experience of realising/recognising them. There’s definitely a limit to the usefulness of words in conveying an experience. When people say that the experience of realisation cannot be captured in language, I would agree (though I think we can say a few things about it). But that’s not the case I’m making here. My case is that statements about nondual reality can be expressed in language, and doing so can be extremely helpful.

O) This list is not meant to be exhaustive. No doubt there are more statements about nondual reality which can be expressed in language, which this brain hasn’t grasped. If “your” brain knows of some, please post about them! Thankswhich can be expressed in language, which this brain hasn’t grasped. If “your” brain knows of some, please post about them! Thanks

Sunday, December 03, 2023

A flash of clarity on what current LLMs can and can not do. An AI apocalypse does not appear to be eminent...

In his most recent newsletter, Venkatesh Rao pulls up a twitter thread he wrote in 2017 making what he calls an ontological distinction between  boundary intelligence and interior intelligence.  This was before transformers like GPT-1 began to attract more attention. The distinction Rao makes is central to understanding what current large language models (LLMs) can and can not do. Here is his unedited text from 2017:
1. I'd like to make up a theory of intelligence based on a 2-element ontology: boundary and interior intelligence

2. Boundary intelligence is how you deal with information flows across the boundary of your processing abilities 

3. Interior intelligence is how you process information. Includes logic, emotional self-regulation, etc.

4. A thesis I've been converging on is that boundary intelligence is VASTLY more consequential once interior intelligence exceeds a minimum

5. Boundary intelligence is by definition meta, since you're tuning your filters and making choices about what to even let hit your attention

6. I think it is highly consequential because almost all risk management happens via boundary intelligence (blindspots, black swans etc)

7. Interior intelligence is your poker skill and strategy. Boundary intelligence is picking which table to sit down at

8. Interior intelligence is reading a book competently, extracting insights and arguments. Boundary intelligence is picking books to read. 

9. Interior intelligence is being a good listener. Boundary intelligence is deciding whom to listen to. 

10. Basically, better input plus mediocre IQ beats bad input and genius IQ every time, so boundary intelligence is leverage

11. And obviously, boundary intelligence is more sensitive to context. The noisier and angrier info streams get, the more BI beats II

12. Most of boundary intelligence has to do with input intelligence, but output intelligence becomes more important with higher agency 

13. Output intelligence is basically the metacognition around when/where/how/to-whom/why to say or do things you are capable of saying/doing

14. We think a lot about external factors in decisions, but output intelligence is about freedom left after you've dealt with external part

Next, from the abstract of a forthcoming paper by Yadlowsky et al. Rao extracts the following:

…when presented with tasks or functions which are out-of-domain of their pretraining data, we demonstrate various failure modes of transformers and degradation of their generalization for even simple extrapolation tasks. Together our results highlight that the impressive ICL abilities of high-capacity sequence models may be more closely tied to the coverage of their pretraining data mixtures than inductive biases that create fundamental generalization capabilities.

And then, in the following selected clips, continues his text:

Translated into the idiom from the fourteen points above, this translates into “It’s all interior intelligence, just within a very large boundary.” There is no boundary intelligence in current machine learning paradigms. There isn’t even an awareness of boundaries; just the ability to spout statements about doubt, unknowns, and boundaries of knowability; a bit like a blind person discussing color in the abstract.

This is not to say AI cannot acquire BI. In fact, it can do so in a very trivial way, through embodiment. Just add robots around current AIs and let them loose in real environments.

The reason people resist this conclusion is is irrational attachment to interior intelligence as a sacred cow (and among computer science supremacists, a reluctance to acknowledge the relevance and power of embodiment and situatedness in understandings of intelligence). If much of the effectual power of intelligence is attributable to boundary intelligence, there is much less room for sexy theories of interior intelligence. Your (cherished or feared) god-like AI is reduced to learning through FAFO (Fuck around and find out) feedback relationships with the rest of the universe, across its boundary, same as us sadsack meatbag intelligences with our paltry 4-GPU-grade interior intelligence.

In their current (undoubtedly very impressive) incarnation, what we have with AI is 100% II, 0% BI. Human and animal intelligences (and I suspect even plant intelligences, and definitely evolutionary process intelligence) are somewhere between 51-49 to 99.9-0.1% BI. They are dominated to varying degrees by boundary intelligence. Evolutionary processes are 100% BI, 0% II.

Monday, November 27, 2023

The feasibility of artificial consciousness through the lens of neuroscience

Some interesting perspectives from Aru, Larkum, and Shine in Trends in Neurosciences. Motivated readers can obtain a copy of the article's text from me.  


Large language models (LLMs) can produce text that leaves the impression that one may be interacting with a conscious agent.
Present-day LLMs are text-centric, whereas the phenomenological umwelt of living organisms is multifaceted and integrated.
Many theories of the neural basis of consciousness assign a central role to thalamocortical re-entrant processing. Currently, such processes are not implemented in LLMs.
The organizational complexity of living systems has no parallel in present-day AI tools. Possibly, AI systems would have to capture this biological complexity to be considered conscious.
LLMs and the current debates on conscious machines provide an opportunity to re-examine some core ideas of the science of consciousness.
Interactions with large language models (LLMs) have led to the suggestion that these models may soon be conscious. From the perspective of neuroscience, this position is difficult to defend. For one, the inputs to LLMs lack the embodied, embedded information content characteristic of our sensory contact with the world around us. Secondly, the architectures of present-day artificial intelligence algorithms are missing key features of the thalamocortical system that have been linked to conscious awareness in mammals. Finally, the evolutionary and developmental trajectories that led to the emergence of living conscious organisms arguably have no parallels in artificial systems as envisioned today. The existence of living organisms depends on their actions and their survival is intricately linked to multi-level cellular, inter-cellular, and organismal processes culminating in agency and consciousness.

Wednesday, November 01, 2023

David Brooks on "What is a Person?"

David Brooks has an astounding ability to simplify and present important ideas. I pass on a few clips from Chapter 5  - titled "What is a Person?" - of his new book  “How to Know a Person: The Art of Seeing Others Deeply and Being Deeply Seen.”  In chapter 9 he offers an equally lucid presentation of work in the cognitive sciences by Gibson and Proffitt showing how people in different life circumstances literally see different worlds. I've enjoyed reading this book and recommend that you read it. 

As we try to understand other people, we want to be constantly asking ourselves: How are they perceiving this situation? How are they experiencing this moment? How are they constructing their reality?
Let me dip briefly into brain science to try to show you how radical this process of construction is. Let’s take an example as simple as the act of looking around a room. It doesn’t feel like you're creating anything. It feels like you're taking in what’s objectively out there. You open your eyes. Light waves flood in. Your brain records what you see: a chair, a painting, a dust bunny on the floor. It feels like one of those old-fashioned cameras—the shutter opens and light floods in and gets recorded on the film
But this is not how perception really works. Your brain is locked in the dark, bony vault of your skull. Its job is to try to make sense of the world given the very limited amount of information that makes it into your retinas, through the optic nerves, and onto the integrative layer of the visual cortex. Your senses give you a poor-quality, low-resolution snapshot of the world, and your brain is then forced to take that and construct a high-definition, feature-length movie.
To do that, your visual system constructs the world by taking what you already know and applying it to the scene in front of you. Your mind is continually asking itself questions like “What is this similar to?” and “Last time I was in this situation, what did I see next?” Your mind projects out a series of models of what it expects to see. Then the eyes check in to report back about whether they are seeing what the mind expected. In other words, seeing is not a passive process of receiving data; it’s an active process of prediction and correction.
Perception, the neuroscientist Anil Seth writes, is “a generative, creative act.” It is “an action-oriented construction, rather than a passive registration of an objective external reality.” Or as the neuroscientist Lisa Feldman Barrett notes, “Scientific evidence shows that what we see, hear, touch, taste, and smell are largely simulations of the world, not reactions to it.” Most of us non-neuroscientists are not aware of all this constructive activity, because it happens unconsciously, It's as if the brain is composing vast, complex Proustian novels, and to the conscious mind it feels like no work at all
Social psychologists take a wicked delight in exposing the flaws of this prediction-correction way of seeing. They do this by introducing things into a scene that we don’t predict will be there and therefore don’t see. You probably know about the invisible gorilla experiment. Re- searchers present subjects with a video of a group of people moving around passing a basketball and ask the subjects to count the number of passes by the team wearing white. After the video, the researchers ask, “Did you see the gorilla?” Roughly half the research subjects have no idea what the researchers are talking about. But when they view the video a second time, with the concept “gorilla” now in their heads, they are stunned to see that a man in a gorilla suit had strolled right into the circle, stood there for a few seconds, and then walked out. They didn’t see it before because they didn’t predict “gorilla.”
In my favorite experiment of this sort, a researcher asks a student for directions to a particular place on a college campus. The student starts giving directions. Then a couple of “workmen”—actually, two other researchers— rudely carry a door between the directions asker and the directions giver. As the door passes between them, the directions asker surreptitiously trades places with one of the workmen. After the door has passed, the directions giver finds himself giving directions to an entirely different human being. And the majority of these directions givers don’t notice. They just keep on giving directions. We don’t expect one human being to magically turn into another, and therefore we don't see it when it happens.
In 1951 there was a particularly brutal football game between Dartmouth and Princeton. Afterward, fans of both teams were furious because, they felt, the opposing team had been so vicious. When psychologists had students rewatch a film of the game in a calmer setting, the students still fervently believed that the other side had committed twice as many penalties as their own side. When challenged about their biases, both sides pointed to the game film as objective proof that their side was right. As the psychologists researching this phenomenon, Albert Hastorf and Hadley Cantril, put it, “The data here indicate that there is no such ‘thing’as a ‘game’ existing ‘out there’ in its own right which people merely ‘observe’ The ‘game’ ‘exists’ for a person and is experienced by him only insofar as certain things have significances in terms of his purpose.” The students from the different schools constructed two different games depending on what they wanted to see. Or as the psychiatrist Iain McGilchrist puts it, “The model we choose to use to understand something determines what we find.”
Researchers like exposing the flaws in our way of seeing, but I’m constantly amazed at how brilliant the human mind is at constructing a rich, beautiful world. For example, in normal conversation, people often slur and mispronounce words. If you heard each word someone said in isolation, you wouldn't be able to understand 50 percent of them. But because your mind is so good at predicting what words probably should be in what sentence, you can easily create a coherent flow of meaning from other people's talk.
The universe is a drab, silent, colorless place. I mean this quite literally. There is no such thing as color and sound in the universe; it’s just a bunch of waves and particles. But because we have creative minds, we perceive sound and music, tastes and smells, color and beauty, awe and wonder. All that stuff is in here in your mind, not out there in the universe.
I've taken this dip into neuroscience to give the briefest sense of just how much creative artistry every person is performing every second of the day. And if your mind has to do a lot of con- structive workin order for you to see the physical objects in front of you, imagine how much work it has to undertake to construct your identity, your life story, your belief system, your ideals. There are roughly eight billion people on Earth, and each one of them sees the world in their own unique, never-to-be-repeated way.

Wednesday, October 25, 2023

A Materialist's Credo

This post passes on a recent effort to put down some basic ideas in as few words as I can manage.

A Materialist’s Credo

In the beginning was the cosmos, fundamentally as incomprehensible to our human brains as quantum chemistry is to a dog’s brain.

What our human brains can understand is that our ultimate emergence from countless generations of less complex organisms can be largely explained by a  simple mechanism that tests the reproductive fitness of varying replicants.

Systems that try to predict the future and dictate whether to go for it or scram - from the chemotaxis of bacteria to the predictive processing of our humans brains - have proved to be more likely to survive and propagate.

Modern neuroscience has proved that our experienced perceptions of sensing and acting are these predictions.  They are fantasies, or illusions, as is our sense of having a self with agency that experiences value, purpose, and meaning. Everything we do and experience is in the service of reducing surprises by fulling these fantasies. An array of neuroendocrine mechanisms have evolved to support this process because it forms the bedrock of human culture and language.

We are as gods, who invent ourselves and our cultures through impersonal emergent processes rising from our biological substrate.

Personal and social dysfunctions can sometimes be addressed by insight into this process, as when interoceptive awareness of the settings of  our autonomic nervous system's axes of arousal, valence, and agency allows us to dial them to more life sustaining values and better regulate our well-being in each instance of the present.

We can distinguish this autonomic substrate from the linguistic cultural overlay it it generates, and allow  the latter to be viewed in a more objective light. This is a deconstruction that permits us to not only let awareness rest closer to the 'engine room' or 'original mind' underlying its transient reactive products, but also to derive from this open awareness the kind of succor or equanimity we once found in the imagined stability of an external world.

Hopefully the deconstruction that takes us into this metaphorical engine room makes us more able to discern and employ illusions that enhance continuation rather than termination of our personal and social evolutionary narratives.