Introduction: The Nature of Perception and Reality
- Current cognitive science suggests we construct perceptions in real time. Evolution suggests our perceptions don’t reflect true reality, but are optimized for survival, challenging the idea that space-time is fundamental.
Projects and Perspectives
- Levin’s Lab: Focuses on understanding collective intelligence, communication with cellular swarms, and exploring competencies of gene regulatory networks and other models. Applications include cancer, birth defects, and regenerative medicine.
- Hoffman’s Project: Investigates structures beyond space-time (like the amplituhedron and decorated permutations) and aims to derive these from a dynamical system based on Markov chains of conscious agents. He proposes linking properties of conscious agent dynamics (e.g., mass, momentum, spin) to physical properties. He aims to predict parton distributions inside protons from this theory.
- Levin’s Childhood Anecdote: A lost toy prompted thoughts about the persistence of objects and self across time, leading to questions about stability, change, and the reconstruction of self from memory traces.
The Nature of Time and Self
- The self needs constant reconstruction. Memories are accessed and rebuilt, not statically stored. The “space-time loaf” is a framework, but physicists are questioning its fundamental nature.
- Space-time may be a “data structure” that breaks down at very small scales (10^-33 cm, 10^-43 s), suggesting a deeper reality beyond it.
- Time and space could be “interface concepts” — useful tools, but not reflecting the ultimate reality, which exists outside space-time. Evolution by natural selection supports this; our perceptions are optimized for survival, not truth.
- Neurobiology is far more complex than previously thought, as it needs to be reverse-engineered from this deeper reality beyond space-time.
- In the conscious agent model, the “arrow of time” may be an artifact of the projection process (loss of information), not inherent in the fundamental dynamics.
- Agents build models of the world. Those might or not match the model of the world.
Agency, Tools, and Perception
- The tools we use (e.g., voltmeters, rulers) limit what we perceive to low-agency, mechanistic phenomena. Minds, however, are good at detecting other minds, suggesting the need for different “tools” to understand agency and higher-level properties.
- Objects, including our bodies and brains, are not fundamentally conscious. Consciousness is a *perception* recreated “on the fly” as needed, similar to an avatar in a virtual reality.
- Object permanence (the belief that objects exist even when unseen) is a deeply ingrained, pre-rational belief, programmed early in life, making it difficult to fully accept the non-fundamentality of objects.
- Levin presented the Skydive memory question: You can have experience, or remeber having, the former group is the ephemeral types while the latter group are of the people for which, only the collection of their memory are considered important to their self.
Implications and Analogies
- Analogy: VR, just like how avatars and objects are not “real” inside a virtual world, neither exist except that moment when rendered. Analogously there may be some outside computer of the VR. Agreement on perception (like seeing a dinosaur bone) doesn’t imply pre-existing reality; it reflects shared interpretation within a “headset.”
- Split-brain patients: Different hemispheres can hold contradictory beliefs (e.g., atheist vs. theist), raising questions about the unity of self and negotiation between internal “agents.”
- The distinction between living and non-living, or conscious and unconscious, may be an artifact of our interface, not a fundamental distinction in reality. (Analogy: conscious vs. unconscious pixels on a Zoom screen).
- A thought experiment describes a patient with a disruptive “partier” personality facing integration therapy, highlighting the ethical complexities of altering or erasing a coherent “self,” even within a single body. The key question: where does the conscious go after integrating.
Conscious Agents and the Fundamental Nature of Reality
- Conscious agent model: A mathematically precise model where agents have experiences, take actions affecting other agents, and interact through a Markov chain.
- There is potentially ONE final agent (infinite) so it cannot be described in practice. So any analysis must be limited.
- Observation: In the model, consciousnesses observe other consciousnesses. Any collection of conscious agents is itself a bigger agent.
- Little Agent and Trace Chain: by picking only subsets and some finite temporal windows of these collection we create little agents. Little agent perspective.
Consciousness, Cognition, and Biology (Levin’s Perspective)
- Cognition is different from consciousness. Levin focuses on cognition, defining it extensively in a recent paper (detained paper). He believes cognition is prevalent throughout the universe, not limited to “living” things.
- His framework, TAME (Technological Approach to Mind Everywhere), is an engineering approach focusing on the practical benefits of a “cognitive lens.” It aims to generate new experiments and interventions in biomedicine.
- Bioelectricity is a key “cognitive glue” for scaling up cognition, but not the only mechanism. Levin advocates dropping “teleophobia” (fear of attributing goals) to unlock new research programs.
- Every cell is some other cell’s environment. And at every biological scale, you see this ‘part within the whole’, that makes drawing the limit of one self hard and challenging.
- All of our bodies (or maybe even our environment!) all are nested, various collections with organs having their own intelligences/cognitions,
- If your “cognitive lens” were, for instance, tracking chemicals instead of visual light, then you might “perceive” and “understand” your internal organ systems and the liver might also have intelligence.
Hoffman’s responses and additions.
- Distinguishing between Subject and Objective Reality: He proposes that we understand object (external reality independent of observers), and there are objects dependent on the perception. His work point to objective reality being different.
- Monodology, and Leibnizian, views are a very good match. In Leibnizian worldview, experiences and probabilistic relationship among those experiences, very similar to his model’s perspective of reality.
Further Discussions and Q&A Highlights
- Fitness vs. Truth: Perceiving the truth (e.g., toggling millions of voltages) would lead to *less* fitness than perceiving a simplified “interface” (e.g., steering wheel, gas pedal) in a virtual reality game. Theorems, not just simulations, show that fitness payoff functions generally contain *no* information about objective reality’s structures. This implies optimization in VR reality will lead to obscuring most information, including truth.
- Evolutionary Game Theory (EGT): Critics argue that using EGT to disprove the fundamentality of physical objects is self-contradictory. Hoffman counters that *all* scientific theories make assumptions, and good theories reveal the *limits* of those assumptions (like Einstein’s theory revealing the limits of space-time). The work being done, is precisely in the spirit of EGT, with the objective to highlight that there is potentially some underlying realities behind our models/reality.
- Space time isn’t fundamental, neither is quantum.
- The hard problem of consciousness isn’t one for Hoffman. Hoffman starts with assuming conscious is all.
- Bayesian Inference and Markov Blankets: Perception as Bayesian inference doesn’t imply perceiving the “true” state of the world. The conditional independence imposed by a Markov blanket shows that we only access an *interface,* not the underlying reality.
- Hoffman acknowledges Delbrück’s similar non-reductionist viewpoint on evolution.
- Relationship between consciousness and high energy physics is, is communicating or collaborative (trace chains), that it has properties correlating and communicating with our real (or rather rendered) world objects like photons and so forth.
- Nima Arkani-Hamed (high-energy physicist): Hoffman recommends his 2019 Harvard lectures for a (relatively) accessible introduction to the amplituhedron and related concepts.
- Physics perspective of Don and Leven were not quite aligned. Hoffman works at physics being secondary and being derived by concious, and a conscious being the ultimate and first truth, while Levin sees cognition very similar, but believes that both are still important perspectives, with intelligence spanning multiple hierarchies/agents. Levin had functional framework it’s called t-a-m-e.