The Computational Theory of Mind (2015)
Posted by cyanregiment 19 hours ago
Comments
Comment by ChaitanyaSai 10 hours ago
For those interested in topic, our book Journey of the Mind would be a great introduction from a systems-thinking perspective. As you'll see on goodreads https://www.goodreads.com/en/book/show/60500189-journey-of-t... the reaction tends to be a bit bimodal, so at least some of you will find it absolutely fascinating.
We go from the simplest possible model of a mind (a single sensor and doer coupled together,separate from the world around them)to consciousness and beyond.
I am quoting a couple because I find it fascinating how readers have such widely differing reactions. (JoM actually does have an explanation for this: we are each a unique bundle of experiences cohering into an identity and a perspective)
"This book is both dense with biology and science as well as equally dense with a holistic philosophy that will genuinely shift your perspective on your place as a human, person and animal."
"Written in a cutesy, "fellow kids" tone that feels less like a serious exploration of the mind and more like someone trying to pander to what they imagine zoomers want. The style makes it almost unreadable and wastes your time. "
"We are all neurons in a (currently diseased) supermind. We are not just ourselves but collectively a Self, made of past and present (and artificial) intelligence. Collectively, a God that dictates the fate of other neurons, life forms, and ultimately, the universe at its whim. Without a doubt, this is one of the best books I have ever read."
Comment by timshell 16 hours ago
Zooming out of my specific work, the “best” success stories were connections across math/CS, neuro, and psych and the golden child is the dopamine model of reinforcement learning where firing patterns encode the TD prediction error
Comment by bofadeez 16 hours ago
Conscious agents are creating spacetime. Not the other way around: https://pmc.ncbi.nlm.nih.gov/articles/PMC4060643/
Comment by CMay 9 hours ago
I learned this years ago from Philip Ball, one of the editors of Nature. There have been other scientists helping to clear up the confusion recently, though.
Here is Sean Carroll explaining it: https://www.youtube.com/watch?v=RNOJV4G7Ips
Here is Sabine Hossenfelder explaining it: https://www.youtube.com/watch?v=npc6Mn2CZV8
Philip Ball explained it in Beyond Weird: https://www.audible.com/pd/Beyond-Weird-Audiobook/B07L5XK4BL
Comment by bofadeez 4 hours ago
Comment by cgio 11 hours ago
1. instantaneous and faithful, at the cost of depending upon substrate-specific persistence parameters;
2. faithful and substrate-neutral, at the cost of requiring historical information;
3. instantaneous and substrate-neutral, at the cost of losing faithfulness.
No implementation map can satisfy all three simultaneously.
Comment by elendilm 10 hours ago
Comment by cgio 10 hours ago
Comment by elendilm 9 hours ago
Doesn't introducing separate time slices automatically forces you into a continuum of time and therefore the "Instantaneous" requirement "I" become meaningless.
One can't evaluate physical state transitions without continuous time or atleast some form of mathematical ordering.
But if you strip away continuous time and keep only the abstract "ordering", you are again back in the world of pure mathematics where states never decay and memory never fades.
Comment by cgio 8 hours ago
Comment by GoblinSlayer 7 hours ago
Comment by cgio 6 hours ago
Comment by Beijinger 17 hours ago
Comment by cyanregiment 17 hours ago
Comment by phoghed 15 hours ago
Comment by cyanregiment 13 hours ago
He's gonna send Tom to do his dirty work
Comment by ohn03s 16 hours ago
Comment by randomImmigrant 15 hours ago
The brain and body instead construct time, a cohesive internal one,from the ground up, with nesting oscillators driving the sequence of all functions and behaviors, over long and short time closes.
What we call “thinking” is a filtered layer of it, a slice that the attention spotlight is focussed on, and in humans this process can be turned to cognition over multilayered abstractions, and using language or other symbolic communications to communicate some of the dynamics of this process, and even evoke them in others.
Turing machines, and modern digital computers with their Von Neumann bottleneck, and LLMs are outside of time. They do not experience time. They can check the clock. They can count steps. But they are not active and agentic in time. Till we change that we won’t make machines that “think”. We can certainly make machines that simulate thinking, and that’s often good enough. But make the problem a real time one, with several conflicting verbal streams to parse and respond to serially and LLMs on their own fail catastrophically.
I think so long as the memory-processing divide remains, the simulation has to break apart processes for thinking in a way that’s alright for some cases, but not for others. And this is why we have the jaggedness of LLM intelligence I believe. They do not have internal timekeeping like almost all biological agents do.
Comment by hexer292 15 hours ago
It is theoretically possible, after all, to simulate a human brain at a subatomic level. Sure, the complexity is absurd and interface required to measure it seems far fetched, but technically there's no restriction.
Because of this I believe what we know as "thought" or consciousness exists in the space between the physical world. It's just a way to represent the world around us, with the ability to reference the past and systems to predict the future.
LLMs to me are like a simplified version thats stretched across the domain of active memory. The "thought" process is the same, an active state (current token) guided by the past state (previous tokens).
I think the next step is to reduce what a token is. Right now they are vectors that are linked to words. If instead of words we fed it direct video and audio, and a way to translate the raw data into something resembling the information passed from our eyes and ears in real time, and train it like a child learns from its parents, it's hard to draw the line on where thought begins.
It's an interesting experiment, but I still consider it anti-human.
In the future, when we have "robot" rights for robots that identify as humans, you'll find me on the side of "they aren't a real human". We'll be called bigots, and I'm okay with that.
Comment by randomImmigrant 14 hours ago
Comment by defrost 13 hours ago
When custom silicon is made to speed up LLM behaviour doesn't that operate fully parallel with mixed memory and processing?
When real time remote sensing signal processing pipelines are built isn't it possible to parallel in the kinds of filters that "anticipate" the expected future (and highlight deviations from the expected).
Comment by randomImmigrant 13 hours ago
Comment by defrost 13 hours ago
To which question?
The Connection Machine CM-2 (1987) has a non von Neumann architecture and mixes memory and processing .. so that's been done, 40 years ago.
Anticipating the future in real time remote sensing signal processing pipelines has been about for at least [redacted] decades.
Comment by rustcleaner 14 hours ago
I'm in your boat. Molecular biology looks quite analogous to something like Conway's Game of Life, but a particle automaton with freedom in 3D space rather than cells in a fixed 2D aetheric grid.
Conway's Game of Life is Turing complete, the fundamental laws/algorithms are simple. Per Wolfram (NKS), you don't need complex algorithms in order to exhibit complex behavior. GoL is just four rules and a[n infinite] grid. Wolfram's automata are simpler.
I will go even further out 'there' and state that we are the equivalent to Greek "city-gods" which arise out of the polity/demos composing them, except our polities are little biological von Neumann machines acting in concert to emerge us in their aggregate. What most people think of as 'god' being some top-down omniscient/omnipotent creator entity, I think is wrong and reverses the true heirarchy of nature. The fabric of spacetime, the quantum field, or whatever emerges it from a lower level with its fixed simple rules, is the primary force driving the universe's [and our] existence. If there are gods, we are categorically much closer to them in form than the pious fanatics say!
(Disclosure: I am petulantly Atheist.)
Comment by esikich 13 hours ago
https://en.wikipedia.org/wiki/Mathematical_universe_hypothes...
Comment by GoblinSlayer 10 hours ago
That's known as optimization algorithm, and genetic algorithm is known to produce good enough results fast https://en.wikipedia.org/wiki/Evolved_antenna Computers are time constrained too and cut such corners just like humans.
> They do not experience time. They can check the clock.
Humans experience time because they check biological clock. And sometimes humans forget about time just fine, when they don't check the clock.
Comment by DiscourseFan 13 hours ago
Comment by DiogenesKynikos 10 hours ago
Any reasonable definition of "thinking" includes what LLMs do. One would have to craft a rather arbitrary and tortured definition of "thinking" to include human thinking but exclude LLM thinking.
Comment by RussianBot9580 13 hours ago
Comment by randomImmigrant 13 hours ago
Comment by DiscourseFan 13 hours ago
Comment by elendilm 12 hours ago
The audacity to still claim biology is broadly different than computing is commendable.
Comment by ChrisGreenHeur 11 hours ago
Comment by elendilm 11 hours ago
Write a weasel program and you will see for yourself.
current = "XXXXXXXXXXXXXXXXXXXXX"
target = "THE LORD OF THE RINGS"
loop {
replicas = replication(current)
replicas = mutation(replicas)
current = naturalSelection(replicas)
print("generation", i, current)
if (current == target)
break
}You can thus make "Dog" turn into a "Cat". I rest my case :)
Comment by lioeters 9 hours ago
Computational Substrates: How Well-formed, Self-replicating Programs Emerge from Simple Interaction - https://arxiv.org/abs/2406.19108
Brainfuck, Forth, Subleq, and most recently Z80 assembly programs with mutations, interactions, and self-modification. Z80 has an LDIR instruction that copies a block of data from one location in memory to another, which allows the "organisms" to reach/discover reproduction quicker and more reliably in repeated experiments. As soon as that happens, it inevitably takes over the "world".
Hm, sounds more like "Lord of the Flies" than Rings.
Comment by elendilm 8 hours ago
My Scope: Evolution proper (what happens after a replicator exists).
Once a self-replicating entity exists, the Weasel loop takes over. Conflating the origin of replicators with the mechanics of evolution itself mixes up two different things.
Laws of logic dictates if you can demonstrate E with R, M and N, then any additional variable is neither sufficient nor necessary.
From a strict theory-of-computation standpoint, if the core loop can be executed in code, then biological evolution is fundamentally an informational process, not a mystical "biological-only" phenomenon.
> As soon as that happens, it inevitably takes over the "world".
Agreed :). Looking forward to an epic battle of the pelennor fields.
> sounds more like "Lord of the Flies" than Rings.
Thats hilarious. "Lord of the Flies" it shall be henceforth :))
Comment by Mikhail_Edoshin 6 hours ago
Comment by firasd 17 hours ago
I think this article is right that definitions really matter here cause one could argue “CTM is trivial, because we can describe almost any physical system as executing computations.” So we have a dual problem here—not just the difficult discussion of ‘what’s going on in minds’, but also ‘what is computation’.
Comment by BobbyTables2 17 hours ago
Have long thought that creativity is little more than a finely tuned filter driven by noise…
Comment by elendilm 9 hours ago
Trying to maintain that our mind is unreachable by the laws of logic is absurd.
If reachable by laws of logic, then it can be stated. If it can be stated, it can be executed.
Its funny that the very act of chaining sentences is what logic is. And every human thought can be written as a sentence.
Comment by fragmede 7 hours ago
No they can't. I have things in my brain that I don't have words for, that I'm able to find things other people have done to help me express them. You can attach sentences to music and art, but a picture is worth a thousand words. The thoughts on my head when I saw the latest Banksy, for example. Maybe I'm abberationally ineloquent, but I don't think I'm that exceptional.
Comment by elendilm 6 hours ago
Either that or you didn't put effort into writing it down or you lack the capability to do it.
You can even write sentences like "cows have wings and smells green". Regular thoughts are feeble by comparison in terms of complexity.
Claiming "a picture is worth a thousand words" may work out in family gatherings but irrelevant and meaningless in a computation discussion. Picture is represented by concrete symbols.
Comment by cat-whisperer 17 hours ago
What are your thoughts on this?
Comment by firasd 17 hours ago
Comment by timshell 16 hours ago
Comment by TheOtherHobbes 17 hours ago
Automating the processes doesn't change that. There's a very large number of possible processes and operations, but only a small number are perceived as valuable.
Comment by alberto_ol 11 hours ago
https://hn.algolia.com/?q=https%3A%2F%2Fplato.stanford.edu%2...
Comment by elendilm 11 hours ago
Then execute it as a program.
Comment by oleganza 11 hours ago
Or even better, even formulating the deterministic theory would require 1000000x energy than approximation. And that's how'd we learn that biological minds do the same trick and skip the hard work :-)
Comment by elendilm 11 hours ago
The vast amounts of energy spends on generating text tokens while biology only consumes a fraction of it makes me hopeful.
My bet is on the deterministic model. When one appears, the whole Jenga tower of AI comes crashing down if everyone can do it dirt cheap.
Comment by dinunnob 11 hours ago
Comment by kimjune01 14 hours ago
Comment by overmann 12 hours ago
Comment by soupspaces 18 hours ago
Comment by dinunnob 12 hours ago
Comment by andsoitis 18 hours ago
Comment by bofadeez 17 hours ago
Even the loosest, "multiply realizable" version of computationalism this entry lays out still needs something physical to run on like neurons, silicon, spacetime, whatever. Problem is, natural selection was never selecting for accurate perception of that substrate, just for fitness payoffs [2].
So computationalism has the order backwards: you can't generate a mind by computing over a brain when the brain, like any object in spacetime, is just a species-specific icon evolution gave you to see, not the hardware underneath it.
Comment by cyanregiment 12 hours ago
Even in a Donald Hoffman esque icon:hardware situation - and I think he said - "I don't take the icon literally, but I do take it seriously" meaning that even though it's an illusion, it still performs the function, I have trouble with mind preceding matter.
It's the same trouble I have with human-like intelligence preceding worlds.
People come out of worlds, not the other way around.
Comment by bofadeez 4 hours ago