Title: From Amoeba to Cognition Frankfurt Institute of Advanced Studies April 16, 2003
1From Amoeba to Cognition Frankfurt Institute of
Advanced StudiesApril 16, 2003
Christoph von der Malsburg Institut für
Neuroinformatik und Fakultät für Physik und
Astronomie Ruhr-University Bochum, Germany
and Computer Science Department and Program in
Neuroscience University of Southern
California Los Angeles
2Amoeba
3Euglena
4History of life
5Repertoire of single-celled animals 1
- Metabolism
- Production, transformation and breakdown of
molecules - Synthesis of molecules under genetic control
- Regulation, e.g., of ionic concentrations
- Transport of molecules, inside, in and out of
cell - Electrical behavior
- Circadian rhythm
- Reproduction
6Repertoire of single-celled animals 2
- Behavior
- Sensing (light, sound, chemical milieu)
- Self-shaping (pseudopodia, mitosis)
- Motility, esp. chemotaxis
- Feeding ingestion and digestion
- Aggression, flight
- Signalling
- Collaboration (e.g., slime mold, biofilms)
7Amoeba aggregation 2
8Spiral waves
9Ants
10Neuron 1
11Neuron 2
12Synapse
13The Ontogenetic Riddle
- Information content of the genome 109 bits
- Information content of the brains wiring 1016
bits - (1010 neurons, hence ld 1010 33 bits per
connection, - times 1015 synapses 1016 bits of information)
- Solution genetically controlled
self-organization
14Rettec anatomical schema
A Model for the Ontogenesis of Retinotopy (Willsha
w and Malsburg, 1976)
15Rettec functional schma
- Chemotaxis
- Synaptic plasticity controlled by electrical
signals
16Hebbian Plasticity
Correlation-controlled Synaptic
Plasticity (Hebbian Plasticity)
Time
10 sec
17Meister
(Prenatal ferret retina, M. Meister et al.)
18Network Self-Organization
Network
Signals
Signal Dynamic
Synaptic Plasticity
19Rettec functional schma
20Rettec principle 2
21Rettec development
22Visual system schema
23Levay stripes
24Binoc 1
A Model for the Ontogenesis of Ocularity Domains
(Biol. Cybernetics, 1977)
25Binoc 2
26HW orient
27Devalois 2
2873 projection
A model for the development of orientation-specifi
c neurons (Kybernetik, 1973)
Connection Strength
Cortex
Retina
2973 stimuli
Retinal Stimuli
30Meister
(Prenatal ferret retina, M. Meister et al.)
3173 cell 70
Re-organization of a cortical receptive field
3273 cortex post
3373 orientmap
34Devalois 1
35Gabors
36Olshausen-and Field Schema
Natural images
- Development of connections strengths Fi(x,y)
under 2 constraints - Preservation of information (ability to
reconstruct) - Sparsity
37Olshausen-Field Gabors
38Points of Conclusion
- Retinotopy, orientation specificity as paradigms
- of network self-organization and CNS ontogenesis
- Ontogenesis of CNS and cellular repertoire
- Amount of genetic information
39Invariant object Recognition(As paradigm of a
cognitive function)
40van Essen
41Rubfig 1
Object recognition
Image Domain
Model Domain
Model Window
42Rubfig 2
Objection recognition 2
Image Domain
Model Domain
Model Window
43Temporal binding
Rapid, Reversible Synaptic Plasticity
Time
10 msec
Temporal binding
44Network Self-Organization
Network
Signals
Signal Dynamic
Synaptic Plasticity
45Image-to-jets
46Maryl-representation
472D mapping formation
48Face recognition rates
After 3 iterations
49Marylin
50Points of Conclusion
- Evolution as a game of varying the eurkaryotes
repertoire - Ontogenesis as a refinement of old cellular
behavioral patterns - reproduction, differentiation
- cellular migration, chemotaxis
- chemical signalling, reaction-diffusion patterns
- putting out of pseudopodia
- Brain function as a fast version of the same
game again - Network Self-Organization the central process
51Outlook
- The flexibility of the human brain shows that
fundamental - principles are at work
- Similar conclusions may be drawn from the rapid
- development of human society
- Elucidating the general principles of
organization is the - challenge of our times
- This issue has at present no academic home
52Molecular Biology
53The Software Crisis
NIST Study 02 yearly US loss due to SW failure
60 Billion
54Algorithmic DOL
Algorithmic Division of Labor
Human
Creative Infrastructure Goals, Methods,
Interpretation, World Knowledge, Diagnostics
Detailed Communication
Machine
Algorithms deterministic, fast,
clue-less
55Organic Computers
Organic Computers
Human
Goal Definition
Loose Communication
Machine
Creative Infrastructure Goals, Methods,
Interpretation, World Knowldege, Debugging Data,
Algorithms
56Self-Organization in Need of Development
The ideas of self-organization have created a
revolution, but they are now in need of forceful
further development!
- Underdeveloped aspects
- Control of the control parameters (Ashbys
super-stability) - Explicit representation of goals
- Cascades of organization (description of
unfolding systems) - Escaping geometry (e.g., network
self-organization)
57Physics to the Rescue!!
- Physics has a proven track-record of
understanding complex - phenomena on the basis of simple paradigms and
principles - Physics is in possession of highly relevant
methodology - (statistical mechanics, systems of non-linear
differential equations) - Physics has a very successful system of
education - Physics is on the look-out for a new application
field