워런 스터지스 매컬록 (1898년 11월 16일 – 1969년 9월 24일)은 미국의 신경생리학자이자 사이버네틱스 학자로, 특정 뇌 이론의 기초에 관한 연구와 사이버네틱스 운동에 대한 기여로 알려져 있다. 매컬록은 월터 피츠와 함께 임계 논리라 불리는 수학적 알고리즘에 기반한 계산 모델을 만들었으며, 이는 탐구를 두 가지 별개의 접근법으로 나누었는데, 하나...

Warren Sturgis McCulloch

{{Short description|American neurophysiologist and cybernetician}} {{Infobox scientist | name = Warren Sturgis McCulloch | image = | image_size = | alt = | caption = | birth_date = {{Birth date|1898|11|16|df=yes}} | birth_place = [[Orange, New Jersey]], U.S. | death_date = {{Death date and age|1969|9|24|1898|11|16|df=yes}} | death_place = [[Cambridge, Massachusetts]], U.S. | residence = | fields = [[Cybernetics]][[Artificial neural network]][[Neurophysiology]][[Biophysics]][[Computer Science]] | workplaces = [[Massachusetts Institute of Technology]][[Yale University]][[University of Illinois at Chicago]] | alma_mater = [[Yale University]] ([[Bachelor of Arts|BA]])[[Columbia University]] ([[Master of Arts|MA]], [[M. D.|MD]]) | doctoral_advisor = | academic_advisors = | doctoral_students = | notable_students = [[Stafford Beer]] | known_for = * [[A Logical Calculus of the Ideas Immanent in Nervous Activity|A logical calculus of the ideas immanent in nervous activity]]

[[Heterarchy]] | author_abbrev_bot = | author_abbrev_zoo = | influences = | influenced = | awards = [[American Society for Cybernetics#Wiener and McCulloch awards|Wiener Gold Medal]] (1968) | signature = | signature_alt = | footnotes = }}

'''Warren Sturgis McCulloch''' (November 16, 1898 – September 24, 1969) was an American [[neurophysiologist]] and [[cybernetician]] known for his work on the foundation for certain brain theories and his contribution to the [[cybernetics]] movement.Ken Aizawa (2004), "[http://philosophy.uwaterloo.ca/MindDict/mcculloch.html McCulloch, Warren Sturgis]". In: Dictionary of the Philosophy of Mind. Retrieved May 17, 2008. Along with [[Walter Pitts]], McCulloch created computational models based on [[mathematics|mathematical]] [[algorithms]] called [[Artificial neuron#History|threshold logic]] which split the inquiry into two distinct approaches, one approach focused on biological processes in the brain and the other focused on the application of [[Artificial neural network|neural networks]] to [[artificial intelligence]].{{cite journal|last=McCulloch|first=Warren|author2=Walter Pitts|title=A Logical Calculus of Ideas Immanent in Nervous Activity|journal=Bulletin of Mathematical Biophysics|year=1943|volume=5|pages=115–133|doi=10.1007/BF02478259|issue=4}}

== Biography == Warren Sturgis McCulloch was born in [[Orange, New Jersey]], in 1898. His brother was a [[chemical engineer]] and Warren was originally planning to join the [[Christian ministry]]. As a teenager he was associated with the theologians [[Henry Sloane Coffin]], [[Harry Emerson Fosdick]], [[Herman Karl Wilhelm Kumm]] and [[Julian F. Hecker]]. He was also mentored by the [[Quaker]] [[Rufus Jones (writer)|Rufus Jones]].{{cite journal |last1=McCulloch |first1=Warren |date=1961 |title=What is a number, that a man may know it, and a man, that he may know a Number |url=https://www.nsl.com/k/parry/mcculloch_what-is-a-number.pdf |journal=General Semantics Bulletin |issue=26 & 27 |pages=7–18}} He attended [[Haverford College]] then studied philosophy and psychology at [[Yale University]], where he received a Bachelor of Arts degree in 1921. He continued to study psychology at [[Columbia University|Columbia]] and received a Master of Arts degree in 1923. Receiving his MD in 1927 from the [[Columbia University College of Physicians and Surgeons]] in New York, he undertook an internship at [[Bellevue Hospital]], New York. Then he worked under [[Eilhard von Domarus]] at the [[Rockland Psychiatric Center|Rockland State Hospital for the Insane]].{{cite journal |last1=Abraham |first1=Tara H. |title=(Physio)logical circuits: The intellectual origins of the McCulloch-Pitts neural networks |journal=Journal of the History of the Behavioral Sciences |date=2002 |volume=38 |issue=1 |pages=3–25 |doi=10.1002/jhbs.1094 |pmid=11835218 |url=https://www.academia.edu/4051737 |issn=0022-5061}} He returned to academia in 1934. He worked at the Laboratory for Neurophysiology at Yale University from 1934 to 1941.

In 1941 he moved to Chicago and joined the Department of Psychiatry at the [[University of Illinois at Chicago]], where he was a professor of psychiatry, as well as the director of the Illinois Neuropsychiatric Institute until 1951.{{cite journal |last1=Smalheiser|first1=Neil |title=Walter Pitts |journal=Perspectives in Biology and Medicine|date=2000 |volume=43 |issue=43,2 |pages= 217–226|doi=10.1353/pbm.2000.0009 |pmid=10804586 |s2cid=8757655 }} From 1952 he worked at the [[Massachusetts Institute of Technology]] in [[Cambridge, Massachusetts]] with [[Norbert Wiener]]. He was a founding member of the [[American Society for Cybernetics]] and its second president during 1967–1968. He was a mentor to the British [[operations research]] pioneer [[Stafford Beer]].

McCulloch had a range of interests and talents. In addition to his scientific contributions he wrote poetry ([[sonnet]]s), and he designed and engineered buildings and a dam at his farm in [[Old Lyme]], Connecticut.

McCulloch married Ruth Metzger, known as 'Rook', in 1924 and they had three children.{{Cite book|title=Rebel genius : Warren S. McCulloch's transdisciplinary life in science|last=H.|first=Abraham, Tara|isbn=9780262035095|location=Cambridge, Massachusetts|oclc=946160418|date = 2016-10-28}} He died in [[Cambridge, Massachusetts|Cambridge]] in 1969.

== Work == He is remembered for his work with Joannes Gregorius Dusser de Barenne from Yale{{cite journal | pmc = 2602446 | volume=12 | issue=6 | journal=Yale J Biol Med | title=Joannes Gregorius Dusser de Barenne| pages=742.2–746 | year=1940 | pmid=21433922 }} and later with [[Walter Pitts]] from the [[University of Chicago]]. He provided the foundation for certain brain theories in a number of classic papers, including "''[[A Logical Calculus of the Ideas Immanent in Nervous Activity]]''" (1943) and "''How We Know Universals: The Perception of Auditory and Visual Forms''" (1947), both published in the ''Bulletin of Mathematical Biophysics''. The former is "widely credited with being a seminal contribution to neural network theory, the theory of automata, the theory of computation, and cybernetics".

McCulloch was the chair of the set of [[Macy conferences]] dedicated to Cybernetics. These, greatly due to the diversity of the backgrounds of the participants McCulloch brought in, became the foundation for the field.

In [[Cybernetics: Or Control and Communication in the Animal and the Machine|Wiener's ''Cybernetics'']] (1948), he recounted an event in the spring of 1947, when McCulloch designed a machine to allow the blind to read, by converting printed letters to tones. He designed it so that the tone is invariant for the same letter viewed under different angles. Gerhardt von Bonin saw the design, and immediately asked, " Is this a diagram of the fourth layer of the [[visual cortex]] of the brain?".Wiener, Norbert. ''Cybernetics or Control and Communication in the Animal and the Machine''. (1948){{Pg|pages=22, 140}}

In his last days in 1960s, he worked on loops, oscillations and triadic relations with Moreno-Díaz; the reticular formation with Kilmer and dynamic models of memory with Da Fonseca.{{Citation |last1=de Blasio |first1=Gabriel |title=McCulloch's Relation to Connectionism and Artificial Intelligence |date=2018 |work=Computer Aided Systems Theory – EUROCAST 2017 |volume=10671 |pages=41–48 |editor-last=Moreno-Díaz |editor-first=Roberto |url=http://link.springer.com/10.1007/978-3-319-74718-7_6 |access-date=2024-10-12 |place=Cham |publisher=Springer International Publishing |doi=10.1007/978-3-319-74718-7_6 |isbn=978-3-319-74717-0 |last2=Moreno-Díaz |first2=Arminda |last3=Moreno-Díaz |first3=Roberto |editor2-last=Pichler |editor2-first=Franz |editor3-last=Quesada-Arencibia |editor3-first=Alexis|url-access=subscription }} His work in the 1960s was summarized in a 1968 paper.{{Citation |last=McCulloch |first=W. S. |title=Logic and Closed Loops for a Computer Junket to Mars |date=1968 |work=Neural Networks |pages=65–91 |editor-last=Caianiello |editor-first=E. R. |url=http://link.springer.com/10.1007/978-3-642-87596-0_7 |access-date=2024-10-12 |place=Berlin, Heidelberg |publisher=Springer Berlin Heidelberg |language=en |doi=10.1007/978-3-642-87596-0_7 |isbn=978-3-642-87598-4|url-access=subscription }}

=== Neuroscience === He studied the excitation of the brain by [[strychnine]] neuronography, which was a method to map brain connections. Applying strychnine in one point of the brain causes excitations in different points of the brain.{{Cite journal |last1=de Barenne |first1=J. G. Dusser |last2=McCulloch |first2=W. S. |date=1939-10-31 |title=Physiological Delimitation of Neurones in the Central Nervous System |url=https://www.physiology.org/doi/10.1152/ajplegacy.1939.127.4.620 |journal=American Journal of Physiology. Legacy Content |language=en |volume=127 |issue=4 |pages=620–628 |doi=10.1152/ajplegacy.1939.127.4.620 |issn=0002-9513|url-access=subscription }} Bailey, Bonin, and McCulloch conducted a series of studies in the 1940s that identified connections in the brains of macaque and chimpanzee that are consistent with modern understanding of [[Vertical occipital fasciculus|VOF]].''The isocortex of the chimpanzee.'' by Percival Bailey, Gerhardt von Bonin, and Warren S. McCulloch. Urbana, Illinois, University of Illinois Press, 1950{{Cite journal |last1=Takemura |first1=Hiromasa |last2=Pestilli |first2=Franco |last3=Weiner |first3=Kevin S. |date=2019-09-01 |title=Comparative neuroanatomy: Integrating classic and modern methods to understand association fibers connecting dorsal and ventral visual cortex |journal=Neuroscience Research |volume=146 |pages=1–12 |doi=10.1016/j.neures.2018.10.011 |pmid=30389574 |pmc=6491271 |issn=0168-0102}}

=== Mathematical logic === In 1919 he began to work mainly on mathematical logic, and by 1923 he attempted to make a logic of [[transitive verb]]s. His goal in psychology is to invent a "psychon" or "least psychic event" that are binary atomic events with necessary causes, such that they can be combined to create complex logical propositions concerning their antecedents. He noticed in 1929 that these may correspond to the all-or-nothing firings of neurons in the brain.

In the 1943 paper, they described how memories can be formed by a neural network with loops in it, or alterable synapses. These then encodes for sentences like "There was some x such that x was a ψ" or (\exists x) (\psi x), and showed that looped neural networks can encode all [[First-order logic|first-order logic with equality]] and conversely, any looped neural networks is equivalent to a sentence in first-order logic with equality, thus showing that they are equivalent in logical expressiveness.

The 1943 paper describes neural networks operating over time, and [[Universal quantification|logical universals]] -- "there exists" and "for all"—for spatial objects, such as geometric figures, was further developed in their 1947 paper.{{Cite journal |last1=Pitts |first1=Walter |last2=McCulloch |first2=Warren S. |date=1947-09-01 |title=How we know universals the perception of auditory and visual forms |url=https://link.springer.com/article/10.1007/bf02478291 |journal=The Bulletin of Mathematical Biophysics |language=en |volume=9 |issue=3 |pages=127–147 |doi=10.1007/BF02478291 |pmid=20262674 |issn=1522-9602|url-access=subscription }}

He worked with [[Manuel Blum]] in studying how a neural network can be "logically stable", that is, can implement a Boolean function even if the activation thresholds of individual neurons are varied.Blum, Manuel. "Properties of a neuron with many inputs." ''Bionics Symposium: Living Prototypes--the Key to New Technology, 13-14-15 September 1960''. WADD technical report, 60-600. (1961){{Pg|page=64}} They were inspired by the problem of how the brain can perform the same functions, such as breathing, under influence of [[caffeine]] or [[Ethanol|alcohol]], which shifts the activation threshold over the entire brain.

He worked on triadic relations, an extension of the [[Algebraic logic|calculus of relations]] to handle relations that relates 3 objects, such as "A gives B to C" or "A perceives B to be C". He was convinced that such a logic is necessary for understanding brain activity.{{Cite journal |last=Arbib |first=Michael A |date=2000 |title=Warren McCulloch's Search for the Logic of the Nervous System |url=https://muse.jhu.edu/pub/1/article/46496 |journal=Perspectives in Biology and Medicine |volume=43 |issue=2 |pages=193–216 |doi=10.1353/pbm.2000.0001 |issn=1529-8795|url-access=subscription }}

=== How we know universals === In the 1947 paper ''How we know universals'', they studied the problem of recognizing objects despite changes in representation. For example, recognizing a square under different viewing angles and lighting conditions, or recognizing a phoneme under different loudness and tones. That is, recognizing objects invariant under the [[Group action|action]] of some [[symmetry group]]. This problem was partly inspired by a practical problem in designing a machine for the blind to read (recounted in Wiener's ''Cybernetics'', see before).{{Citation |last=Masani |first=P. R. |title=McCulloch, Pitts and the Evolution of Wiener's Neurophysiological Ideas |date=1990 |work=Norbert Wiener 1894–1964 |pages=218–238 |url=http://link.springer.com/10.1007/978-3-0348-9252-0_16 |access-date=2024-10-13 |place=Basel |publisher=Birkhäuser Basel |language=en |doi=10.1007/978-3-0348-9252-0_16 |isbn=978-3-0348-9963-5|url-access=subscription }}

The paper proposed two solutions. The first is in computing an invariant by averaging over the symmetry group. Let the symmetry group be G and the object to be recognized be x. Let a neural network implement a function T. Then, the group-invariant representation would be \frac{1}{|G|}\sum_{g \in G} T(g x), the group-action average. The second solution is in a negative feedback circuit that drives a canonical representation. Consider the problem of recognizing whether an object is a square. The circuit moves the eye so that the "center of gravity of brightness" of the object is moved to the middle of the visual field. This then effectively converts each object into a canonical representation, which can then be compared with a representation in the brain.{{Cite journal |last=Aizawa |first=Kenneth |date=September 2012 |title=Warren McCulloch's Turn to Cybernetics: What Walter Pitts Contributed |url=https://journals.sagepub.com/doi/full/10.1179/0308018812Z.00000000017 |journal=Interdisciplinary Science Reviews |language=en |volume=37 |issue=3 |pages=206–217 |doi=10.1179/0308018812Z.00000000017 |bibcode=2012ISRv...37..206A |issn=0308-0188|url-access=subscription }}{{Citation |last=Masani |first=P. R. |title=McCulloch, Pitts and the Evolution of Wiener's Neurophysiological Ideas |date=1990 |work=Norbert Wiener 1894–1964 |pages=218–238 |url=http://link.springer.com/10.1007/978-3-0348-9252-0_16 |access-date=2024-10-14 |place=Basel |publisher=Birkhäuser Basel |language=en |doi=10.1007/978-3-0348-9252-0_16 |isbn=978-3-0348-9963-5|url-access=subscription }}

=== Neural network modelling === In the 1943 paper McCulloch and Pitts attempted to demonstrate that a [[Turing machine]] program could be implemented in a finite network of ''formal'' [[neuron]]s (in the event, the Turing Machine contains their model of the brain, but the converse is not truesee: S.C. Kleene, "Representations of Events in Nerve Nets and Finite Automata"), that the neuron was the base logic unit of the brain. In the 1947 paper they offered approaches to designing "nervous nets" to recognize visual inputs despite changes in orientation or size.

From 1952 McCulloch worked at the Research Laboratory of Electronics at MIT, working primarily on [[neural network (biology)|neural network]] modelling. His team examined the visual system of the [[frog]] in consideration of McCulloch's 1947 paper, discovering that the eye provides the brain with information that is already, to a degree, organized and interpreted, instead of simply transmitting an image.

With Roberto Moreno-Díaz, he studied a formalized problem of memory. Given that neural networks can store memory by a pattern of oscillations in a circle, they studied the number of possible oscillation patterns that can be sustained by some neural network with N neurons. This came out to be K(N) = \binom{2^N}{k}\sum_{k=1}^{2^N-1} k! (Schnabel, 1966).Schnabel, C. P. J. ''Number of Modes of Oscillation of a Net of N Neurons''. Quarterly Progress Report No. 80, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, Mass., January 15, 1966. P. 253. Also, they proved a universality theorem, in that for each N, there exists a neural network (possibly with more than N neurons) with \log_2 K(N) binary inputs, such that, for any oscillation pattern realizable by some neural network with N neurons, there exists a binary input for this universal network such that it exhibits the same pattern.Moreno-Díaz, R. ''Realizability of a Neural Network Capable of All Possible Modes of Oscillation''. Quarterly Progress Report No. 82, Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, Mass., July 15, 1966. Pp. 280-285.Moreno-Díaz, R., and W. S. McCulloch. "''Circularities in nets and the concept of functional matrices''." ''Biocibernetics of the Central Nervous System, Little, Brown and Company, Boston'' (1969): 145-151.{{Cite journal |last1=Moreno-Díaz |first1=Roberto |last2=Moreno-Díaz |first2=Arminda |date=2007-04-01 |title=On the legacy of W.S. McCulloch |url=https://www.sciencedirect.com/science/article/abs/pii/S0303264706002152 |journal=Biosystems |series=BIOCOMP 2005: Selected papers presented at the International Conference - Diffusion Processes in Neurobiology and Subcellular Biology |volume=88 |issue=3 |pages=185–190 |doi=10.1016/j.biosystems.2006.08.010 |bibcode=2007BiSys..88..185M |issn=0303-2647|url-access=subscription }}

=== Control === McCulloch considered the problem of contradictory information and motives, which he called a "[[heterarchy]]" of motives, meaning that the motives are not linearly ordered, but can be ordered like A > B > C > A.{{Cite journal |last=McCulloch |first=Warren S. |date=June 1945 |title=A heterarchy of values determined by the topology of nervous nets |url=http://link.springer.com/10.1007/BF02478457 |journal=The Bulletin of Mathematical Biophysics |language=en |volume=7 |issue=2 |pages=89–93 |doi=10.1007/BF02478457 |pmid=21006853 |issn=0007-4985|url-access=subscription }} He posited the concept of "poker chip" [[reticular formation]]s as to how the brain deals with contradictory information in a democratic, somatotopical neural network. Specifically, how the brain can commit the animal to a single course of action when the situation is ambiguous.

They designed a prototypic example neural network "RETIC", with "12 anastomatically coupled modules stacked in columnar array", which can switch between unambiguous stable modes based on ambiguous inputs.

His principle of "Redundancy of Potential Command"{{Citation |last1=Kilmer |first1=W. L. |title=Some Mechanisms for a Theory of the Reticular Formation |date=1968 |work=Systems Theory and Biology |pages=286–375 |editor-last=Mesarović |editor-first=M. D. |url=http://link.springer.com/10.1007/978-3-642-88343-9_14 |place=Berlin, Heidelberg |publisher=Springer Berlin Heidelberg |language=en |doi=10.1007/978-3-642-88343-9_14 |isbn=978-3-642-88345-3 |last2=McCulloch |first2=W. S. |last3=Blum |first3=J.|url-access=subscription }} was developed by [[Heinz von Foerster|von Foerster]] and [[Gordon Pask|Pask]] in their study of [[self-organization]]"A Predictive Model for Self-Organizing Systems", Part I: Cybernetica 3, pp. 258–300; Part II: Cybernetica 4, pp. 20–55, 1961 [[Heinz von Foerster]] and [[Gordon Pask]] and by Pask in his [[Conversation Theory]] and [[Gordon Pask#Interactions of Actors Theory|Interactions of Actors Theory]].Gordon Pask (1996). ''Heinz von Foerster's Self-Organisation, the Progenitor of Conversation and Interaction Theories''

== Publications == McCulloch wrote a book and several articles:His papers now reside in the manuscripts collection of the [[American Philosophical Society]].

1965, ''Embodiments of Mind''. MIT Press, Cambridge,
1993, ''The Complete Works of Warren S. McCulloch''. Intersystems Publications: Salinas, CA.

Articles, a selection:

1943, [https://www.cs.cmu.edu/~./epxing/Class/10715/reading/McCulloch.and.Pitts.pdf "A Logical Calculus of the Ideas Immanent in Nervous Activity"]. With [[Walter Pitts]]. In: ''Bulletin of Mathematical Biophysics'' Vol 5, pp 115–133.
1945, "A Heterarchy of Values Determined by the Topology of Nervous Nets". In: ''Bulletin of Mathematical Biophysics'', 7, 1945, 89–93.
1959, [https://web.archive.org/web/20110928024235/http://jerome.lettvin.info/lettvin/Jerome/WhatTheFrogsEyeTellsTheFrogsBrain.pdf "What The Frog's Eye Tells The Frog's Brain"]. With [[Jerome Lettvin]], [[Humberto Maturana|H.R. Maturana]] and [[Walter Pitts|W.H. Pitts]]. In: ''Proc. of the I. R. E.'' Vol 47 (11).
1969, [http://www.cyberneticians.com/materials/mcculloch-recollections.pdf "Recollections of the Many Sources of Cybernetics"], published in: ASC FORUM Volume VI, Number 2 -Summer 1974.

Papers published by the Chicago Literary Club:

1945, [https://web.archive.org/web/20080509162455/http://www.chilit.org/Published%20Papers/48.%20McCulloch%20--%20Word.PDF "One Word After Another"].
1959, [https://web.archive.org/web/20080509163314/http://www.chilit.org/Published%20Papers/56.%20McCulloch%20--%20Delusion.PDF "The Past of a Delusion"].
1959, [https://web.archive.org/web/20080509183513/http://www.chilit.org/Published%20Papers/66.%20McCulloch%20--%20Natural%20Fit.PDF "The Natural Fit"].

== See also == *[[Randolph diagram]]

== References == {{Reflist}}

== Further reading == {{wikiquote|Warren S. McCulloch}} *''Rebel Genius: Warren S. McCulloch's Transdisciplinary Life in Science'' (Cambridge, MA: MIT Press, 2016). *''New York Times'' (1969), Obituaries, September 25.

Crevier, Daniel (1993), ''AI: The Tumultuous Search for Artificial Intelligence'', BasicBooks, New York, NY.

{{DEFAULTSORT:McCulloch, Warren Sturgis}} [[Category:1898 births]] [[Category:1969 deaths]] [[Category:Cyberneticists]] [[Category:American neuroscientists]] [[Category:American systems scientists]] [[Category:People from Orange, New Jersey]] [[Category:Columbia University Vagelos College of Physicians and Surgeons alumni]] [[Category:Haverford College alumni]] [[Category:Yale University alumni]] [[Category:20th-century American people]]