Rethinking eliminative connectionism. Marcus, G. F Cognit Psychol, 37(3):243–82, 1998. abstract bibtex Humans routinely generalize universal relationships to unfamiliar instances. If we are told "if glork then frum," and "glork," we can infer "frum"; any name that serves as the subject of a sentence can appear as the object of a sentence. These universals are pervasive in language and reasoning. One account of how they are generalized holds that humans possess mechanisms that manipulate symbols and variables; an alternative account holds that symbol-manipulation can be eliminated from scientific theories in favor of descriptions couched in terms of networks of interconnected nodes. Can these "eliminative" connectionist models offer a genuine alternative? This article shows that eliminative connectionist models cannot account for how we extend universals to arbitrary items. The argument runs as follows. First, if these models, as currently conceived, were to extend universals to arbitrary instances, they would have to generalize outside the space of training examples. Next, it is shown that the class of eliminative connectionist models that is currently popular cannot learn to extend universals outside the training space. This limitation might be avoided through the use of an architecture that implements symbol manipulation.
@Article{Marcus1998a,
author = {Marcus, Gary F},
journal = {Cognit Psychol},
title = {Rethinking eliminative connectionism},
year = {1998},
number = {3},
pages = {243--82},
volume = {37},
abstract = {Humans routinely generalize universal relationships to unfamiliar
instances. If we are told "if glork then frum," and "glork," we can
infer "frum"; any name that serves as the subject of a sentence can
appear as the object of a sentence. These universals are pervasive
in language and reasoning. One account of how they are generalized
holds that humans possess mechanisms that manipulate symbols and
variables; an alternative account holds that symbol-manipulation
can be eliminated from scientific theories in favor of descriptions
couched in terms of networks of interconnected nodes. Can these "eliminative"
connectionist models offer a genuine alternative? This article shows
that eliminative connectionist models cannot account for how we extend
universals to arbitrary items. The argument runs as follows. First,
if these models, as currently conceived, were to extend universals
to arbitrary instances, they would have to generalize outside the
space of training examples. Next, it is shown that the class of eliminative
connectionist models that is currently popular cannot learn to extend
universals outside the training space. This limitation might be avoided
through the use of an architecture that implements symbol manipulation.},
keywords = {Computing Methodologies, Human, Language, Learning, Mental Processes, Models, Theoretical, Stochastic Processes, Support, U.S. Gov't, Non-P.H.S., Cognition, Linguistics, Neural Networks (Computer), Practice (Psychology), Non-U.S. Gov't, Memory, Psychological, Task Performance and Analysis, Time Factors, Visual Perception, Adult, Attention, Discrimination Learning, Female, Male, Short-Term, Mental Recall, Orientation, Pattern Recognition, Visual, Perceptual Masking, Reading, Concept Formation, Form Perception, Animals, Corpus Striatum, Shrews, P.H.S., Visual Cortex, Visual Pathways, Acoustic Stimulation, Auditory Cortex, Auditory Perception, Cochlea, Ear, Gerbillinae, Glycine, Hearing, Neurons, Space Perception, Strychnine, Adolescent, Decision Making, Reaction Time, Astrocytoma, Brain Mapping, Brain Neoplasms, Cerebral Cortex, Electric Stimulation, Electrophysiology, Epilepsy, Temporal Lobe, Evoked Potentials, Frontal Lobe, Noise, Parietal Lobe, Scalp, Child, Language Development, Psycholinguistics, Brain, Perception, Speech, Vocalization, Animal, Discrimination (Psychology), Hippocampus, Rats, Calcium, Chelating Agents, Excitatory Postsynaptic Potentials, Glutamic Acid, Guanosine Diphosphate, In Vitro, Neuronal Plasticity, Pyramidal Cells, Receptors, AMPA, Metabotropic Glutamate, N-Methyl-D-Aspartate, Somatosensory Cortex, Synapses, Synaptic Transmission, Thionucleotides, Action Potentials, Calcium Channels, L-Type, Electric Conductivity, Entorhinal Cortex, Neurological, Long-Evans, Infant, Mathematics, Statistics, Probability Learning, Problem Solving, Psychophysics, Association Learning, Child Psychology, Habituation (Psychophysiology), Probability Theory, Analysis of Variance, Semantics, Symbolism, Behavior, Eye Movements, Macaca mulatta, Prefrontal Cortex, Cats, Dogs, Haplorhini, Photic Stimulation, Electroencephalography, Nervous System Physiology, Darkness, Grasshoppers, Light, Membrane Potentials, Neural Inhibition, Afferent, Picrotoxin, Vision, Deoxyglucose, Injections, Microspheres, Neural Pathways, Rhodamines, Choice Behavior, Speech Perception, Verbal Learning, Dominance, Cerebral, Fixation, Ocular, Language Tests, Random Allocation, Comparative Study, Saguinus, Sound Spectrography, Species Specificity, Audiometry, Auditory Threshold, Calibration, Data Interpretation, Statistical, Anesthesia, General, Electrodes, Implanted, Pitch Perception, Sound Localization, Paired-Associate Learning, Serial Learning, Auditory, Age Factors, Motion Perception, Brain Injuries, Computer Simulation, Blindness, Psychomotor Performance, Color Perception, Signal Detection (Psychology), Judgment, ROC Curve, Regression Analysis, Music, Probability, Arm, Cerebrovascular Disorders, Hemiplegia, Movement, Muscle, Skeletal, Myoclonus, Robotics, Magnetoencephalography, Phonetics, Software, Speech Production Measurement, Epilepsies, Partial, Laterality, Stereotaxic Techniques, Germany, Speech Acoustics, Verbal Behavior, 9892549},
}
Downloads: 0
{"_id":"XSdeLFM9jAfNMqvMi","bibbaseid":"marcus-rethinkingeliminativeconnectionism-1998","author_short":["Marcus, G. F"],"bibdata":{"bibtype":"article","type":"article","author":[{"propositions":[],"lastnames":["Marcus"],"firstnames":["Gary","F"],"suffixes":[]}],"journal":"Cognit Psychol","title":"Rethinking eliminative connectionism","year":"1998","number":"3","pages":"243–82","volume":"37","abstract":"Humans routinely generalize universal relationships to unfamiliar instances. If we are told \"if glork then frum,\" and \"glork,\" we can infer \"frum\"; any name that serves as the subject of a sentence can appear as the object of a sentence. These universals are pervasive in language and reasoning. One account of how they are generalized holds that humans possess mechanisms that manipulate symbols and variables; an alternative account holds that symbol-manipulation can be eliminated from scientific theories in favor of descriptions couched in terms of networks of interconnected nodes. Can these \"eliminative\" connectionist models offer a genuine alternative? This article shows that eliminative connectionist models cannot account for how we extend universals to arbitrary items. The argument runs as follows. First, if these models, as currently conceived, were to extend universals to arbitrary instances, they would have to generalize outside the space of training examples. Next, it is shown that the class of eliminative connectionist models that is currently popular cannot learn to extend universals outside the training space. This limitation might be avoided through the use of an architecture that implements symbol manipulation.","keywords":"Computing Methodologies, Human, Language, Learning, Mental Processes, Models, Theoretical, Stochastic Processes, Support, U.S. Gov't, Non-P.H.S., Cognition, Linguistics, Neural Networks (Computer), Practice (Psychology), Non-U.S. Gov't, Memory, Psychological, Task Performance and Analysis, Time Factors, Visual Perception, Adult, Attention, Discrimination Learning, Female, Male, Short-Term, Mental Recall, Orientation, Pattern Recognition, Visual, Perceptual Masking, Reading, Concept Formation, Form Perception, Animals, Corpus Striatum, Shrews, P.H.S., Visual Cortex, Visual Pathways, Acoustic Stimulation, Auditory Cortex, Auditory Perception, Cochlea, Ear, Gerbillinae, Glycine, Hearing, Neurons, Space Perception, Strychnine, Adolescent, Decision Making, Reaction Time, Astrocytoma, Brain Mapping, Brain Neoplasms, Cerebral Cortex, Electric Stimulation, Electrophysiology, Epilepsy, Temporal Lobe, Evoked Potentials, Frontal Lobe, Noise, Parietal Lobe, Scalp, Child, Language Development, Psycholinguistics, Brain, Perception, Speech, Vocalization, Animal, Discrimination (Psychology), Hippocampus, Rats, Calcium, Chelating Agents, Excitatory Postsynaptic Potentials, Glutamic Acid, Guanosine Diphosphate, In Vitro, Neuronal Plasticity, Pyramidal Cells, Receptors, AMPA, Metabotropic Glutamate, N-Methyl-D-Aspartate, Somatosensory Cortex, Synapses, Synaptic Transmission, Thionucleotides, Action Potentials, Calcium Channels, L-Type, Electric Conductivity, Entorhinal Cortex, Neurological, Long-Evans, Infant, Mathematics, Statistics, Probability Learning, Problem Solving, Psychophysics, Association Learning, Child Psychology, Habituation (Psychophysiology), Probability Theory, Analysis of Variance, Semantics, Symbolism, Behavior, Eye Movements, Macaca mulatta, Prefrontal Cortex, Cats, Dogs, Haplorhini, Photic Stimulation, Electroencephalography, Nervous System Physiology, Darkness, Grasshoppers, Light, Membrane Potentials, Neural Inhibition, Afferent, Picrotoxin, Vision, Deoxyglucose, Injections, Microspheres, Neural Pathways, Rhodamines, Choice Behavior, Speech Perception, Verbal Learning, Dominance, Cerebral, Fixation, Ocular, Language Tests, Random Allocation, Comparative Study, Saguinus, Sound Spectrography, Species Specificity, Audiometry, Auditory Threshold, Calibration, Data Interpretation, Statistical, Anesthesia, General, Electrodes, Implanted, Pitch Perception, Sound Localization, Paired-Associate Learning, Serial Learning, Auditory, Age Factors, Motion Perception, Brain Injuries, Computer Simulation, Blindness, Psychomotor Performance, Color Perception, Signal Detection (Psychology), Judgment, ROC Curve, Regression Analysis, Music, Probability, Arm, Cerebrovascular Disorders, Hemiplegia, Movement, Muscle, Skeletal, Myoclonus, Robotics, Magnetoencephalography, Phonetics, Software, Speech Production Measurement, Epilepsies, Partial, Laterality, Stereotaxic Techniques, Germany, Speech Acoustics, Verbal Behavior, 9892549","bibtex":"@Article{Marcus1998a,\n author = {Marcus, Gary F},\n journal = {Cognit Psychol},\n title = {Rethinking eliminative connectionism},\n year = {1998},\n number = {3},\n pages = {243--82},\n volume = {37},\n abstract = {Humans routinely generalize universal relationships to unfamiliar\n\tinstances. If we are told \"if glork then frum,\" and \"glork,\" we can\n\tinfer \"frum\"; any name that serves as the subject of a sentence can\n\tappear as the object of a sentence. These universals are pervasive\n\tin language and reasoning. One account of how they are generalized\n\tholds that humans possess mechanisms that manipulate symbols and\n\tvariables; an alternative account holds that symbol-manipulation\n\tcan be eliminated from scientific theories in favor of descriptions\n\tcouched in terms of networks of interconnected nodes. Can these \"eliminative\"\n\tconnectionist models offer a genuine alternative? This article shows\n\tthat eliminative connectionist models cannot account for how we extend\n\tuniversals to arbitrary items. The argument runs as follows. First,\n\tif these models, as currently conceived, were to extend universals\n\tto arbitrary instances, they would have to generalize outside the\n\tspace of training examples. Next, it is shown that the class of eliminative\n\tconnectionist models that is currently popular cannot learn to extend\n\tuniversals outside the training space. This limitation might be avoided\n\tthrough the use of an architecture that implements symbol manipulation.},\n keywords = {Computing Methodologies, Human, Language, Learning, Mental Processes, Models, Theoretical, Stochastic Processes, Support, U.S. Gov't, Non-P.H.S., Cognition, Linguistics, Neural Networks (Computer), Practice (Psychology), Non-U.S. Gov't, Memory, Psychological, Task Performance and Analysis, Time Factors, Visual Perception, Adult, Attention, Discrimination Learning, Female, Male, Short-Term, Mental Recall, Orientation, Pattern Recognition, Visual, Perceptual Masking, Reading, Concept Formation, Form Perception, Animals, Corpus Striatum, Shrews, P.H.S., Visual Cortex, Visual Pathways, Acoustic Stimulation, Auditory Cortex, Auditory Perception, Cochlea, Ear, Gerbillinae, Glycine, Hearing, Neurons, Space Perception, Strychnine, Adolescent, Decision Making, Reaction Time, Astrocytoma, Brain Mapping, Brain Neoplasms, Cerebral Cortex, Electric Stimulation, Electrophysiology, Epilepsy, Temporal Lobe, Evoked Potentials, Frontal Lobe, Noise, Parietal Lobe, Scalp, Child, Language Development, Psycholinguistics, Brain, Perception, Speech, Vocalization, Animal, Discrimination (Psychology), Hippocampus, Rats, Calcium, Chelating Agents, Excitatory Postsynaptic Potentials, Glutamic Acid, Guanosine Diphosphate, In Vitro, Neuronal Plasticity, Pyramidal Cells, Receptors, AMPA, Metabotropic Glutamate, N-Methyl-D-Aspartate, Somatosensory Cortex, Synapses, Synaptic Transmission, Thionucleotides, Action Potentials, Calcium Channels, L-Type, Electric Conductivity, Entorhinal Cortex, Neurological, Long-Evans, Infant, Mathematics, Statistics, Probability Learning, Problem Solving, Psychophysics, Association Learning, Child Psychology, Habituation (Psychophysiology), Probability Theory, Analysis of Variance, Semantics, Symbolism, Behavior, Eye Movements, Macaca mulatta, Prefrontal Cortex, Cats, Dogs, Haplorhini, Photic Stimulation, Electroencephalography, Nervous System Physiology, Darkness, Grasshoppers, Light, Membrane Potentials, Neural Inhibition, Afferent, Picrotoxin, Vision, Deoxyglucose, Injections, Microspheres, Neural Pathways, Rhodamines, Choice Behavior, Speech Perception, Verbal Learning, Dominance, Cerebral, Fixation, Ocular, Language Tests, Random Allocation, Comparative Study, Saguinus, Sound Spectrography, Species Specificity, Audiometry, Auditory Threshold, Calibration, Data Interpretation, Statistical, Anesthesia, General, Electrodes, Implanted, Pitch Perception, Sound Localization, Paired-Associate Learning, Serial Learning, Auditory, Age Factors, Motion Perception, Brain Injuries, Computer Simulation, Blindness, Psychomotor Performance, Color Perception, Signal Detection (Psychology), Judgment, ROC Curve, Regression Analysis, Music, Probability, Arm, Cerebrovascular Disorders, Hemiplegia, Movement, Muscle, Skeletal, Myoclonus, Robotics, Magnetoencephalography, Phonetics, Software, Speech Production Measurement, Epilepsies, Partial, Laterality, Stereotaxic Techniques, Germany, Speech Acoustics, Verbal Behavior, 9892549},\n}\n\n","author_short":["Marcus, G. F"],"key":"Marcus1998a","id":"Marcus1998a","bibbaseid":"marcus-rethinkingeliminativeconnectionism-1998","role":"author","urls":{},"keyword":["Computing Methodologies","Human","Language","Learning","Mental Processes","Models","Theoretical","Stochastic Processes","Support","U.S. Gov't","Non-P.H.S.","Cognition","Linguistics","Neural Networks (Computer)","Practice (Psychology)","Non-U.S. Gov't","Memory","Psychological","Task Performance and Analysis","Time Factors","Visual Perception","Adult","Attention","Discrimination Learning","Female","Male","Short-Term","Mental Recall","Orientation","Pattern Recognition","Visual","Perceptual Masking","Reading","Concept Formation","Form Perception","Animals","Corpus Striatum","Shrews","P.H.S.","Visual Cortex","Visual Pathways","Acoustic Stimulation","Auditory Cortex","Auditory Perception","Cochlea","Ear","Gerbillinae","Glycine","Hearing","Neurons","Space Perception","Strychnine","Adolescent","Decision Making","Reaction Time","Astrocytoma","Brain Mapping","Brain Neoplasms","Cerebral Cortex","Electric Stimulation","Electrophysiology","Epilepsy","Temporal Lobe","Evoked Potentials","Frontal Lobe","Noise","Parietal Lobe","Scalp","Child","Language Development","Psycholinguistics","Brain","Perception","Speech","Vocalization","Animal","Discrimination (Psychology)","Hippocampus","Rats","Calcium","Chelating Agents","Excitatory Postsynaptic Potentials","Glutamic Acid","Guanosine Diphosphate","In Vitro","Neuronal Plasticity","Pyramidal Cells","Receptors","AMPA","Metabotropic Glutamate","N-Methyl-D-Aspartate","Somatosensory Cortex","Synapses","Synaptic Transmission","Thionucleotides","Action Potentials","Calcium Channels","L-Type","Electric Conductivity","Entorhinal Cortex","Neurological","Long-Evans","Infant","Mathematics","Statistics","Probability Learning","Problem Solving","Psychophysics","Association Learning","Child Psychology","Habituation (Psychophysiology)","Probability Theory","Analysis of Variance","Semantics","Symbolism","Behavior","Eye Movements","Macaca mulatta","Prefrontal Cortex","Cats","Dogs","Haplorhini","Photic Stimulation","Electroencephalography","Nervous System Physiology","Darkness","Grasshoppers","Light","Membrane Potentials","Neural Inhibition","Afferent","Picrotoxin","Vision","Deoxyglucose","Injections","Microspheres","Neural Pathways","Rhodamines","Choice Behavior","Speech Perception","Verbal Learning","Dominance","Cerebral","Fixation","Ocular","Language Tests","Random Allocation","Comparative Study","Saguinus","Sound Spectrography","Species Specificity","Audiometry","Auditory Threshold","Calibration","Data Interpretation","Statistical","Anesthesia","General","Electrodes","Implanted","Pitch Perception","Sound Localization","Paired-Associate Learning","Serial Learning","Auditory","Age Factors","Motion Perception","Brain Injuries","Computer Simulation","Blindness","Psychomotor Performance","Color Perception","Signal Detection (Psychology)","Judgment","ROC Curve","Regression Analysis","Music","Probability","Arm","Cerebrovascular Disorders","Hemiplegia","Movement","Muscle","Skeletal","Myoclonus","Robotics","Magnetoencephalography","Phonetics","Software","Speech Production Measurement","Epilepsies","Partial","Laterality","Stereotaxic Techniques","Germany","Speech Acoustics","Verbal Behavior","9892549"],"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://endress.org/publications/ansgar.bib","dataSources":["xPGxHAeh3vZpx4yyE","TXa55dQbNoWnaGmMq"],"keywords":["computing methodologies","human","language","learning","mental processes","models","theoretical","stochastic processes","support","u.s. gov't","non-p.h.s.","cognition","linguistics","neural networks (computer)","practice (psychology)","non-u.s. gov't","memory","psychological","task performance and analysis","time factors","visual perception","adult","attention","discrimination learning","female","male","short-term","mental recall","orientation","pattern recognition","visual","perceptual masking","reading","concept formation","form perception","animals","corpus striatum","shrews","p.h.s.","visual cortex","visual pathways","acoustic stimulation","auditory cortex","auditory perception","cochlea","ear","gerbillinae","glycine","hearing","neurons","space perception","strychnine","adolescent","decision making","reaction time","astrocytoma","brain mapping","brain neoplasms","cerebral cortex","electric stimulation","electrophysiology","epilepsy","temporal lobe","evoked potentials","frontal lobe","noise","parietal lobe","scalp","child","language development","psycholinguistics","brain","perception","speech","vocalization","animal","discrimination (psychology)","hippocampus","rats","calcium","chelating agents","excitatory postsynaptic potentials","glutamic acid","guanosine diphosphate","in vitro","neuronal plasticity","pyramidal cells","receptors","ampa","metabotropic glutamate","n-methyl-d-aspartate","somatosensory cortex","synapses","synaptic transmission","thionucleotides","action potentials","calcium channels","l-type","electric conductivity","entorhinal cortex","neurological","long-evans","infant","mathematics","statistics","probability learning","problem solving","psychophysics","association learning","child psychology","habituation (psychophysiology)","probability theory","analysis of variance","semantics","symbolism","behavior","eye movements","macaca mulatta","prefrontal cortex","cats","dogs","haplorhini","photic stimulation","electroencephalography","nervous system physiology","darkness","grasshoppers","light","membrane potentials","neural inhibition","afferent","picrotoxin","vision","deoxyglucose","injections","microspheres","neural pathways","rhodamines","choice behavior","speech perception","verbal learning","dominance","cerebral","fixation","ocular","language tests","random allocation","comparative study","saguinus","sound spectrography","species specificity","audiometry","auditory threshold","calibration","data interpretation","statistical","anesthesia","general","electrodes","implanted","pitch perception","sound localization","paired-associate learning","serial learning","auditory","age factors","motion perception","brain injuries","computer simulation","blindness","psychomotor performance","color perception","signal detection (psychology)","judgment","roc curve","regression analysis","music","probability","arm","cerebrovascular disorders","hemiplegia","movement","muscle","skeletal","myoclonus","robotics","magnetoencephalography","phonetics","software","speech production measurement","epilepsies","partial","laterality","stereotaxic techniques","germany","speech acoustics","verbal behavior","9892549"],"search_terms":["rethinking","eliminative","connectionism","marcus"],"title":"Rethinking eliminative connectionism","year":1998}