- Title Pages
- The Rise of Cognitive Architectures
- Preface
- Contributors
- Part I Beginnings
- 1 Composition and Control of Integrated Cognitive Systems
- 2 Cognitive Control in a Computational Model of the Predator Pilot
- 3 Some History of Human Performance Modeling
- PART II Systems for Modeling Integrated Cognitive Systems
- 4 Using Brain Imaging to Guide the Development of a Cognitive Architecture
- 5 The Motivational and Metacognitive Control in CLARION
- 6 Reasoning as Cognitive Self-Regulation
- 7 Construction/Integration Architecture
- Part III Visual Attention and Perception
- 8 Guided Search 4.0
- 9 Advancing Area Activation toward a General Model of Eye Movements in Visual Search
- 10 The Modeling and Control of Visual Perception
- Part IV Environmental Constraints on Integrated Cognitive Systems
- 11 From Disintegrated Architectures of Cognition to an Integrated Heuristic Toolbox
- 12 A Rational–Ecological Approach to the Exploration/Exploitation Trade-Offs
- 13 Sequential Dependencies in Human Behavior Offer Insights into Cognitive Control
- 14 Ecological Resources for Modeling Interactive Behavior and Embedded Cognition
- Part V Integrating Emotions, Motivation, Arousal into Models of Cognitive Systems
- 15 Integrating Emotional Processes into Decision-Making Models
- 16 The Architectural Role of Emotion in Cognitive Systems
- 17 Decreased Arousal as a Result of Sleep Deprivation
- 18 Lessons from Defining Theories of Stress for Cognitive Architectures
- 19 Reasons for Emotions
- PART VI Modeling Embodiment in Integrated Cognitive Systems
- 20 On the Role of Embodiment in Modeling Natural Behaviors
- 21 Questions without Words
- 22 Toward an Integrated, Comprehensive Theory of Visual Search
- Part VII Coordinating Tasks Through Goals and Intentions
- 23 Control of Cognition
- 24 Integrated Models of Driver Behavior
- 25 The Minimal Control Principle
- 26 Control Signals and Goal-Directed Behavior
- 27 Intentions, Errors, and Experience
- PART VIII Tools for Advancing Integrated Models of Cognitive Systems
- 28 Bounding Rational Analysis
- 29 Integrating Cognitive Systems
- Part IX Afterword
- 30 Local Theories versus Comprehensive Architectures
- Author Index
- Subject Index
A Rational–Ecological Approach to the Exploration/Exploitation Trade-Offs
A Rational–Ecological Approach to the Exploration/Exploitation Trade-Offs
Bounded Rationality and Suboptimal Performance
- Chapter:
- (p.165) 12 A Rational–Ecological Approach to the Exploration/Exploitation Trade-Offs
- Source:
- Integrated Models of Cognitive Systems
- Author(s):
Wai-Tat Fu
- Publisher:
- Oxford University Press
This chapter describes a rational-ecological approach to derive the processes underlying the balance between exploration and exploitation of actions as an organism adapts to a new environment. The approach uses a two-step procedure: the general environment is first analyzed to identify its invariant properties; then a set of adaptive mechanisms are proposed that exploit these invariant properties. The underlying assumption of the approach is that cognitive algorithms are adapted to the invariant properties of the general environment. The current proposal is that suboptimal performance can be often explained by the interaction of the cognitive algorithms, information samples, and the specific properties of the new environment so that the obtained samples of the environment may provide a biased representational input to the cognitive algorithms. The current approach is applied to analyze behavior in two information-seeking tasks. It is shown that suboptimal performance is often an emergent property of the dynamic interactions between cognition, information samples, and the characteristics of the environment.
Keywords: rational-ecological approach, exploration, exploitation, invariant properties, cognitive algorithms, suboptimal performance, information-seeking tasks, cognition, information samples, environment
Oxford Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.
Please, subscribe or login to access full text content.
If you think you should have access to this title, please contact your librarian.
To troubleshoot, please check our FAQs , and if you can't find the answer there, please contact us .
- Title Pages
- The Rise of Cognitive Architectures
- Preface
- Contributors
- Part I Beginnings
- 1 Composition and Control of Integrated Cognitive Systems
- 2 Cognitive Control in a Computational Model of the Predator Pilot
- 3 Some History of Human Performance Modeling
- PART II Systems for Modeling Integrated Cognitive Systems
- 4 Using Brain Imaging to Guide the Development of a Cognitive Architecture
- 5 The Motivational and Metacognitive Control in CLARION
- 6 Reasoning as Cognitive Self-Regulation
- 7 Construction/Integration Architecture
- Part III Visual Attention and Perception
- 8 Guided Search 4.0
- 9 Advancing Area Activation toward a General Model of Eye Movements in Visual Search
- 10 The Modeling and Control of Visual Perception
- Part IV Environmental Constraints on Integrated Cognitive Systems
- 11 From Disintegrated Architectures of Cognition to an Integrated Heuristic Toolbox
- 12 A Rational–Ecological Approach to the Exploration/Exploitation Trade-Offs
- 13 Sequential Dependencies in Human Behavior Offer Insights into Cognitive Control
- 14 Ecological Resources for Modeling Interactive Behavior and Embedded Cognition
- Part V Integrating Emotions, Motivation, Arousal into Models of Cognitive Systems
- 15 Integrating Emotional Processes into Decision-Making Models
- 16 The Architectural Role of Emotion in Cognitive Systems
- 17 Decreased Arousal as a Result of Sleep Deprivation
- 18 Lessons from Defining Theories of Stress for Cognitive Architectures
- 19 Reasons for Emotions
- PART VI Modeling Embodiment in Integrated Cognitive Systems
- 20 On the Role of Embodiment in Modeling Natural Behaviors
- 21 Questions without Words
- 22 Toward an Integrated, Comprehensive Theory of Visual Search
- Part VII Coordinating Tasks Through Goals and Intentions
- 23 Control of Cognition
- 24 Integrated Models of Driver Behavior
- 25 The Minimal Control Principle
- 26 Control Signals and Goal-Directed Behavior
- 27 Intentions, Errors, and Experience
- PART VIII Tools for Advancing Integrated Models of Cognitive Systems
- 28 Bounding Rational Analysis
- 29 Integrating Cognitive Systems
- Part IX Afterword
- 30 Local Theories versus Comprehensive Architectures
- Author Index
- Subject Index
