Jump to ContentJump to Main Navigation
Computational Interaction$
Users without a subscription are not able to see the full content.

Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, and Andrew Howes

Print publication date: 2018

Print ISBN-13: 9780198799603

Published to Oxford Scholarship Online: March 2018

DOI: 10.1093/oso/9780198799603.001.0001

Show Summary Details
Page of

PRINTED FROM OXFORD SCHOLARSHIP ONLINE (www.oxfordscholarship.com). (c) Copyright Oxford University Press, 2019. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a monograph in OSO for personal use (for details see www.oxfordscholarship.com/page/privacy-policy).date: 19 July 2019

Interaction as an Emergent Property of a Partially Observable Markov Decision Process

Interaction as an Emergent Property of a Partially Observable Markov Decision Process

Chapter:
(p.287) 10 Interaction as an Emergent Property of a Partially Observable Markov Decision Process
Source:
Computational Interaction
Author(s):

Andrew Howes

Xiuli Chen

Aditya Acharya

Richard L. Lewis

Publisher:
Oxford University Press
DOI:10.1093/oso/9780198799603.003.0011

In this chapter we explore the potential advantages of modeling the interaction between a human and a computer as a consequence of a Partially Observable Markov Decision Process (POMDP) that models human cognition. POMDPs can be used to model human perceptual mechanisms, such as human vision, as partial (uncertain) observers of a hidden state are possible. In general, POMDPs permit a rigorous definition of interaction as the outcome of a reward maximizing stochastic sequential decision processes. They have been shown to explain interaction between a human and an environment in a range of scenarios, including visual search, interactive search and sense-making. The chapter uses these scenarios to illustrate the explanatory power of POMDPs in HCI. It also shows that POMDPs embrace the embodied, ecological and adaptive nature of human interaction.

Keywords:   interaction, POMDP, cognitive model, machine learning, reinforcement learning, adaptive, visual search

Oxford Scholarship Online requires a subscription or purchase to access the full text of books within the service. Public users can however freely search the site and view the abstracts and keywords for each book and chapter.

Please, subscribe or login to access full text content.

If you think you should have access to this title, please contact your librarian.

To troubleshoot, please check our FAQs , and if you can't find the answer there, please contact us .