NDLI: A framework of an agent planning with reinforcement learning for e-pet

Content Provider	IEEE Xplore Digital Library
Author	Sheng-Tzong Cheng Tun-Yu Chang Chih-Wei Hsu
Copyright Year	2013
Description	Author affiliation: Dept. of Comput. Sci. & Inf. Eng., Nat. Cheng Kung Univ., Tainan, Taiwan (Sheng-Tzong Cheng; Tun-Yu Chang; Chih-Wei Hsu)
Abstract	E-pet is an animal-type robot companions, he can be physical or electronic. Reinforcement learning (RL) can be applied to the e-pet. However, the interactive instruction is constituted by complex activities. In this study, we proposed a framework that integrated AI planning technology into RL to generate the solution. In the framework, the e-pet interacts with human and includes two components: environment and agent. The agent exploits AI planning to seek goal state and Markov decision process (MDP) to choose the action and updates each Q-value using Q-learning algorithm. And we proposed the three-level subsumption architecture which including instinct level, perception level, and planning level. We build layers corresponding to each level of competence and can simply add a new layer to an existing set to move to the next higher level of overall competence. We implement the e-pet in a 3D model and train the agent. Experimental result shows that the update of Q-table reduces the number of planning states in the framework.
Sponsorship	IEEE Tainan Sect.
Starting Page	310
Ending Page	313
File Size	668670
Page Count	4
File Format	PDF
ISBN	9781467359344
e-ISBN	9781467359368
DOI	10.1109/ICOT.2013.6521220
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-03-12
Publisher Place	Taiwan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Solid modeling Three-dimensional displays E-pet Learning (artificial intelligence) Reinforcement learning Markov processes AI planning Markov decision process Subsumption architecture Planning Robots
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

State thresholding to accelerate reinforcement learning

High-level behavior control of an e-pet with reinforcement learning

A decision-making method for autonomous vehicles based on simulation and reinforcement learning

Web Service Composition Based on Reinforcement Learning

Multiple-model Q-learning for stochastic reinforcement delays

Multi-robot collaboration based on Markov decision process in Robocup3D soccer simulation game

Continuous-time Markov decision process with average reward: Using reinforcement learning method

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning

Solving Problems with Extended Reachability Goals through Reinforcement Learning on Propositionally Constrained State Spaces

A framework of an agent planning with reinforcement learning for e-pet

Similar Documents

State thresholding to accelerate reinforcement learning

High-level behavior control of an e-pet with reinforcement learning

A decision-making method for autonomous vehicles based on simulation and reinforcement learning

Web Service Composition Based on Reinforcement Learning

Multiple-model Q-learning for stochastic reinforcement delays

Multi-robot collaboration based on Markov decision process in Robocup3D soccer simulation game

Continuous-time Markov decision process with average reward: Using reinforcement learning method

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning

Solving Problems with Extended Reachability Goals through Reinforcement Learning on Propositionally Constrained State Spaces

A framework of an agent planning with reinforcement learning for e-pet