Autonomous Learning of State Representations for Control: An Emerging Field Aims to Autonomously Learn State Representations for Reinforcement Learning Agents from Their Real-World Sensor Observations

Böhmer, WendelinSpringenberg, Jost TobiasBoedecker, JoschkaRiedmiller, MartinObermayer, Klaus2018-01-082018-01-0820152015https://dl.gi.de/handle/20.500.12116/11481This article reviews an emerging field that aims for autonomous reinforcement learning (RL) directly on sensor-observations. Straightforward end-to-end RL has recently shown remarkable success, but relies on large amounts of samples. As this is not feasible in robotics, we review two approaches to learn intermediate state representations from previous experiences: deep auto-encoders and slow-feature analysis. We analyze theoretical properties of the representations and point to potential improvements.Autonomous roboticsDeep auto-encoder networksEnd-to-end reinforcement learningRepresentation learningSlow feature analysisAutonomous Learning of State Representations for Control: An Emerging Field Aims to Autonomously Learn State Representations for Reinforcement Learning Agents from Their Real-World Sensor ObservationsText/Journal Article1610-1987