Can I read Improving Imitation Learning by Merging Experts Trajectories on EtoBox?

Improving Imitation Learning by Merging Experts Trajectories by Pegah Alizadeh; Aomar Osmani; Sammy Taleb is a scholarly article available to read on EtoBox.

What is Improving Imitation Learning by Merging Experts Trajectories about?

This paper proposes an original approach based on expert trajectories combination and Deep Reinforcement Learning to provide a better MineCraft player. The combination is based on the idea that the problem is naturally decomposable and the search space presents large plateaus. We use two steps approach to build a better trajectory from all existed expert trajectories and consequently to extract an optimal policy. The first step uses Birch clustering approach and images cosine similarity to obtain compact representation and substantial state and action space reduction. To reduce the overall complexity, the image distances are computed in images latent space trained by an encoder-decoder model. In the second step, we first eliminate plateaus to keep only the nodes with non-zero rewards then we compare trajectories using the Bellman equation and an appropriate value function. By checking the incremental compatibility of the trajectory of compact representations, we build the solution combining the best compatible sub-trajectories of the experts. The experimental results on NeurIPS MineRL 2020 challenge show that training the actors model on the most rewarding extracted subset of traje

Author

Pegah Alizadeh; Aomar Osmani; Sammy Taleb

Publisher

ACM

Published

2022

Language

EN