Skip to content

thomasj02/DeepRLNavigation

Repository files navigation

Project 1: Navigation

Introduction

This project trains an agent to navigate (and collect bananas!) in a large, square world.

Trained Agent

A reward of +1 is provided for collecting a yellow banana, and a reward of -1 is provided for collecting a blue banana. Thus, the goal of your agent is to collect as many yellow bananas as possible while avoiding blue bananas.

The state space has 37 dimensions and contains the agent's velocity, along with ray-based perception of objects around agent's forward direction. Given this information, the agent has to learn how to best select actions. Four discrete actions are available, corresponding to:

  • 0 - move forward.
  • 1 - move backward.
  • 2 - turn left.
  • 3 - turn right.

The task is episodic, and in order to solve the environment, your agent must get an average score of +13 over 100 consecutive episodes.

Getting Started

  1. Follow the instructions in the DRLND GitHub repository to set up your Python environment

  2. Download the environment from one of the links below. You need only select the environment that matches your operating system:

    (For Windows users) Check out this link if you need help with determining if your computer is running a 32-bit version or 64-bit version of the Windows operating system.

    (For AWS) If you'd like to train the agent on AWS (and have not enabled a virtual screen), then please use this link to obtain the environment.

  3. Place the file in the local GitHub repository, in the root folder, and unzip (or decompress) the file.

  4. (Optional) Run DqnTrainer.py to train the agent.

  5. Use the Report.ipynb notebook to visualize the results

About

Navigation project for Udacity Deep RL Course

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published