webppl-agents

This package provides constructors for MDP and POMDP agents, for gridworld and bandit environments, and a function for visualizing gridworlds:

• Environments:
  • makeGridWorldMDP
  • makeGridWorldPOMDP
  • makeBanditPOMDP
• Agents:
  • makeMDPAgent + simulateMDP
  • makePOMDPAgent + simulatePOMDP
• Visualization:
  • GridWorld.draw (also available as viz.gridworld if webppl-viz is used)

Installation

To globally install webppl-agents, run:

mkdir -p ~/.webppl
npm install --prefix ~/.webppl webppl-agents

This may print warnings (npm WARN ENOENT...) which can be ignored.

To upgrade to the latest version, run:

npm install --prefix ~/.webppl webppl-agents --force

For the agent functions, you will also need to install webppl-dp.

Usage

Once installed, you can make the environment and agent functions available to program.wppl by running:

webppl --require webppl-dp --require webppl-agents program.wppl

Testing

Run the included test using:

webppl --require webppl-dp --require . tests/tests.wppl

License

MIT