Open-Source RL Environment for Planning Interventions on Transportation Infrastructure

InfraPlanner is a Python open-source RL environment developed in accordance to the gym environment standards. This environment enables emulating the visual insepctions process, and produces probablistic estimates for the deteriroation condition and speed. The deterioration state in this environment can be obtained at the element-level, the structural category level, and bridge-level.

Paper presnetation: YouTube.

How to cite

Hierarchical reinforcement learning for transportation infrastructure maintenance planning
Hamida, Z. and Goulet, J.-A.
Reliablity Engineering & System Safety [DOI]

Prerequisites

• Python 3.x

• Pytorch: load pre-traind models (Optional).

• Access to GPU computing (Optional)

Getting Started

To get started, open the terminal and clone the repo,

git clone https://github.com/CivML-PolyMtl/InfrastructuresPlanner.git

Access the project folder,

cd InfrastructuresPlanner

Create a virtual environment,

python -m venv .venv
# Or,
python3 -m venv .venv

Activate the environment,

source .venv/bin/activate
# Or in windows,
&.venv/scripts/activate.ps1

Install the required packages by using the pip command in terminal,

 pip install -r requirements.txt

Run environment tests using,

 python test_env.py

Remarks

The Infra Planner package is originally developed based on the inspection and interventions database of the Transportation Ministry of Quebec (MTQ).

Misc

To perform analyses on vectorized environment, a recommanded wrapper is (RayEnvWrapper):

pip install RayEnvWrapper
number_of_workers, envs_per_worker = 10, 2
base_env = infra_planner
env = WrapperRayVecEnv(base_env, number_of_workers, envs_per_worker)
env.step(0)

• Note: RayEnvWrapper is an external package; therefore, it is required to verify the compatiblity with the OS in use.

Contributing

Please read CONTRIBUTING.md for details on the process for submitting pull requests.

Authors

• Zachary Hamida - Methodology & code development - webpage
• James-A. Goulet - Methodology review & development - webpage

Acknowledgments

• The funding for this project is provided by the Transportation Ministry of Quebec Province (MTQ), Canada.