Communication-aware-Performance-Prediction-of-Parallel-Jobs

SURGE'23

Getting Started

Pre-requisites:

1. Python -version >=3.7
2. Python libraries: Numpy, Pandas, Matplotlib, Tensorflow, re, os, datetime, scikit-learn, and Seaborn.

About the Dataset:

We had data in five types of files: counters_table , jobs_table , paths_table , qstat_table and actual_runtimes

preprocessing.py

It contains how to prepare dataset for training model.

LSTM_model_code.py

This contain code for scaling features and LSTM model training.