| title | description | author | layout |
|---|---|---|---|
The BigPanDA Project |
Next Generation Workload Management and Analysis System for Big Data |
Torre Wenaus |
page |
The BigPanDA project was established as an extension of the PanDA Project when DOE ASCR and DOE HEP funded in 2012 a three year work program to develop a next generation workload management and analysis system for big data building on PanDA.
PanDA was originally designed specifically for the needs of the ATLAS Experiment at the Large Hadron Collider (LHC), and has proved to be highly successful in meeting all the distributed computing needs of the experiment. The core design of PanDA is however not experiment specific.
PanDA is capable of meeting the needs of other data intensive scientific applications, and the BigPanDA project was created to undertake this. The project has generalized PanDA for use by other experiments, extended its reach to High Performance Computing (HPC) platforms, and added intelligent network awareness to the system.
The BigPanDA work program consists of four work packages as follows.
Factorizing the core components of PanDA to enable adoption by a wide range of exascale scientific communities.
Evolving PanDA to support extreme scale computing clouds and Leadership Computing Facilities.
Leveraging intelligent networks): Integrating network services and real-time data access to the PanDA workflow.
Real time monitoring and visualization package for PanDA.
- Face to Face Meeting at BNL, January 14, 2015
- Face to Face Meeting at BNL, May 6, 2014
- Phone conference, April 14, 2014
- Face to Face Meeting at ANL, March 6-7, 2014
- Face to Face Meeting at BNL, December 19, 2013
- PanDA Workshop at UTA, September 3-4, 2013
- Face to Face Meeting at BNL, August 13, 2013
- Face to Face Meeting at BNL, July 1, 2013
- Workshop on HPC and Super-computing for Future Science Applications, June 4-6, 2013
- Face to Face Meeting at BNL, April 24, 2013
- Next-generation Networks for Science Program PI Meeting, March 18-20, 2013
- Face to Face Meeting at BNL, January 28, 2013
- Face to Face Meeting at BNL, November 30, 2012
- Kick-off Meeting at BNL, September 24, 2012
DOE ASCR and DOE HEP funded the proposal "A next generation workload management and analysis system for big data", beginning in 2012, with lead PIs Alexei Klimentov (BNL) and Kaushik De (UTA).