Skip to content
This repository has been archived by the owner on Sep 12, 2024. It is now read-only.

Standalone scripts

Hasan Öztürk edited this page Jan 15, 2021 · 5 revisions

This page is created with the intention to document all the standalone scripts in this repository. If we are not able to understand and thus document a script, we should delete it, since there is nobody who can use it.

wfsWithMissingUnmergedData.py

Script used for querying all the active workflows in wmstats and matching their output LFNBases against a list of unmerged files (that were lost somewhere). It will print out the request name, its status and the LFN base path to the files missing. Note: you need to setup your grid proxy (X509_USER_PROXY) before running it

setCascadeStatus.py

Script to set the WM status of a set of workflows. (I did not try to run it, but if it's running, then it might be useful)

resubmit.py

...

remove_campaign.py

Seems like it removes a given campaign from mongodb. I did not try it, but it might be useful.

rejectWorkflows.py

Reject a given list of workflows. This can be used when input workflows are in status: assigened or assignment-approved input arg: Text file with list of workflows.

I did not try it so far, but if it is running, could be handy sometime.

rejectAndClone.py

Reject a given list of workflows and then clone them. also INVALIDATES original dataset, since the clone will have increased version number This can be used when input workflows are in status: assigened or assignment-approved Please use abortAndClone for workflows in status acquired or running open/closed The cloned requests have a newly generated RequestName, new timestamp, however -everything- else is copied from the original request. input arg: Text file with list of workflows.

I did not try it so far, but if it is running, could be handy sometime.

recoverMissingLumis.py & recovery.py

python recovery.py --assign "--site original --xrootd --lumisperjob 1" --w pdmvserv_Run2016G_BTagCSV_UL2016_MiniAODv1_NanoAODv2_201215_091431_5998 --go

makeACDC.py

...

getDatasetStatus.py

...

forceCompleteWorkflows.py

...

findOrphanACDCs.py

Filters through the list of ACDC's that are in "completed" which ones have it's original workflow in a status beyond (archived, closed-out, rejected, etc)

createSitesBackfill.py

To be reviewed

closeOutWorkflowsManual.py

Close out a given list of workflows. It will search for any Resubmission requests for which the given request is a parent and announce them too. input arg: Text file with list of workflows. [Hasan]: I haven't run it, but, it could be helpful if it is running.

cleanBackfills.py & cleanBackfills.sh

[Hasan]: I haven't run it, but, it could be helpful if it is running.

checkmem.sh

[Hasan]: I haven't run it, but, it could be helpful if it is running. Looks like it gives a snapshot of the memory usage in unified machines

changeSplittingWorkflow.py

This script allows to change the splitting of a request, on a given task name

.. automodule:: WmAgentScripts.changeSplittingWorkflow

.. program-output:: python ../WmAgentScripts/changeSplittingWorkflow.py -h

Note

The TASKPATH should be the full task path in which you want to change the splitting, i.e. StepOneProc, StepOne /StepOneProcMerge, Production, etc.
The TYPE is the algorithm for splitting.

[Hasan]: I haven't run it, but, it could be helpful if it is running.

changePriorityWorkflow.py

Changes priority of a workflow or a list of workflows

[Hasan]: I haven't run it, but, it could be helpful if it is running.

campaignsConfiguration.py

To be documented

campaignAPI.py

To be documented

assign.py

To be documented

announceWorkflows.py

Announce a given list of workflows. It will search for any Resubmission requests for which the given request is a parent and announce them too. input arg: Text file with list of workflows.

[Hasan]: I haven't run it, but, it could be helpful if it is running.

acdc.py

In case the ACDC console is down, this could be handy

abortWorkflows.py & abortAndClone.py

Abort a given list of workflows This can be used when input workflows are in status: acquired or running open/closed input arg: Text file with list of workflows.

[Hasan]: I haven't run it, but, it could be helpful if it is running.

Clone this wiki locally