Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhanced manager reporting #262

Closed
dgasmith opened this issue May 20, 2019 · 1 comment
Closed

Enhanced manager reporting #262

dgasmith opened this issue May 20, 2019 · 1 comment
Assignees
@Lnaden
Labels
Compute Related to queue managers Enhancement Project enhancement discussion Feature Adds a new feature to the project

Comments

@dgasmith
Copy link
Contributor

Is your feature request related to a problem? Please describe.
Managers should log their current resource consumption and several metrics on their cumulative consumption. This will allow manager maintainers to obtain a quick overview of consumed resources and also investigate potential issues.

Describe the solution you'd like
Every several minutes in the qcfractal-manager logs print out the following:

  • Approximate number of nodes, cores, and memory that the manager is consuming. This data can be pulled from most distributed managers by querying the number of active workers.
  • Approximate total number of core-hours consumed since manager boot up. A good approximation is total number of current core * update interval. This does not have to be incredibly accurate, but more to give a general guideline.
  • The number of pulled, completed, batched returned tasks, and failed tasks periodically.

This information would also be very useful to push back to the server, but should be a future step.

Additional context
Related to #261.
@dgasmith dgasmith added Enhancement Project enhancement discussion Feature Adds a new feature to the project Compute Related to queue managers labels May 20, 2019
@dgasmith dgasmith mentioned this issue May 22, 2019
Open
Lnaden added a commit to Lnaden/QCFractal that referenced this issue Jul 3, 2019
@Lnaden
Manager Quality of Life statistics
998fb62 
Added quality of life stats to the Queue Manager reporting,
only really works in parsl for efficiency, but will track totals
as well.

Progress towards (and possible resolution) of MolSSI#262
@Lnaden Lnaden mentioned this issue Jul 3, 2019
Merged
2 tasks
Lnaden added a commit to Lnaden/QCFractal that referenced this issue Jul 9, 2019
@Lnaden
Manager Quality of Life statistics
c33eb9a 
Added quality of life stats to the Queue Manager reporting,
only really works in parsl for efficiency, but will track totals
as well.

Progress towards (and possible resolution) of MolSSI#262
@Lnaden
Copy link
Collaborator

Lnaden commented Jul 10, 2019

Should be fixed by #313

@Lnaden Lnaden closed this as completed Jul 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Lnaden Lnaden

Labels
Compute Related to queue managers Enhancement Project enhancement discussion Feature Adds a new feature to the project
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@dgasmith @Lnaden