This repository has been archived by the owner on May 21, 2024. It is now read-only.
Releases: whamcloud/lustre-collector
Releases · whamcloud/lustre-collector
v0.6.0
What's Changed
- Bump to 2018 edition by @jgrund in #11
- Bump deps by @jgrund in #13
- Add basic collection for lnetctl export stats by @jgrund in #10
- Add initial support for MDT parsing by @jgrund in #14
- Add support for collecting
threads_startedon the MGS. by @jgrund in #15 - Add library interface by @jgrund in #16
- Add Deserialize trait to types by @jgrund in #17
- LNet net may not exist by @jgrund in #18
- Handle empty mdstats by @jgrund in #19
- Add Deref implementations by @jgrund in #20
- Use easy_parse by @jgrund in #21
- Remove untagged annotation. by @jgrund in #22
- Implement Display for TargetVariant by @johnsonw in #23
- Add parsers for node stats by @jgrund in #24
- Unify Node returns by @jgrund in #25
- Fix lnet drop stat by @jgrund in #26
- Implement connected client count by @jgrund in #27
- Do not parse
lnetctl exportif stdout is empty. by @jgrund in #28 - EX-1552 - Implement parser to get MGS filesystems by @johnsonw in #29
- Bump Lustre Collector to 0.2.14 by @jgrund in #30
- Don't blow up if the mgs_fs errors. by @johnsonw in #31
- Cast lnet_memused overflow to 0 by @jgrund in #32
- Add mdt job_stats parsing by @RDruon in #33
- Bump lustre_collector to 0.2.17 by @jgrund in #34
- Implement recovery_status for mdt and ost by @jgrund in #36
- Remove lnet tcp bonding stat by @jgrund in #37
- Fix a number of clippy issues by @jgrund in #38
- Remove parsing global and peers section from lnet by @jgrund in #39
- Bump deps by @jgrund in #42
- Add osd parser by @jgrund in #43
- Add parsing of
lnetctl stats showby @RDruon in #44 - A few small updates by @jgrund in #45
New Contributors
Full Changelog: v0.1.0preview2...v0.6.0
Contributors
jgrund, johnsonw, and RDruon
Assets 3
0.1.0 Preview2
This is preview2 of lustre-collector.
This is a work in progress that currently collects some stats regarding OSTs and MGTs in either JSON or YAML format.
How to use
-
Upload this binary to a Lustre storage server (only OSS or MGS for this release).
-
Run:
# Will return stats in JSON format
lustre_collector
# Will return stats in YAML format
lustre_collector --format=yaml
Preview 2 adds support for jobstats on OSTs
0.1.0 Preview1
This is preview1 of lustre-collector.
This is a work in progress that currently collects some stats regarding OSTs and MGTs in either JSON or YAML format.
How to use
-
Upload this binary to a Lustre storage server (only OSS or MGS for this release).
-
Run:
# Will return stats in JSON format
lustre_collector
# Will return stats in YAML format
lustre_collector --format=yaml
Output is currently like the following for an OST (in prettified JSON):
Click To Expand
[
{
"param": "memused",
"value": 304177197
},
{
"param": "memused_max",
"value": 304586339
},
{
"param": "lnet_memused",
"value": 1123782744
},
{
"param": "health_check",
"value": "healthy"
},
{
"kind": "OST",
"param": "stats",
"target": "cache0-OST0004",
"value": [
{
"name": "create",
"units": "reqs",
"samples": 2,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 113254,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "process_config",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "reconnect",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 262339,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "ping",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
}
]
},
{
"kind": "OST",
"param": "stats",
"target": "cache0-OST0005",
"value": [
{
"name": "create",
"units": "reqs",
"samples": 2,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 113254,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "process_config",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "reconnect",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 262339,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "ping",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
}
]
},
{
"kind": "OST",
"param": "stats",
"target": "cache0-OST0006",
"value": [
{
"name": "create",
"units": "reqs",
"samples": 2,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 113254,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "process_config",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "reconnect",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 262339,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "ping",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
}
]
},
{
"kind": "OST",
"param": "stats",
"target": "cache0-OST0007",
"value": [
{
"name": "create",
"units": "reqs",
"samples": 2,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 113254,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "process_config",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "reconnect",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "statfs",
"units": "reqs",
"samples": 262339,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
},
{
"name": "ping",
"units": "reqs",
"samples": 1,
"min": null,
"max": null,
"sum": null,
"sumsquare": null
}
]
},
{
"kind": "OST",
"param": "brw_stats",
"target": "cache0-OST0004",
"value": [
{
"name": "pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_blocks",
"unit": "rpcs",
"buckets": []
},
{
"name": "dio_frags",
"unit": "ios",
"buckets": []
},
{
"name": "rpc_hist",
"unit": "ios",
"buckets": []
},
{
"name": "io_time",
"unit": "ios",
"buckets": []
},
{
"name": "disk_iosize",
"unit": "ios",
"buckets": []
}
]
},
{
"kind": "OST",
"param": "brw_stats",
"target": "cache0-OST0005",
"value": [
{
"name": "pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_blocks",
"unit": "rpcs",
"buckets": []
},
{
"name": "dio_frags",
"unit": "ios",
"buckets": []
},
{
"name": "rpc_hist",
"unit": "ios",
"buckets": []
},
{
"name": "io_time",
"unit": "ios",
"buckets": []
},
{
"name": "disk_iosize",
"unit": "ios",
"buckets": []
}
]
},
{
"kind": "OST",
"param": "brw_stats",
"target": "cache0-OST0006",
"value": [
{
"name": "pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_blocks",
"unit": "rpcs",
"buckets": []
},
{
"name": "dio_frags",
"unit": "ios",
"buckets": []
},
{
"name": "rpc_hist",
"unit": "ios",
"buckets": []
},
{
"name": "io_time",
"unit": "ios",
"buckets": []
},
{
"name": "disk_iosize",
"unit": "ios",
"buckets": []
}
]
},
{
"kind": "OST",
"param": "brw_stats",
"target": "cache0-OST0007",
"value": [
{
"name": "pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_pages",
"unit": "rpcs",
"buckets": []
},
{
"name": "discont_blocks",
"unit": "rpcs",
"buckets": []
},
{
"name": "dio_frags",
"unit": "ios",
"buckets": []
},
{
"name": "rpc_hist",
"unit": "ios",
"buckets": []
},
{
"name": "io_time",
"unit": "ios",
"buckets": []
},
{
"name": "disk_iosize",
"unit": "ios",
"buckets": []
}
]
},
{
"kind": "OST",
"param": "filesfree",
"target": "cache0-OST0004",
"value": 5766901
},
{
"kind": "OST",
"param": "filesfree",
"target": "cache0-OST0005",
"value": 5766869
},
{
"kind": "OST",
"param": "filesfree",
"target": "cache0-OST0006",
"value": 5766901
},
{
"kind": "OST",
"param": "filesfree",
"target": "cache0-OST0007",
"value": 5766869
},
{
"kind": "OST",
"param": "filestotal",
"target": "cache0-OST0004",
"value": 5767168
},
{
"kind": "OST",
"param": "filestotal",
"target": "cache0-OST0005",
"value": 5767168
},
{
"kind": "OST",
"param": "filestotal",
"target": "cache0-OST0006",
"value": 5767168
},
{
"kind": "OST",
"param": "filestotal",
"target": "cache0-OST0007",
"value": 57...