Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ceph daemons should be self-configuring #18

Open
mrunge opened this issue Oct 19, 2020 · 3 comments
Open

ceph daemons should be self-configuring #18

mrunge opened this issue Oct 19, 2020 · 3 comments

Comments

@mrunge
Copy link
Member

mrunge commented Oct 19, 2020

Ceph daemons are deployed on every ceph node, but they also include global numbers (i.e. each number is unique over the cluster).

E.g

[root@ceph-0 run]# ls -l /var/run/ceph
total 0
srwxr-xr-x. 1 167 167 0 Oct 19 09:05 ceph-osd.0.asok
srwxr-xr-x. 1 167 167 0 Oct 19 09:05 ceph-osd.10.asok
srwxr-xr-x. 1 167 167 0 Oct 19 09:05 ceph-osd.13.asok
srwxr-xr-x. 1 167 167 0 Oct 19 09:05 ceph-osd.4.asok
srwxr-xr-x. 1 167 167 0 Oct 19 09:05 ceph-osd.7.asok

These sockets have to get provided for the ceph plugin https://github.com/collectd/collectd/blob/main/src/collectd.conf.pod#plugin-ceph

@elfiesmelfie
Copy link
Contributor

Would these not be passed in as config values? which is parsed in:

{% for daemon in collectd_plugin_ceph_daemon %}
<Daemon "{{ daemon.name|e }}">
SocketPath "{{ daemon.socketpath|e }} "
</Daemon>

For cluster configuration, this would be something that would be done when by whoever/whatever is consuming this collectd_config role (e.g. in tripleo-collectd-ansible-role )

@mrunge
Copy link
Member Author

mrunge commented Aug 26, 2021

These config values are currently fed by tripleo config. However, that would write the same config to all nodes, but e.g osds (numbered 1-15) are spread across 3 nodes, e.g node 1 gets osd 1, 3, 6, 7, and 13.
Collectd doesn't handle non-existing osds very well, and it would be great to just look into /var/lib/ceph/ to add the mgrs and osds from there to the collectd config.

@elfiesmelfie
Copy link
Contributor

WIP here: https://github.com/infrawatch/collectd-config-ansible-role/tree/issue/18

Needs some testing with tripleo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants