Where to install Lustre_exporter

[gbeyer3]

Hi, this is more a question than an issue. Where is the best place to install the exporter -- on the lustre server(s) or the lustre clients? If I put it only on the servers, will it also collect client traffic metrics? Thanks.

[gabrieleiannetti]

Hi,

yes, the exporter needs to be run on the servers.

Well, it collects metrics that are related to client produced "traffic", but it cannot identify the clients itself.
See Lustre Jobstats for more details about that: https://doc.lustre.org/lustre_manual.xhtml#jobstats

What we do is to identify the IO throughput which comes from the connection with the clients,
but are mapped to account, group, user and process based information in relation to SLURM jobs and processes: https://github.com/GSI-HPC/prometheus-cluster-exporter

You welcome!

Best
Gabriele

[gbeyer3]

Thanks for the response and info, Gabriele. I notice that you have forked the H-P lustre exporter to your own. Can you tell me what is different about yours vs. the H-P one listed by Prometheus (though not as an official exporter)?

best,
Greg

[gabrieleiannetti]

Hi Greg,

up to now we got mainly:

• partial support for Lustre 2.12, see: Update Remaining OST Metrics for Lustre 2.12 GSI-HPC/lustre_exporter#7
• a new metric for Lustre Changelogs
• support for newer golang version with less dependencies
• added build container
• improved parsing for Lustre Jobstats

You can get an overview by checking the closed issues of the project here.

For more detailed information check the commits after the last commit after the HP fork.

Best
Gabriele

[mjtrangoni]

Hi @gabrieleiannetti,

If you are interested, it would be very nice that you contact a Prometheus forum to add your fork to the https://github.com/prometheus-community repository.

I guess, you will need an approval from [email protected] too.

[gbeyer3]

I am not a dev, so please forgive if this suggestion does not make sense. But instead of a second Lustre_exporter, may I suggest merging @gabrieleiannetti enhancements to this Lustre_exporter? Thus making for one, stronger, exporter. Thx