feat(node): zfs monitor and grafana ui #559
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Contributor Author
| node-overview.json
|
Contributor Author
| node-zfs.json
. |
Contributor Author
| node-zfs.json unhealthy pool list fisrt |
Contributor Author
| node-alert.json
|
Contributor Author
| ZPoolDegraded jump from alert page with pool name
|
Contributor Author
| ZDatasetSpaceFull jump from alert page with pool name and dataset name
|
waitingsong force-pushed the zfs-monitor branch from 5e92d64 to 2be8d70 Compare 
waitingsong force-pushed the zfs-monitor branch 11 times, most recently from cef6110 to 9fb1852 Compare Contributor Author
| zfs_exporter aliveness panels
. |
## Installation Add parameters: - `zfs_exporter_enabled`: setup zfs_exporter on this node, false by default - `zfs_exporter_version`: current `3.8.1` - `zfs_exporter_port`: zfs exporter listen port, 9134 by default - `zfs_exporter_options`: see "/roles/node_monitor/defaults/main.yml" ## Prometheus Add [node_exporter] (forked from [pdf-node_exporter]) with more metrics: - `node:zfs:pool_metrics` - `node:zfs:dataset_metrics` Add alert rules: - `ZPoolDegraded` - `ZPoolFaulted` - `ZPoolOffline` - `ZPoolUnavail` - `ZPoolRemoved` - `ZPoolSuspended` - `ZPoolReadonly` - `ZPoolSpaceFull` - `ZDatasetSpaceFull` Update alert rule: - `NodeFsSpaceFull` with `fstype!="zfs"` ## Grafana Add panels: - [node-zfs.json] - list ZFS Pools and Datasets - unhealthy pool list fisrt - ability search with `Node ID`, `Pool`, `Dataset` - alert summary about zfs Update panels: - [node-overview.json](http://g.pigsty/d/node-overview/node-overview) - add `ZFS Pools` Row - unhealthy pool list fisrt - [node-alert.json](http://g.pigsty/d/node-alert/node-alert) - show zfs alerts - cell link to [node-overview.json] page with pool name and/or dataset name filter [node_exporter]: https://github.com/waitingsong/zfs_exporter [pdf-node_exporter]: https://github.com/pdf/zfs_exporter [node-overview.json]: http://g.pigsty/d/node-overview/node-overview [node-zfs.json]: http://g.pigsty/d/zfs-overview/node-zfs
Member
|
|
Vonng force-pushed the main branch 4 times, most recently from df9afaf to 47d9e6d Compare waitingsong force-pushed the zfs-monitor branch 5 times, most recently from d94bca3 to 04f70eb Compare waitingsong changed the title - node:ins:zfs_arc_utilization - node:ins:zfs_arc_memory_ratio - node:ins:zfs_arc_meta_usage - node:ins:zfs_arc_hit_ratio - node:ins:zfs_arc_hit_ratio_rate1m - node:ins:zfs_arc_hit_ratio_rate5m - node:ins:zfs_arc_usage_ratio - node:ins:zfs_arc_pressure_ratio
waitingsong force-pushed the zfs-monitor branch 2 times, most recently from 662b303 to 38deca0 Compare - ARC Pressure - ARC Memory Ratio - ARC Utilization - ARC Meta Usage - ARC Dnode Size - ARC Evict Skip - ARC Hit (rate1m) - ARC Hit Ratio (rate1m)
…e:ins:zfs_pool_metrics
waitingsong force-pushed the zfs-monitor branch from 38deca0 to c8d66b2 Compare - ARC Memory Summary - ARC Memory - ARC Memory Structure: data/meta/dnode/misc - ARC Hit Summary
Contributor Author
| node-instance.json
|
waitingsong changed the title …node:ins:zfs_dataset_metrics
…xtra thresholds fields
waitingsong force-pushed the zfs-monitor branch from 58f467a to 4f14793 Compare Contributor Author
| node-alert.json
|
…cs from lastNotNull to min
Vonng force-pushed the main branch 2 times, most recently from d351d04 to 9690822 Compare Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
feat(node): zfs monitor and grafana ui
Installation
Add parameters:
zfs_exporter_enabled: setup zfs_exporter on this node,falseby defaultzfs_exporter_version: current3.8.1zfs_exporter_port: zfs exporter listen port,9134by defaultzfs_exporter_options: see "/roles/node_monitor/defaults/main.yml"Prometheus
Add node_exporter (forked from pdf-node_exporter) with more metrics:
node:ins:zfs_pool_metricsnode:ins:zfs_dataset_metricsAdd alert rules:
ZPoolDegradedZPoolFaultedZPoolOfflineZPoolUnavailZPoolRemovedZPoolSuspendedZPoolReadonlyZPoolSpaceFullZDatasetSpaceFullUpdate alert rule:
NodeFsSpaceFullwithfstype!="zfs"Grafana
Add panels:
Node ID,Pool,DatasetUpdate panels:
ZFS PoolsRow