Statistics
This page describes the statistics available in the Weka system and how to work with them.
Last updated
This page describes the statistics available in the Weka system and how to work with them.
Last updated
As the Weka system runs, it collects hundreds of statistics on system performance. These statistics help in analyzing the Weka system performance and determining the source of any problems.
Five different categories of statistics are available for review - Operations (NFS), Operations (Driver), Object Store, SSD and CPU – and when each category is selected, a list of the possible statistics that can be selected is displayed.
By default, the main statistics page displays the last hour of operation, presenting the Weka system operation per second on a time axis.
This Statistics view screen offers a number of options to drill-down into the statistics, according to category. Options include:
Mousing over the scrollable graph area to view various performance metrics of the Weka cluster.
Troubleshooting or obtaining a correlation between events and performance (using the top line which provides links to events that occurred).
Adding more statistics to the view (using the Statistics menu).
Displaying different statistics simultaneously and toggling between them. By default, the graph area shows Ops/sec for the last hour. Using the "Hour, Day, Week" buttons
at the bottom-right enables changing of the time interval.
Displaying, hiding. deleting, and zooming-in on statistics from defined timelines and dates.
Bookmarking specific statistics for future reference and sharing with others (using the URL).
Note: The statistics are only shown for backend/clients that are part of the cluster. Once a host is removed (or a client is not connected to the cluster for more than the remove_after_secs period) its statistics will not be shown. The Weka cluster does not hold historical statistics data. Use weka-mon for that, as suggested in the External Monitoring section.
To view the statistics screen using the GUI, click the statistics button on the left bar:
To select the addition of specific statistics, click the + Add Statistics tab on the right-hand side of the Statistics view screen. The statistics menu will be displayed.
Then select the component for which statistics required from the six possible categories. As each component is selected, the list of possible Statistics Names that can be selected changes. It is also possible to searching for a specific statistic by typing the name of the statistic in the Filter field at the top of the menu.
Up to 5 different statistics can be displayed simultaneously. Selecting a metric adds its graph to the Statistics view, together with a selector containing the category and name of the statistics which are displayed according to the appropriate units.
Switching the active unit scale is performed by clicking on one of the inactive units displayed in the left bottom corner of the graph display box.
To hide or delete statistics from a graph, mouse-over the selector and click either the Hide or Delete button appearing under the selector.
To define a specific period of time (start and end) for the statistics to be displayed, click the From and To selectors appearing in the left corner of the graph display box. Then select the date of the statistics required from the calendar popup and the hours from the right scroller, or by using the up and down arrows that appear when hovering on the time selectors.
Note: It is also possible to change the time period by dragging the graph left or right.
The Auto Refresh setting offers another option for defining a specific period of time. Activation of Auto Refresh is performed by clicking on one of the buttons displayed in the right bottom corner of the graph display box, according to the desired period (hour, day or week). The selected period of time for the statistics will be automatically updated every minute, until Auto Refresh is deactivated by clicking the 'x' button located at the top right of the Auto Refresh tool tip, or by defining a period of time using the time selector.
To obtain a summary of events that occurred in a specific time period, click the events bubble displayed above the graph. The Events popup will be displayed. Expand the popup in order to obtain a detailed list of events. Click on the icon next to each event to link to the selected event in the Events view screen.
Command: weka stats list-types
Use the following command line to obtain statistics definition information:
weka stats list-types [<name-or-category>] [--show-internal]
Parameters in Command Lines
Name | Type | Value | Limitations | Mandatory | Default |
| String | Name or category fo filter by | Valid name or category | No | |
| Boolean | Also displays internal statistics | No | False |
Command: weka stats realtime
Use the following command line to obtain the current performance-related statistics of the hosts, in a one-second interval:
weka stats realtime [<node-ids>] [--raw-units] [--UTC]
Parameters in Command Lines
Name | Type | Value | Limitations | Mandatory | Default |
| Comma-separated strings | Only show realtime stats of these nodes | No | ||
| Boolean | Print values in raw units (bytes, seconds, etc.) | No | Human-readable format, e.g 1KiB 234MiB 2GiB | |
| Boolean | Print times in UTC | No | Host's local time |
Command: weka stats
The collected statistics are helpful to analyze system performance and determine the source of any problems as the Weka system runs, according to several categories. When each category is selected, a list of the possible statistics that can be selected is displayed.
Note: All statistics are averaged over one-second intervals. Consequently, "total" or other aggregates relate to a specific minute.
Use the following command line to manage filters and read statistics:
weka stats [--start-time <start-time>] [--end-time <end-time>] [--interval interval] [--resolution-secs resolution-secs] [--category category][--stat stat] [--node-ids node-ids] [--param param] [--accumulated] [--per-node] [--no-zeros] [--show-internal] [--raw-units] [--UTC]
Parameters in Command Lines
Name | Type | Value | Limitations | Mandatory | Default |
| String | Start time of the reported period | Format: 5m, -5m, -1d, -1w, 1:00, 01:00, 18:30, 18:30:07, 2018-12-31 10:00, 2018/12/31 10:00, 2018-12-31T10:00, 9:15Z, 10:00+2:00 | No | -1m |
| String | End time of the reported period | Format: 5m, -5m, -1d, -1w, 1:00, 01:00, 18:30, 18:30:07, 2018-12-31 10:00, 2018/12/31 10:00, 2018-12-31T10:00, 9:15Z, 10:00+2:00 | No | Current time |
| String | Period of time to be reported | Valid interval in seconds (positive integer number) | Yes | |
| String | Length of each interval in the reported period | Must be multiples of 60 seconds | No | 60 |
| String | Specific categories for retrieval of appropriate statistics | Valid existing categories: CPU, Object Store, Operations, Operations (NFS), Operations (Driver), SSD | No | All |
| String | Statistics names | Valid statistics names | No | All |
| String | Node id | Valid node-id | No | All |
| String | For parameterized statistics, retrieve only the instantiations where the specified parameter is of the specified value. Multiple values can be supplied for the same key, e.g. '--param method:putBlocks --param method:initBlock' | Format: | No | |
| Boolean | Display accumulated statistics, not rate statistics | No | False | |
| Boolean | Does not aggregate statistics across nodes | No | False | |
| Boolean | Filters results where the value is 0 | No | False | |
| Boolean | Also displays internal statistics | No | False | |
| Boolean | Print values in raw units (bytes, seconds, etc.) | No | Human-readable format, e.g 1KiB 234MiB 2GiB | |
| Boolean | Print times in UTC | No | Host's local time |
Command: weka stats retention set
Use the following command line to set the statistics retention period
weka stats retention set <--days days> [--dry-run]
Parameters in Command Lines
Name | Type | Value | Limitations | Mandatory | Default |
| Number | The Number of days to keep the statistics | Should have enough free disk space per server | Yes | |
| Boolean | Only test the required capacity per the retention period | No |
Use weka stats retention status to view the current retention and weka stats retention restore-default to restore the default retention settings.
