List of Events

This page lists all the events generated by the Weka system, according to category.

Alerts

Type

Severity

Description

AlertMuted

INFO

Alert muted

AlertUnmuted

INFO

Alert unmuted

Cloud

Type

Severity

Description

CloudDisabled

INFO

Cloud disabled

CloudEnabled

INFO

Cloud enabled

CloudProxyUpdated

INFO

Cloud proxy updated

CloudSetUploadRate

INFO

Cloud upload rate changed

CloudStatsErrorClearedEvent

WARNING

Cloud stats have now been written successfully

CloudStatsErrorEvent

WARNING

Error writing cloud stats for upload

DiagsUploaded

INFO

Diags uploaded

LowDiskSpaceClearedEvent

WARNING

Host no longer has low disk space

LowDiskSpaceEvent

WARNING

Host has low disk space

Clustering

Type

Severity

Description

AllBucketsResponsive

INFO

All compute resources are now responding

BucketRedist

INFO

Buckets were redistributed in the cluster

ClientConnected

INFO

Client connected

ClientDisconnected

INFO

Client disconnected

ClientNodesFencedDuringStopIO

INFO

Some clients disconnected during stop-io

ClientRemoved

INFO

Disconnected client is being removed from the cluster

ClientsUnavailable

CRITICAL

Some clients are unavailable because too many backends are down

ClockSkewedHostJoin

MINOR

Host cannot join because of clock skew

ClusterInitializationFailed

MAJOR

Cluster initialization failed

ClusterInitialized

INFO

Cluster successfully initialization

ClusteringFailure

MINOR

Node clustering failed

ConfigChangeSetsSliderFull

MINOR

Config changeset slider is full while the node is pulling config

ConfigGenerationHasNoFirstChunk

MINOR

Applying a partial config generation is prohibited

ConfigSnapshotPulled

MINOR

Config snapshot pulled

GrimReaperFencingNode

MINOR

Partially connected node selected to be fenced by grim reaper

HostActivated

INFO

Host configuration change

HostAdded

INFO

Host configuration change

HostAdding

INFO

Host configuration change

HostDeactivated

INFO

Host configuration change

HostDeactivating

INFO

Host configuration change

HostRemoved

INFO

Host configuration change

HostRemovingFailed

INFO

Host configuration change

HostRemoving

INFO

Host configuration change

LeaderChanged

WARNING

Cluster leader has changed

NodeNetworkUnstable

MAJOR

A node with unstable network detected

NodePartiallyConnected

MINOR

A partially connected node was removed

NodeRejoined

INFO

Node rejoined the cluster

NodeUnreachable

MINOR

An unreachable node was removed

PreviousCluster

INFO

This host was part of another cluster before

RejoinFailureReport

MINOR

Node(s) failed to rejoin

UnresponsiveBuckets

CRITICAL

Some compute resources are not responding

WrongConfigSignatureForRaftSnapshot

MINOR

Tried loading RAFT snapshot with unsupported config root snapshot signature

WrongSchemaVersionForRaftSnapshot

MINOR

Tried loading RAFT snapshot with unsupported schema version

Config

Type

Severity

Description

DirectoryQuotasDisabled

INFO

Directory Quotas were disabled

DirectoryQuotasEnabled

INFO

Directory Quotas were enabled

LoginBannerCleared

INFO

Login banner has been cleared

LoginBannerDisabled

INFO

Login banner disabled

LoginBannerEnabled

INFO

Login banner enabled

LoginBannerSet

INFO

Login banner has been set

S3ClusterCreated

INFO

S3 Cluster Created

S3ClusterDestroyed

INFO

S3 Cluster Destroyed

S3ClusterUpdated

INFO

S3 Cluster Updated

Custom

Type

Severity

Description

Custom

INFO

Custom event

Drive

Type

Severity

Description

CorruptedDrive

MAJOR

Drive has a valid header but is corrupt

DriveAdded

INFO

Drive provisioned

DriveDeactivated

INFO

Drive deactivated

DriveExcessiveErrors

WARNING

Drive has excessive error rate and will be phased out; call Contact Support Team

DriveFormatUpgraded

INFO

Drive format was upgraded

DriveImmediateShutdown

MAJOR

Drive had to be shutdown immediately; call Contact Support Team

DriveInfoReport

INFO

Drive Information reporting

DriveInitFailed

MAJOR

Drive failed to initialize

DriveIoErrorBMS

MAJOR

Drive found an IO error in background media scan

DriveIoError

MAJOR

Drive had an IO error

DriveLimitExceeded

WARNING

Attempted to add more drives than supported

DriveMediumError

MINOR

Drive had a Medium error

DriveNvmeErrorLog

WARNING

NVMe Drive Error Log Entry

DriveNvmeSmartChange

MINOR

NVMe Drive SMART status changed

DriveNvmeSmartInfo

INFO

NVMe Drive SMART status update - drive normal

DriveRemoved

INFO

Drive removed

DriveScanBlockLifted

MINOR

Drive blocked during scan is now responsive

DriveScanBlocked

MINOR

Drive blocked during scan and is unresponsive

DriveSignatureUnknown

MINOR

Drive has an unknown signature

DriveSmartCriticalWarning

MINOR

Drive SMART reports critical warning, failing it immediately

DriveStateChangesReport

MINOR

Drive state changes

DriveTrimAborted

WARNING

Drive TRIM commands at initialization timed out and aborted, potentially degrading write performance

DriveUnderIOMMU

MAJOR

Drive is under IOMMU but IOMMU is currently disabled, please contact support

DriveUnresponsive

MAJOR

Drive is unresponsive and failed to return IOs for an extended period of time; consider power cycling the host

DriveWrongFailureDomain

MINOR

Drive is attached to a host from an incorrect failure domain

NvmeBindTimingOut

MAJOR

NVMe device bind is stuck, server needs power cycle to recover

Events

Type

Severity

Description

DedupEventsDiscarded

WARNING

Deduplicated events discarded

EventsDedupReport

INFO

Event deduplication ended

EventsDiscarded

MINOR

Too many events were generated in a short period of time, so some of them were discarded and lost

ExampleAggregated

INFO

Example Aggregated

ExampleDebug

DEBUG

ExampleDebug

Example

INFO

Example

TracesDumperDownEvent

MAJOR

Traces Dumper is inactive

Filesystem

Type

Severity

Description

BlockReadFailure

CRITICAL

Failed to read a block

BlockSeekFinished

MAJOR

Block seek finished

BlockSeekStarted

MAJOR

Block seek started for a secondary metadata block that could not be read

BrokenFile

MAJOR

File metadata corruption

CWTaskTemplateFinished

INFO

CWTask template finished

ChecksumErrorInCommit

MAJOR

Checksum error detected by SSD node in a committing block

DefaultDirectoryQuotaSet

INFO

Default directory quota was set

DefaultDirectoryQuotaUnset

INFO

Default directory quota was unset

DirectoryQuotaSet

INFO

Directory quota was set

DirectoryQuotaUnset

INFO

Directory quota was unset

DumpSnapHashCompleted

INFO

Finished a snap hash manifest scan

FailedToSplitSliceNoRetry

CRITICAL

Failed to split a directory slice - wont retry

FilesystemAdded

INFO

Filesystem configuration change

FilesystemDeleted

INFO

Filesystem configuration change

FilesystemDownloadStarted

INFO

Filesystem download started

FilesystemGroupAdded

INFO

Filesystem group configuration change

FilesystemGroupDeleted

INFO

Filesystem group configuration change

FilesystemGroupUpdated

INFO

Filesystem group configuration change

FilesystemSquashFinished

INFO

Filesystem squash finished

FilesystemSquashStarted

INFO

Filesystem squash started

FilesystemUpdated

INFO

Filesystem configuration change

ForcedBucketStepdown

MINOR

Bucket forced to step down

FsCapacityLimitReached

WARNING

Filesystem capacity limit has been reached

HangingBackendIosDetected

CRITICAL

Some IOs are hanging

HangingBackendIosNoLongerDetected

INFO

IOs are no longer hanging

HangingBucketStepDown

WARNING

Bucket step-down is hanging

HangingDirectorySplit

MAJOR

Directory split hasn't any made progress for a long time

HangingDriverFrontendIosDetected

CRITICAL

Some IOs are hanging

HangingDriverFrontendIosNoLongerDetected

INFO

IOs are no longer hanging

HangingNFSFrontendIosDetected

CRITICAL

Some IOs are hanging

HangingNFSFrontendIosNoLongerDetected

INFO

IOs are no longer hanging

IntegrityCheckFinished

INFO

Integrity check finished

IntegrityCheckIssue

CRITICAL

Found an data integrity issue

IntegrityCheckStarted

INFO

Integrity check started

IntegrityCheckTransientIssue

WARNING

Found a possibly transitional data integrity issue - check if a critical issue is found afterwards

ManualOverrideStall

WARNING

Service has been manually-overridden and stalled

ObjectStoreAttachedToFilesystem

INFO

Object Store attached to filesystem

ObjectStoreFinishedDetachingdFromFilesystem

INFO

Object Store finished detaching from filesystem

ObjectStoreStartedDetachingdFromFilesystem

INFO

Object Store started detaching from filesystem

QuotaGraceExpired

WARNING

Directory soft capacity quota has been reached and grace period expired

QuotaHardLimitReached

WARNING

Directory hard capacity quota has been reached

RAIDDataBlockReadFailureInSnaphashDump

WARNING

Failed to read data block from RAID when dumping the snapshot manifest

RAIDMDReadFailureInSnaphashDump

WARNING

Failed to read metadata block from RAID when dumping the snapshot manifest

SnapshotContentCopied

INFO

Snapshot content copied

SnapshotCreated

INFO

Snapshot created

SnapshotDeleted

INFO

Snapshot deleted

SnapshotDownloadStarted

INFO

Snapshot download started

SnapshotFilesystemRestored

INFO

Filesystem restored from snapshot

SnapshotParamsUpdated

INFO

Snapshot updated

SnapshotUploadFinished

INFO

Snapshot upload finished

SnapshotUploadStarted

INFO

Snapshot upload started

SquelchBlockIdSetAbortedFlushed

DEBUG

While setting a squelch block's block id for upgrade was already changed to invalid

SquelchBlockIdSetAbortedRewritten

WARNING

While setting a squelch block's block id for upgrade was already rewritten to something else

SuperblockUnreadable

CRITICAL

Superblock of a bucket could not be loaded

UnflushedOpOnDeletingSnapview

MAJOR

Unflushed IO on a deleting snapshot

IO

Type

Severity

Description

SystemDriveIsTooSlow

MAJOR

System drive is slow to respond

InterfaceGroup

Type

Severity

Description

FloatingIpAcquired

INFO

Floating IP was acquired by Node

FloatingIpReleased

INFO

Floating IP was released by Node

InterfaceGroupAdded

INFO

Interface group configuration change

InterfaceGroupDeleted

INFO

Interface group configuration change

InterfaceGroupIpsAdded

INFO

Interface group IPs configuration change

InterfaceGroupIpsDeleted

INFO

Interface group IPs configuration change

InterfaceGroupPortAdded

INFO

Interface group port configuration change

InterfaceGroupPortDeleted

INFO

Interface group port configuration change

InterfaceGroupUpdated

INFO

Interface group configuration change

KMS

Type

Severity

Description

KmsConfigurationAdded

INFO

KMS configuration change

KmsConfigurationRemoved

INFO

KMS configuration change

KmsConfigurationUpdated

INFO

KMS configuration change

Licensing

Type

Severity

Description

LicensingReset

INFO

Licensing state has been reset

NewLicenseInstalled

INFO

New license installed

PaygLicensingEnabled

INFO

PAYG licensing enabled

ManualOverride

Type

Severity

Description

ManualOverrideChanged

INFO

Manual override changed

NFS

Type

Severity

Description

NfsClientGroupAdded

INFO

NFS client group configuration change

NfsClientGroupDeleted

INFO

NFS client group configuration change

NfsClientGroupRuleAdded

INFO

NFS client group rule configuration change

NfsClientGroupRuleDeleted

INFO

NFS client group rule configuration change

NfsCustomOptionsUpdated

INFO

NFS custom options configuration change

NfsExportsPermissionsAdded

INFO

NFS export permissions for configuration change

NfsExportsPermissionsDeleted

INFO

NFS export permissions for configuration change

NfsExportsPermissionsUpdated

INFO

NFS export permissions for configuration change

NfsMountFail

WARNING

NFS mount request failed

NfsPortmapFail

MAJOR

NFS server failed to register in portmap

Network

Type

Severity

Description

ClientNodeDisconnected

INFO

Client Node disconnected from cluster

DefaultDataNetworkingChange

INFO

Default data networking configuration changed

DpdkPoolSummary

DEBUG

Summary of DPDK pool status

HangingRPCs

MAJOR

RPCs are hanging too long

HugepagesAllocationFailure

MINOR

Hugepages allocation failure

IONodeCannotFetchConfig

WARNING

Node cannot join cluster for too long

MgmtNodeCannotFetchConfig

WARNING

Node cannot join cluster for too long

NICNotFound

INFO

NIC not found when initializing

NetDeviceLinkDown

MINOR

Network interface DOWN

NetDeviceLinkUp

MINOR

Network interface UP

NetSlaveDeviceLinkDown

MINOR

Network slave interface DOWN

NetSlaveDeviceLinkUp

MINOR

Network slave interface UP

NetworkPortConfigFail

MINOR

Network port configuration failed

NetworkPortDead

MAJOR

Network Port hasn't passed packets for a long period of time, it is likely dead

NoConnectivityToLivingNode

MAJOR

Node is disconnected from living peer(s)

NoHardwareWatchdog

MAJOR

No hardware watchdog found

NoJumboFrames

MINOR

Network does not allow large-enough messages through

NodeCannotJoinCluster

WARNING

Node cannot join cluster for too long

NodeCannotSendJumboFrames

MINOR

Node cannot send jumbo packets

NodeDisconnected

MINOR

Node disconnected from cluster

RDMAClientDisabled

MINOR

RDMA optimization disabled

RDMAClientEnabled

MINOR

RDMA optimization enabled

Node

Type

Severity

Description

AssertionFailed

MAJOR

Assertion failed

GCCrashReport

MINOR

Node has crashed in GC on the previous run

NodeAbruptExitReport

MINOR

Node has crashed on the previous run

NodeExceptionExit

MAJOR

Node exited with an exception

NodeKernelStack

WARNING

Kernel stack of node before reset

NodeStarted

INFO

Node started

NodeStopped

INFO

Node stopped

NodeTraceback

WARNING

Traceback of node before reset

ObjectStorage

Type

Severity

Description

ChecksumErrorInDownloadedObject

MINOR

Checksum error detected by COMPUTE node in a downloaded OBS data block

ChecksumErrorOnObjectUpload

MAJOR

Checksum error detected by COMPUTE node when uploading an OBS data block (corrupted after verifying data read from the drive)

DataBlobDownloadFailed

WARNING

Failed downloading data blob header

DownloadedExtentMissingExpectedBlock

MAJOR

Downloaded extent missing expected block

InvalidDataBlobHeader

MAJOR

Invalid header detected by COMPUTE node in a downloaded OBS data blob

LegacyV34DataEncountered

WARNING

Legacy V3.4 data encountered in Object Storage. This data will no longer be supported in a future version. Please migrate the filesystem to a fresh Object Store bucket

ObjectStoreBucketAdded

INFO

Object store bucket configuration change

ObjectStoreBucketDeleted

INFO

Object store bucket configuration change

ObjectStoreBucketUpdated

INFO

Object store bucket configuration change

ObjectStoreGroupAdded

INFO

Object store configuration change

ObjectStoreGroupDeleted

INFO

Object store configuration change

ObjectStoreGroupUpdated

INFO

Object store configuration change

ObjectStoreHasHighLevelOfUnreclaimedCapacity

WARNING

Object store has high level of unreclaimed capacity

ObjectStoreIsFull

CRITICAL

Object store is full

ObjectStoreNoLongerHasHighLevelOfUnreclaimedCapacity

INFO

Object store has high level of unreclaimed capacity

ObjectStoreStatusDown

MAJOR

Object Store status is now down

ObjectStoreStatusUp

INFO

Object Store status is now up

ObsIsMissingObject

MAJOR

Permanently failed to download an object from object storage - The object was not found

PersistentChecksumErrorInDownloadedObject

MAJOR

Checksum error detected by COMPUTE node in a downloaded OBS data block

TieredFilesystemBreakingPolicy

MINOR

Breaking policy; too much disk pressure

Org

Type

Severity

Description

OrgCreated

INFO

Org Created

OrgDeleted

INFO

Org Deleted

OrgRenamed

INFO

Org Renamed

OrgSsdQuotaChanged

INFO

Org SSD Quota Changed

OrgTotalQuotaChanged

INFO

Org Total Quota Changed

RAID

Type

Severity

Description

BitmapChecksumMismatch

MINOR

Bitmap checksum mismatch detected

DataGenerationNumberBug

WARNING

Bug in the advancement of the applied data generation number report from a bucket

DataProtectionLevelDecreased

MINOR

Data protection level decreased

DataProtectionLevelIncreased

INFO

Data protection level increased

DisksFailureDetected

MINOR

Disk(s) failures detected

DisksRecoveryDetected

INFO

Disk(s) quick recovery detected

EnoughActiveFailureDomains

MINOR

Enough active failure domains

FixedFalseFreeBlock

CRITICAL

Found and fixed a false free block

HotSpareFailureDomainsUpdated

INFO

Hot spare failure domains updated

NoDataProtection

CRITICAL

No data protection

QuorumGenerationNumberBug

WARNING

Bug in the advancement of the applied quorum generation number report from a bucket

RaidScrubbingRateUpdated

INFO

RAID scrubber limit updated

RaidsStarted

INFO

RAIDs started

SwitchPlacementHanging

MINOR

SwitchPlacement has no non-dirty chunks

SwitchPlacementRetrying

MINOR

SwitchPlacement retrying

TooFewActiveFailureDomains

MAJOR

Too few active failure domains

TooManyFailures

CRITICAL

Too many failures, some data is unavailable

UsedSSDCapacityCriticalOverflow

CRITICAL

SSD capacity use is critically overflowing, internal spares are running out. Cluster may soon become unavailable for writes.

UsedSSDCapacityNoLongerOverflows

INFO

SSD capacity use is no longer overflowing

UsedSSDCapacityOverflow

MAJOR

SSD capacity use is overflowing, internal capacity spares are being utilized

Resources

Type

Severity

Description

APIServerStartFailed

WARNING

Failed to start the API server

APIServerStarted

INFO

Successfully started the API server

BandwidthSelected

INFO

Bandwidth set for host

CoreAllocated

INFO

Allocated core

DisabledNumaBalancing

INFO

Disabled NUMA Balancing

DriverLoaded

INFO

Driver attached

FailedToLoadDriver

WARNING

Failed to load the wekafs driver

HugepagesAllocated

INFO

Hugepages allocated

HugepagesAllocationRetries

WARNING

Hugepages allocation retried

HugepagesAllocationStarted

INFO

Hugepages allocation started

InactiveHostCannotJoinCluster

INFO

Inactive host cannot join the cluster

LoadingStableResourcesFailed

INFO

Failed loading stable resources

NetworkDeviceAllocated

INFO

Allocated network device

NetworkDeviceNotUsedByAnySlots

MINOR

Network device not used by any slots

NoIPsConfiguredForHostJoinWithNoDefaultNet

WARNING

No IP configured for node {nid} with no default-net

RevertToStableResources

INFO

Reverted to stable resources

UnlimitedBandwidthSelected

INFO

Bandwidth set to unlimited

S3

Type

Severity

Description

S3AddBucketILMRuleEvent

INFO

S3 Add Bucket ILM Rule

S3AsssumeRoleEvent

INFO

S3 Assume Role STS Token Created

S3AttachIAMPolicyEvent

INFO

S3 Attach IAM policy

S3AuditWebhookDisabledEvent

INFO

S3 Audit Webhook Disabled

S3AuditWebhookEnabledEvent

INFO

S3 Audit Webhook Enabled

S3BucketDestroyedEvent

INFO

S3 Bucket Destroyed

S3ClusterDestroyFailed

MAJOR

Failed to destroy S3 cluster

S3ContainerStateChangesEvent

INFO

S3 Container Status Change

S3CreateBucketEvent

INFO

S3 Bucket Created

S3CreateIAMPolicyEvent

INFO

S3 Create IAM Policy

S3DestroyBucketEvent

INFO

S3 Bucket Destroyed

S3DetachIAMPolicyEvent

INFO

S3 Detach IAM policy

S3DrainEvent

INFO

S3 Container Drain

S3ETCDDisabledEvent

INFO

S3 Cluster etcd Disabled

S3ETCDEnabledEvent

INFO

S3 Cluster etcd Enabled

S3KVAddedEvent

INFO

S3 Config Add Key

S3KVRemovedEvent

INFO

S3 Config Remove Key

S3KVResetEvent

INFO

S3 KV Store Config Reset

S3RemoveBucketILMRuleEvent

INFO

S3 Remove Bucket ILM Rule

S3RemoveIAMPolicyEvent

INFO

S3 Remove IAM Policy

S3ResetBucketILMRuleEvent

INFO

S3 Reset Bucket ILM Rules

S3SetBucketPolicyEvent

INFO

S3 Set Bucket Policy

S3UnDrainEvent

INFO

S3 Container Undrain

Security

Type

Severity

Description

CaCertSet

INFO

CA cert was added to the cluster

CaCertUnset

INFO

CA cert was unset

TLSSet

INFO

TLS was set

TLSUnset

INFO

TLS was unset

SMB

Type

Severity

Description

SmbAdJoined

INFO

Active Directory configuration change

SmbAdLeft

INFO

Active Directory configuration change

SmbClusterConfigured

INFO

SMB cluster configuration change

SmbClusterCreated

INFO

SMB cluster configuration change

SmbClusterDestroyed

INFO

SMB cluster configuration change

SmbConfigGenerationUpdated

INFO

SMB Config configuration change

SmbShareAdded

INFO

Share configuration change

SmbShareConfigured

INFO

Share configuration change

SmbShareHostnameACERemovedRemoved

INFO

SambaHostnameACE configuration change

SmbShareHostnameACEResetDestroyed

INFO

SambaHostnameACE configuration change

SmbShareRemoved

INFO

Share configuration change

SmbTrustedDomainAdded

INFO

TrustedDomain configuration change

SmbTrustedDomainRemoved

INFO

TrustedDomain configuration change

Statistics

Type

Severity

Description

StatLimitExceeded

WARNING

A set limit on a stat was exceeded

System

Type

Severity

Description

BlockTaskAborted

INFO

A bucket task aborted successfully

BlockTaskComplete

INFO

A bucket task completed successfully

BucketsCreated

INFO

System has created buckets

ClusterTaskAborted

INFO

Cluster task aborted

ClusterTaskPaused

INFO

Cluster task paused

ClusterTaskResumed

INFO

Cluster task resumed

ClusterwideTaskChanged

INFO

Clusterwide task changed

HaveEnoughSSDCapacity

MINOR

Enough SSD capacity now exists for all provisioned file systems

IOStarted

INFO

System has started

IOStopped

INFO

System has stopped

NotEnoughSSDCapacity

CRITICAL

Not enough SSD capacity exists for all provisioned file systems

StartIORequested

INFO

The user has requested that IO be started

StopIORequested

INFO

The user has requested that IO be stopped

SystemInfoReport

INFO

Management node started; reporting OS info

Traces

Type

Severity

Description

TracesConfigurationActivated

INFO

Traces configuration change

TracesConfigurationDeactivated

INFO

Traces configuration change

TracesConfigurationReset

INFO

Traces configuration change

TracesConfigurationUpdated

INFO

Traces configuration change

TracesFreezePeriodReset

INFO

Traces freeze period has been reset

TracesFreezePeriodSet

INFO

Traces freeze period has been set

Upgrade

Type

Severity

Description

ClientUpgradeRequested

INFO

Client upgrade requested

ExternalUpgradeCancelled

INFO

External Upgrade was cancelled

ExternalUpgradeFinished

INFO

External Upgrade complete

ExternalUpgradeStarting

INFO

External Upgrade was started

FinishedExternalHostUpgrade

INFO

External host upgrade complete

StartingExternalHostUpgrade

INFO

External host upgrade started

User

Type

Severity

Description

LDAPAuthDisabled

INFO

LDAP authentication disabled

LDAPAuthEnabled

INFO

LDAP authentication enabled

LDAPConfigUpdated

INFO

LDAP configuration updated

UserCreated

INFO

User Created

UserDeleted

INFO

User Deleted

UserLoggedIn

INFO

User logged in

UserLoginFailed

INFO

User login failed

UserLoginLocked

MINOR

User login locked

UserPasswordChangedByAnotherUser

INFO

User password changed by an admin

UserPasswordChanged

INFO

User changed password

UserRoleChanged

INFO

User role changed

Last updated