Data catalog FAQ

Find answers to common questions about data catalog capacity, performance, upgrades, and deployment limits.

Browse common answers about data catalog capacity, performance, upgrades, and deployment limits.

What happens if .indexfs runs out of space?

Catalog ingestion can stall and then fail until you add space to the index filesystem.

After capacity is available again, ingestion resumes on the next catalog ingest cycle.

Check these events on the affected filesystem:

Event: CatalogIndexFsCapacityCritical
Event: CatalogIngestionFailed

What IO overhead does data catalog add?

Internal testing with typical workloads shows up to 10% overhead on client IO.

For environments with high IO load, run data catalog on dedicated servers instead of sharing servers with backend workloads.

What happens if you upgrade with catalog indexing enabled?

The upgrade is blocked. The cluster does not start the upgrade while catalog indexing is enabled or catalog tasks are still running.

Disable indexing before the upgrade. Re-enable it after the upgrade completes.

Example upgrade failure:

Upgrade starting with mode ndu
Running pre-upgrade verifications
Can't start upgrade because catalog indexing is enabled
verification catalog indexing is enabled or catalog tasks are running failed
Upgrade can't continue: verification catalog indexing is enabled or catalog tasks are running failed

Disable indexing:

weka catalog config update --index-enabled false
weka catalog config show

Before you start the upgrade, confirm the output shows:

Indexing enabled: false

Re-enable indexing after the upgrade:

weka catalog config update --index-enabled true
weka catalog config show

After the upgrade completes, confirm the output shows:

Indexing enabled: true

Can you deploy all data service containers on one server?

No. Deploy one data service container per server, and size the deployment based on the number of objects and expected growth rate.

Related topics

For deployment steps and sizing guidance, see Configure data catalog.

For UI workflows, see Analyze storage distribution.