Skip to content

Catalog operation

The Catalog Operation is run on a Datastore to import the named collections (e.g. tables, views, files, topics) of data available within it. The operation will also attempt to automatically identify the best way to support:

  • Incremental scanning
  • Data partitioning
  • Record identification

Note

  • The attributes of the named collection are recorded as special identifiers and can be manually overridden.

Operation Configuration

A Catalog Operation can be configured with the following options:

  • Prune - Remove any existing named collections that no longer appear in the datastore
  • Recreate - Restore any previously removed named collection that do currently appear in the database

Screenshot Screenshot

Last update: April 25, 2024