Step 1. Catalog Operation
The Catalog Operation is run on a Datastore to import the named collections (e.g. tables, views, files, topics) of data available within it. The operation will also attempt to automatically identify the best way to support:
- Incremental scanning
- Data partitioning
- Record identification
Note
- The attributes of the named collection are recorded as special identifiers and can be manually overridden.
Operation Configuration
A Catalog Operation can be configured with the following options:
Prune- Remove any existing named collections that no longer appear in the datastoreRecreate- Restore any previously removed named collection that do currently appear in the database
Last update:
September 29, 2023