Skip to content

Logical Schema Summary

The logical schema summary package allows to create a logical table for each schema that is an union of all the partition tables.

Configuration

  • Connection: connection where the schema belongs to.
  • Schema list: list (comma seprated) of schemas following the format database_name/schema_name.
  • Regex: regex of tables to match. Leave empty to match all tables belonging to the selected schema.

What it does

The package performs the following steps:

  • Fetch all tables beloging to the selected schema.
  • Apply the regex (if specified) to filter out tables.

  • Create a logical table for each schema with the following properties:

    • The name of the table is the concatenation of "Logical" with the schema name.
    • The columns of the table are the distinct sum of all columns of the tables belonging to the schema.
    • The lineage (both at table and column level) is the distinct sum of the lineage of the tables and the columns belonging to the schema.