Skip to content

Informatica Icon IICS Miner

The IICS Miner package handles the replication based lineage for IICS job exports.

Pre-requisites

For iics-miner to run successfully, lineage-builder package must be deployed on the tenant.

Configuration

Credentials

  • Authentication: Select the AWS S3 authentication type.

    • AWS Access Key: your AWS access key.
    • AWS secret key: your AWS secret key.
    • S3 Bucket Name: your S3 bucket name.
    • Region: your S3 region
    • S3 Bucket Name: your S3 bucket name.
    • Region: your S3 region

Configuration

  • Source Connection Qualified Name: Enter the qualified_name of the atlan source connection.
  • Source Database Name: Enter the database name of the source tables. This database name must be present in the source connection qualified name.
  • Target Connection Qualified Name: Enter the qualified_name of the atlan target connection.
  • Transformation Process connection: Select the connection for the transformation assets.

What it does

Limitations

This package supports replication based lineage creation for only Table and Column assets as provided in the IICS job exports. Only the job exports which have both zip and xml extract will be processed.

The package processes IICS job export files placed on the input S3 bucket. It extracts table and column details from mtTask.json, connection.csv, and XML files provided in job exports based on specific business rules. The package then retrieves additional information from Atlan using FluentSearch to construct data lineage. It then generates a CSV file containing all necessary details for lineage construction. This CSV file is finally used as input to the lineage builder workflow, which then creates the data lineage in Atlan.