Skip to content

Dataverse Icon Microsoft Dataverse Crawler

The Microsoft Dataverse Crawler fetches assets from MS Dataverse and publish them to Atlan for discovery. The assets crawled are:

  • Entities
  • Attributes

Configuration

Credentials

  • Client ID: unique application (client) ID assigned to your app.For example: 123456ab-987z-12a1-1234-ab12345a1234
  • Client Secret: client secret.For example: Abc1Z~abCD._a1CD2EF~A1-AbcDEfgHIj1kLmnop
  • Tenant ID: unique identifier of the Dataverse instance.For example: 123abc1a-1ab2-1234-1234-123456a12ab1
  • Dataverse URI: the full Dynamics365 DNS.For example: bag-mpd365-crm-sandbox.crm.dynamics.com

Configurations

  • Connection: name of the connection that will be created in Atlan.
  • Connection Admins: controls connection admin permissions. All_admins are added by default.
  • Include entities by regex: Text filter to ingest only the entities matching the given pattern.
  • Exclude entities by regex: Text filter to exclude all the entities matching the given pattern.

Warning

The connection name must be unique across all Dataverse connections.

What it does

The package performs the following steps:

  • Create a connection in Atlan. If the connection already exists, it fetches the details of that connection.
  • Fetch the list of entities from the source Dataverse instance.
  • For each entity fetch the list of attributes.
  • Publish entities and attributes into Atlan.
  • Fetch the list of inter-asset relationships from the source Dataverse instance.
  • Publish the lineage relationships across Dataverse Entities and associated Attributes into Atlan.

Warning

Entities and Attributes deleted/archived in Dataverse are automatically archived in Atlan as well.