ADLS Data Store

Purpose

This configuration file sets up the ADLS (Azure Data Lake Storage) data stores. These data stores are critical for storing various datasets required for machine learning tasks, including raw data and processed data.

Dependencies

• infra_resource_group: Resource group for general infrastructure components.
• ml_resource_group: Resource group specific to machine learning resources.
• adls: Azure Data Lake Storage accounts hosting the data containers.
• workspace: The machine learning workspace where these data stores will be registered.
• role_assignment: Role assignments ensuring correct access controls for the data stores.

Inputs

• datastores: A list of data stores to be created, each specifying the reference name, storage container ID, workspace ID, and other metadata necessary for its creation.

Usage

To apply this configuration, run the following commands: ```sh terragrunt init terragrunt apply