Machine Learning Infrastructure Terraform Configuration

This repository contains the Terraform configurations managed by Terragrunt for setting up a machine learning infrastructure on Azure. The configurations leverage multiple Azure resources, organized in a modular approach to ensure reusability and ease of management.

Overview

The project structure is organized into various modules and configurations, each setting up specific resources. The main components include resource groups, Key Vaults, ADLS (Azure Data Lake Storage), compute clusters, role assignments, and data stores.

Getting Started

To get started with this project, ensure you have Terraform and Terragrunt installed on your machine. Follow the instructions provided in the docs folder for detailed guidance on each module and configuration.

1. Clone the repository:

    git clone git@github.com:Natural-State/NIP-Lakehouse-Infra.git
    cd <repository-directory>
   

2. Initialize Terragrunt:

    terragrunt init
   

3. Apply the configurations:

    terragrunt apply
   

Documentation

Detailed documentation for each component is provided in the docs folder. This includes explanations for what each component does, its dependencies, and inputs.