Initial Release: Terraform AWS Glue Job Module

Release Body

Initial Release: Terraform AWS Glue Job Module

We are excited to announce the initial release of the Terraform AWS Glue Job module. This module enables users to create and manage AWS Glue Jobs with various configurations using Terraform.

Key Features:

• Create Glue ETL Jobs with configurable attributes such as job name, description, role ARN, execution class, Glue version, worker type, number of workers, max capacity, timeout, and security configuration.
• Supports both Glue ETL and Python Shell job types.
• Glue scripts are sourced from an S3 bucket.
• Tagging support for Glue ETL jobs.

Usage:

To use this module, include the following in your Terraform configuration:

module "glue_etl_job" {
  source   = "app.terraform.io/subhamay-bhattacharyya/glue-job/aws"
  version  = "1.0.0"

  aws-region                       = "us-east-1"
  project-name                     = "your-project"
  environment-name                 = "your-environment"
  glue-job-base-name               = "example-glue-job"
  glue-job-description             = "An example Glue ETL Job"
  glue-script-bucket-base-name     = "example-script-bucket"
  script-name                      = "example-script.py"
  glue-job-role-name               = "example-glue-role"
  execution-class                  = "STANDARD"
  glue-version                     = "2.0"
  python-version                   = "3.0"
  glue-job-command-name            = "glueetl"
  glue-job-timeout                 = 2880
  max-capacity                     = 0.0625
  worker-type                      = "Standard"
  number-of-workers                = 2
  max-concurrent-runs              = 1
  default-arguments = {
    "--job-bookmark-option" = "job-bookmark-enable"
    "--enable-metrics"      = "true"
  }
  glue-security-configuration-name = "security-configuration-name"
  glue-job-tags                   = {
    Environment      = "dev"
    ProjectName      = "example-project"
    GitHubRepository = "example-repo"
    GitHubRef        = "refs/heads/main"
    GitHubURL        = "https://github.com/example/example-repo"
    GitHubSHA        = "example-sha"
  }
  ci-build = ""
}

Inputs and Outputs:

For detailed information about the module's inputs and outputs, please refer to the README.md.

Changelog:

[1.0.0] - 2024-11-14

Added

• Initial release of the Terraform AWS Glue Job module.
• Create a Glue Job of type Glue ETL / Python Shell.
• The Glue script is pulled from an S3 bucket.
• Tag the Glue ETL job.

For more details, visit the repository.