AWS Glue Pricing

AWS Glue Pricing

AWS Glue pricing was structured based on three components: Data Catalog, ETL Jobs, and Crawlers. 

1. Data Catalog:

   • The Data Catalog is used to store metadata about data sources, transformations, and targets in AWS Glue. There are no separate charges for using the AWS Glue Data Catalog; you only pay for the underlying AWS resources used to store the metadata (e.g., Amazon RDS or Amazon Aurora) based on their respective pricing.

2. ETL Jobs:

   • ETL (Extract, Transform, Load) Jobs are the data processing tasks in AWS Glue, where you can extract data from various sources, perform transformations, and load it into target destinations.
   • You are billed based on the number of Data Processing Units (DPUs) and the duration of the ETL job. DPUs represent the processing power allocated to an ETL job, and different DPU options are available based on your processing needs.
   • As of my last update, the price per DPU-hour was $0.44 in the US East (N. Virginia) region. For other regions, the prices may vary slightly.

3. Crawlers:

   • Crawlers in AWS Glue are used to automatically discover and catalog metadata from various data sources, such as databases or S3 buckets.
   • You are charged per Crawler run and the number of Data Catalog tables created by the crawler.
   • The cost per Crawler run was $0.44 in the US East (N. Virginia) region, and additional charges apply if the Crawler creates or updates Data Catalog tables.