Data Catalog and Crawlers
Metadata repository, created by crawlers and inferred automatically from the data.
ETL
Supported Transformations:
- Drop(DropFields, DropNullFields)
- Filter
- Join
- Map
- FindMatches (fuzzy match)
- Conversion
Glue
-
Database Migration Service (DMS)
No transformation is performed (unlike Glue) and continuous data replication.
- Data Pipeline
-
Batch
It is suitable for any computing docker-based jobs, not just ETL. Glue is mostly ETL in that regard.
-
Athena
S3 -> Glue -> Athena -> QuickSight
- 2 Data Engineering