AITS Development Methodology
For Business Intelligence Projects
ETL

ETL Developer

Focus: Data movement, data transformation, data integrity, data availability

Roles

The Extract Transform Load (ETL) Developer is focused on Data Movement. The goal of ETL Development is to create ETL Maps, which extract data from a source system, transform data by applying predetermined business rules, and move the data to the data warehouse. The ETL Developer schedules these maps to run on a recurring basis to keep the data warehouse data current.

ETL Developers work closely with the Data Warehouse Designer to understand the business requirements of the project, applying the design to the data source to create the data solution. They work closely with the Data Warehouse Designers to understand and implement any data interactions required to store and retrieve data. The ETL Developer is responsible for troubleshooting data integrity issues found during data validations.

Activities

  • Software development
  • Unit testing of developed software
  • Integrating with external services (e.g. databases, scheduling tools, etc.)
  • ETL maps deployed to test and production environments
  • Troubleshoot ETL code and resolve issue
  • Maintain data movement documentation (e.g. technical knowledgebase, scheduling dependencies, etc.)

Key Products

  • ETL maps
  • Application manager modules