Federated Media is looking for a data warehouse engineer to help build and maintain our warehouse of Web events, user data, and performance metrics. The ideal candidate has a deep understanding of the technical and functional aspects of database, data warehouse and report design.
Responsibilities:
Actively participate in the technical design, implementation and maintenance of data modeling, ETL and reporting tasks.
Perform all of the necessary data transformations to populate data into a warehouse table structure that is optimized for reporting and analytics.
Quickly assess the impact of production system changes to the existing warehouse, and implement changes to the warehouse ETL and reporting code to ensure consistent and accurate reporting.
Skills/Requirements:
Excellent MySQL skills <---- subject to change depending on tech
Excellent understanding of data modeling, indexes, denormalization, star schema, query plan analysis, database performance optimization and tuning
Min 3 years of experience working in a data warehouse environment.
Experience designing and developing custom ETL systems for complex, multi-source data warehouse applications.
Strong programming skills and extensive knowledge of Unix/Linux and scripting skills (Perl, shell, Python, XML).
Excellent interpersonal and communication skills.
Excellent attention to detail.
Knowledge of data partitioning and sharding at the software and hardware level.
M.S or B.S in computer science, or equivalent.
Nice to have:
Experience with ETL packages (e.g. Pentaho)
Java software development experience
Experience with logging platforms like syslog-ng
Experience with Hadoop, map/reduce, Hive, Pig
Experience with BI and reporting tools and packages (BIRT, Crystal Reports, etc)
Responsibilities:
Actively participate in the technical design, implementation and maintenance of data modeling, ETL and reporting tasks.
Perform all of the necessary data transformations to populate data into a warehouse table structure that is optimized for reporting and analytics.
Quickly assess the impact of production system changes to the existing warehouse, and implement changes to the warehouse ETL and reporting code to ensure consistent and accurate reporting.
Skills/Requirements:
Excellent MySQL skills <---- subject to change depending on tech
Excellent understanding of data modeling, indexes, denormalization, star schema, query plan analysis, database performance optimization and tuning
Min 3 years of experience working in a data warehouse environment.
Experience designing and developing custom ETL systems for complex, multi-source data warehouse applications.
Strong programming skills and extensive knowledge of Unix/Linux and scripting skills (Perl, shell, Python, XML).
Excellent interpersonal and communication skills.
Excellent attention to detail.
Knowledge of data partitioning and sharding at the software and hardware level.
M.S or B.S in computer science, or equivalent.
Nice to have:
Experience with ETL packages (e.g. Pentaho)
Java software development experience
Experience with logging platforms like syslog-ng
Experience with Hadoop, map/reduce, Hive, Pig
Experience with BI and reporting tools and packages (BIRT, Crystal Reports, etc)
Source: Joel On Software