We are looking for Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on partner needs.
Responsibilities
- Partner with leadership, engineers, program managers and data scientists to understand data needs.
- Design, build and launch extremely efficient and reliable data pipelines to move data across several platforms including Data Warehouse, online caches and real-time systems.
- Build data expertise and own data quality for your areas.
Qualifications
- 2+ years Data Engineering experience
- Advanced SQL coding - Expert in SQL with good understanding of how relational databases work
- Experience querying massive datasets using Presto, Hive etc.
- Good Python Programming Experience
- Experience with Data Warehousing Architecture
- Experience with workflow management engines like Airflow, Dataswarm, Luigi etc.
- 2+ years experience in custom ETL design, implementation and maintenance
- Experience with data quality and validation.
- Experience with SQL performance tuning and e2e process optimization