Us Citizen
Green Card
Corp-Corp
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 2nd Sep 2021
The data engineer will work closely with IT and business stakeholders to identify opportunities and engineer solutions that will help drive additional revenue growth and improve overall usage of data. The candidate will collaborate with colleagues from the Apps, CloudEng and BI/Analytics teams to realize cutting-edge, reliable solutions.
This position will provide overall design and technical solutions for the data warehouse and data lakes including data analysis, data architecture, data modeling, data feature engineering, data validation, ETL/ELT data pipeline design and development, along with the development of the semantic layer for reporting and analytics. Additional areas include leading technical discussions, code reviews, solution documentation and defining overall best practice as related to data integration and data engineering.
What you’ll do:
Lead technical data solutions, including custom development while working with cross project teams in delivering projects.
Define overall ETL/ELT architecture including key designs on integration standards such as loading real time/batch data, CDC, data validation, data enrichment etc.
Architect solutions based on specific project requirements, considering best practices and performance standards while promoting reusability
Building data model and semantic layer with automated data exception framework
Ability to manage and participate as a Data Analyst gathering and analyzing source data, processing logic, and operational system usage.
Responsible for the solution design, hands-on development, technical tasks oversight, release management and implementation of data products and features.
Deep hands-on knowledge of data integration and data pipeline methodologies and API platforms
Analyze issues, reverse engineer where needed to come up with solutions to resolve issues in a timely manner
Responsible for maintaining commitment to excellence and high standards in a collaborative environment
Skill Set Requirements:
6+ years in a direct role as a Developer / designer / architect for ETL, data warehouse and data lake systems.
4+ years of solid data warehousing, integration methodology experience.
4+ Years - Data modeling experience to deliver both logical model & physical design for transaction and analytical systems.
Candidate must have strong technical expertise in SQL and Snowflake.
Must have advanced technical understanding with tools and products used in data warehouse and data integration development, such as Pyhton, Airflow, Glue, DBT, Workato
Solid hands-on experience in data modeling, data feature engineering.
Broad exposure in the new techniques in data warehousing and data integration technology
Experience in data lake architecture and design
Strong understanding of data architecture in an AWS cloud environment
Able to communicate effectively with all levels of management in a clear and professional manner; verbally and written.
Media & Entertainment (Studios) industry experience is a plus.