US Citizen
Green Card
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 22nd Nov 2022
• Create and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
• Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer
• 8 to 10 years of experience working in data engineering, business intelligence or related field delivering large scale data platforms and services. Ideal candidate will have the following skills:
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
• Expertise in data modeling, data access and data storage techniques. The candidate should have foundational knowledge of dimensional modeling to build a data warehouse
• Strong experience building transformational logic using SQL on relational SQL and NoSQL databases. Skills using DBT framework for data transformation is plus
• Robust programming skills and strong experience with Python to ingest, transform and load the data
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets using tools like Airflow.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift.