US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 1st Sep 2022
Designing and implementing Data Platforms, Data Pipeline(integration) technologies, and Common Data Services using cloud native integration and analytics technologies
Creating datasets for Machine learning algorithms and data analysis
Work closely and collaboratively with other members of the analytics teams to define requirements, mine and analyze data, integrate data from a variety of sources
Design and build low-code/no-code data pipeline frameworks to support large scale ingestions
Perform unit and integration testing
Perform detail assessments of current state data platforms and drive enhancements and optimization activities
Participate in implementation of BI visualizations
Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates
Provide mentoring to junior engineers
Optimize data pipelines for large scale data lake implementations
Implement Common Data Services (e.g., Data Orchestration using AirFlow, Data Governance capabilities using Collibra) to support reuse across business functions
Desired Qualifications:
Proven experience in the following:
Engineering experience in Big Data systems, Data Analytics and Data Integration related fields
GCP experience in Cloud Infrastructure, Data Integration, Data Engineering, Cloud Analytics solutions, and experience with operationalizing enterprise scale solutions
Architecting and designing data lakes on GCP cloud analytics, BI and Machine learning workloads
Middleware technologies, and Data Ingestion technologies like GCP DataFlow, Fusion, and AirFlow
Experience with AtScale is preferred
Writing complex SQL queries, stored procedures, etc.
Agile development skills.
CI/CD pipelines such as Concourse, Jenkins and Terraform technologies