Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 29th Oct 2024

JOB DETAIL

· 10 years of experience designing, developing, testing, and implementing Extract, Transform and Load (ELT/ETL) solutions using enterprise ELT/ETL

· 15 years of comparable work experience.

· 10 years of experience developing and implementing data integration, data lake and data warehouse solutions in an on-premise and cloud environment.

· 5 years of experience working with Business Intelligence tools (IBM Cognos is preferred), Power BI and Alteryx.

· 7 years of experience working with API’s, data as a service, data marketplace and data mesh.

· 10 years of experience with various Software Development Life Cycle methods such as Agile, SCRUM, Waterfall, etc.

· 3-year experience in 100+ TB data environment.

· Proven experience developing and maintaining data pipelines and ETL jobs using IBM DataStage, Informatica, Matillion, FiveTran, Talend or Dbt

· Knowledge of AWS cloud services such as S3, EMR, Lambda, Glue, Sage Maker, Redshift & Athena and/or Snowflake.

· Experienced in data modelling for self-service business intelligence, advanced analytics, and user application.

· Experience with Data Science including AI/ML Engineering, ML framework/pipeline build and predictive/prescriptive analytics on Aws Sagemaker.

· Experience with migrating, architecting, designing, building and implementing cloud data lake, data warehouses (cloud/on-prem), data mesh, data as a service, and cloud data marketplace.

· Ability to communicate complex technical concepts by adjusting messaging to the audience: business partners, IT peers, external stakeholders, etc.

· Proven ability to design and build technical solutions using applicable technologies; ability to demonstrate exceptional data engineering skills. · Ability to prioritize work by dividing time, attention and effort between current project workload and on-going day to day activities.

· Demonstrates strength in adapting to change in processes, procedures and priorities.

· Proven ability to establish a high level of trust and confidence in both the business and IT communities.

· Strong teamwork and interpersonal skills at all management levels.

· Proven ability to manage to a project budget.

· Experience applying agile practices to solution delivery.

· Must be team-oriented and have excellent oral and written communication skills.

· Strong analytic and problem-solving skills.

· Good organizational and time-management skills.

· Experience in Strategic Thinking and Solutioning.

· Must be a self-starter to understand existing bottlenecks and come up with innovative solution.

· Demonstrated ability to work with key stakeholders outside the project to understand requirements/resolve issues.

· Experience with data model design, writing complex SQL queries, etc., and should have a good understanding of BI/DWH principles.

· Expertise in Relational Database Management System, Data Mart and Data Warehouse design.

· Expert-level SQL development skills in a multi-tier environment.

· Expertise in flat file formats, XML within PL/SQL, and file format conversion.

· Strong understanding of SDLC and Agile Methodologies.

· Strong understanding of model driven development. · Strong understanding of ETL best practices. · Proven strength in interpreting customer business needs and translating them into application and operational requirements.

· Strong problem-solving skills and analytic skills with proven strength in applying root cause analysis

Company Information