Required Skills

Lead Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 12th Dec 2023

JOB DETAIL

  • Experience in Data Engineering in AWS/Azure Cloud
  • Experience with API data integration
  • Experience with Talend or other data movement tools Informatica, Azure Data Factory
  • Snowflake or other relational database experience such as Oracle or SQL Server
  • CI/CD Experience either using Git or Azure Dev Ops
  • Team Lead responsibility Looking for the resource to become the overall Data Engineering lead

Core Responsibilities:

  • Complete full life cycle of ETL/ELT development to address business needs or resolve issues including design, mappings, data transformations, scheduling and testing.
  • Translate data movement requirements into technical ETL design.
  • Develop ETL/ELT workflows and mappings to extract, transform, and load data into target environments.
  • Develop data extraction and transmissions to external vendors.
  • Develop test plans and perform unit testing.
  • Create supporting documentation for new ETL processes.
  • Work closely with data analysts to gain understanding of business processes and corporate data.
  • Determine impacts to data warehouse structures and information flows due to changes in business or technical requirements.
  • Contribute to architectural decisions to support business processes.
  • Provide production support for data solutions.
  • Complete root cause analysis and contribute to remediation planning and implementation.
  • Perform data quality analysis, report data quality issues and propose solutions for data quality management.
  • Learn and expand upon internal controls and participate in customer support.
  • Perform design and code reviews in support of organizational standards.
  • Mentor less experienced team members.
  • Prepare effort estimation including researching and estimating costs of software development, unit testing. May provide estimates for upgrades of vendor packages upgrades and integration with existing systems.
  • On Call and/or after hours work required.

 

Skill Qualifications

Required:

  • Minimum of 8 years of relevant experience in data warehousing, business intelligence tools, and the analysis of data
  • Minimum of 5 years of SQL query development, preferably across multiple database management platforms, and working with dimensional and star schema data warehouse implementations
  • Proficiency in ETL/ELT concepts and tools (Informatica IICS, Talend, Boomi and PowerCenter preferred)
  • Working knowledge of data warehousing concepts, structures and ETL best practices
  • Experience using query tools (e.g.. AQT, MS Query)
  • Ability to problem solve using analytical thinking skills
  • Must work well independently - must be inquisitive and seek answers to complex questions without being prompted
  • Strong organizational and time management skills
  • Strong communication skills including verbal and written to communicate effectively with clients and management
  • Strong project management skills to ensure that projects get done on time and within budget
  • Effectively participates in teams and moves the team toward completion of goals
  • Ability to resolve conflicts

 

Preferred:

  • Some experience with cloud database technologies preferred
  • Some experience with data visualization tools (e.g. Tableau) desirable

 

Company Information