Required Skills

Lead Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 18th Dec 2023

JOB DETAIL

The lead data engineer will design solutions and work with a team of engineers to ensure accurate, consistent, reliable, and sustainable solutions are delivered. The data engineer will also influence data engineering processes that result in highly accurate and trusted data assets for use in Truterra and across the organization. Additionally, the lead data engineer influences stakeholders to ensure investments in data driven solutions are centered on optimizing clearly defined and quantified business outcomes.
Required Education and Experience
• Bachelor's degree in Computer Science, MIS, or related field and 7+ years of experience with or Associates Degree and 9+ years of experience
• Applicable experience is characterized as advanced SQL, data engineering & data modeling techniques
• Ability to function as a technical lead, working closely with developers and data analysts, as well as hands-on implementation
• 7+ years of experience building data integration solutions using tools like Informatica, Talend, Mulesoft, Qlik, etc.
• Strong experience building out data warehouse and/or data lake

• 3+ years of experience leading engineering resources
• 2+ years of experience working with cloud-native data solutions on Microsoft Azure, AWS, or Google Cloud platform
• Strong experience leading full lifecycle, large, complex reporting or data engineering efforts
• Strong experience in working with heterogeneous datasets in building and optimizing data pipelines, pipeline architectures and integrated datasets using various data integration technologies (ETL/ELT, data replication/CDC, message-oriented data movement, API design, etc.)
• Experience with DevOps, CI/CD pipelines and automated testing Required Competencies/skills
• Implement data structures using standards and best practices in data modeling, ETL/ELT processes, SQL, database, and other technologies
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Thorough experience building and optimizing data pipelines and data sets.
• Deep knowledge of the data vault method, model, and architecture
• Ability to manage the overall data landscape: meta data, processing patterns, and data quality
• A successful history of manipulating, processing and extracting value from large datasets.
• Strong working knowledge of message queuing, stream processing, and highly scalable data stores
• Ability to obtain a clear understanding of business needs and value, developing a detailed vision for the initiative, mapping out the solution, and guiding its implementation
• Develop test-driven solutions that can be deployed quickly and in an automated fashion
• Ability to obtain a clear understanding of business needs and value, developing a detailed vision for the initiative, mapping out the solution, and guiding its implementation
• Demonstrated ability to collaborate across all levels (Engineers, Management, Architects, etc.) & across all skill sets (Data scientists, Data visualization developers, Salesforce developers etc.) particularly in a Product-oriented culture 
• Capable of using agile methodology and implementing Continuous Integration/Continuous Delivery (CI/CD) pipelines
 • Experience working with Databricks (or Spark) & Qlik technologies (Replicate and Compose)
• Experience with any scripting languages, preferably Python
• Experience working with BI Tools (Power BI, Tableau etc.) to create dashboards and reports
• Experience with Snowflake
• Experience in Manufacturing or Agriculture industry Preferred
• Troubleshooting skills, ability to determine impacts, ability to resolve complex issues, and ability to exercise sound judgment and initiative in challenging situations.

Company Information