Required Skills

Sr. Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 4th Oct 2023

JOB DETAIL

As noted above, this list is intended to reflect the current job but there may be additional essential functions (and certainly non-essential job functions) that are not referenced. Management will modify the job or require other tasks be performed whenever it is deemed appropriate to do so, observing, of course, any legal obligations including any collective bargaining obligations.
• Be a part of the data privacy and governance team. Work closely with data privacy office, data application teams and product owners to design, implement and support data privacy, governance and analytics solutions that provide insights to make better decisions.
• Implement data privacy and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream Analytics, Azure Databricks, etc.) and traditional data warehouse tools.
• Perform multiple aspects involved in the development lifecycle – design, cloud engineering (Infrastructure, network, security, and administration)
• Provide technical leadership and collaborate within a team environment as well as work independently.
• Be a part of a DevOps team that completely owns and supports their product.
• Implement batch and streaming data pipelines using cloud technologies.
• Leads development of coding standards, best practices and privacy and security guidelines.
• Mentors' others on technical and domain skills to create multi-functional teams.
• Develop and support data privacy and governance related frameworks and help other team implement them for compliance
• Experience working in an Agile environment and with Agile teams

 

All you'll need for success
• Minimum Qualifications- Education & Prior Job Experience
• Bachelor's degree in Computer Science, Computer Engineering, Technology, Information Systems (CIS/MIS), Engineering or related technical discipline, or equivalent experience/training
• 4 years software solution development using agile, DevOps, operating in a product model that includes designing, developing, and implementing large-scale applications or data engineering solutions
• 3 years data analytics experience using SQL
• 2 years of cloud development and data lake experience (prefer Microsoft Azure) including Azure EventHub, Azure Data Factory, Azure Databricks, Azure DevOps, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Power BI
• Combination of Development, Administration & Support experience in several of the following tools/platforms required:
§ Programming/Scripting: Python, Spark, Unix, SQL, APIs, Java
§ Data Platforms: Teradata, Cassandra, MongoDB, Oracle, SQL Server, ADLS, Snowflake
§ Azure Cloud Technologies: Azure Databricks, Azure Blob Storage, Azure Data Lake, Azure Power Apps and Azure Functions
§ CI/CD: GitHub, Jenkins, Azure DevOps, Terraform
§ BI Analytics Tool Stack - Cognos, Tableau, Power BI, and Grafana
§ Tools: DataStage, Informatica EDC/Axon, BigID
 

Company Information