Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 11th May 2022

JOB DETAIL

Hiring Manager notes:

Building a Big Data platform.
Role will be fine tuning existing Stored Procedures
Strong Java backend, python will work, too.
Big data experience like hybase, pyspark and java spark, map reduce
Will be migrating to Azure to experience with Databricks/Data Factory needed

2 round interviews.  2nd  round will be a lot about azure

Description:
Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning and other similar roles. Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated eco systems. Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments. Analyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities. Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition. May design schemas, write SQL or other data markup scripting and helps to support development of Analytics and Applications that build on top of data. Selects, develops and evaluates personnel to ensure the efficient operation of the function.

Primary Responsibilities:
• Provide technical leadership in architecture, design and engineering in modernization of legacy Data Ingestion, ETL and Database to new technologies in the Public Cloud (Azure), Big Data and API Space
• Solve the hard problems with the team, including setting patterns and practices and building frameworks. Heavy hands on code and build. Lead the technology transformation
from our legacy Data and Analytic platforms to a Big Data Cloud based Modern Software paradigm.
• Understands security threats and patterns comprehensively and ensures adherence to all
regulatory initiatives. HIPPA, PHI, PII, locational data restrictions, contractual etc.
• Demonstrate leadership in the context of software engineering and be an evangelist for
engineering best practices
• Stay abreast of leading-edge technologies in the industry evaluating emerging software
technologies
• Work collaboratively with all business areas to assess unmet/new business needs and solutions
• Encourage the growth of junior engineers on the team through skills development, mentoring
and technical guidance
• Create a startup mentality to accelerate the introduction of new capabilities and transform
teams
• Avid supporter of the Open Source software community
• Excellent time management, communication, decision making, and presentation skills
• Display a strong desire to achieve and attain high levels of both internal and external customer
satisfaction.

Job Qualification:
• Engineering graduate in Computer Science or equivalent experience
• Experience with some of the modern relational databases
• Skilled at optimizing SQL statements
• Experience with Data warehousing services preferably Snowflake
• 5+ years of experience working on commercially available software and / or healthcare platforms as a Data Engineer.
• Subject matter expert on Cloud technologies preferably Azure and Big Data ecosystem.
• Should have 3-4 years of strong experience designing and building Enterprise Data solutions on cloud.
• 1-2 years of experience developing solutions hosted within public cloud providers such as Azure or AWS or private cloud/container based systems using Kubernetes/OpenShift
• Experience in using modern software engineering and product development tools including Agile / SAFE, Continuous Integration, Continuous Delivery, DevOps etc.
• Strong experience of operating in a quickly changing environment and driving technological innovation to meet business requirement
Preferred Experience:
• Experience building Big Data solutions on public cloud (Azure)
• Experience building data pipelines on Azure with skills Databricks spark, scala, Azure Data factory, Kafka and Kafka Streams, App services, Az Functions.
• Experience developing RESTful Services in .NET, Java or any other language
• Experience with DevOps in Data engineering.
• Experience with Microservices architecture
• Ability to establish repeatable processes, best practices and implement version control software in a Cloud team environment

Company Information