Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 15th May 2023

JOB DETAIL

Key Pointers:- AWS, Bigdata, Databricks

Minimum 8 years of experience with Hadoop, AWS Databricks - Excellent with Big Data concepts - storage, curation, consumption, scalability, maintainability, RBAC - Experience with batch processing and real time data processing using Spark/Databricks - Experience with large setup where raw data storage is ~1 Petabyte - Experience with generic ingestion, curation frameworks using AWS Databricks services - At least 2 years of experience migrating on-premise Data Lake to AWS - S3, Delta Lake/Lakehouse - At lest

2-3 years of healthcare experience - Excellent with AWS services - DataSync, S3, Airflow, Databricks (Python, Scala, SQL) - Excellent debugging skill with PySpark/Scala/SQL - Excellent written and verbal communication - Ability to participate in requirement gathering, scoping, architecture ,planning, DevOps and application roll-out within Agile execution - Experience with UAT of migrated analytical application in AWS - Experience with content creation/curation in Confluence

Company Information