Green Card
Corp-Corp
W2-Contract
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 29th Oct 2021
Client is looking for a highly energetic and collaborative Big data resource with experience in enterprise data projects around Business and IT operations. The ideal candidate should be an expert in leading projects in the Big Data space, using traditional, new and emerging technologies. Candidate should have good experience in defining the overall technical architecture for enterprise and customer data platforms. A good understanding of enterprise data architecture and systems is expected.
• 8 years of overall experience in providing ETL, data engineering and management solutions having working knowledge in datalake implementation
• 3+ years of hands-on experience developing a big data distributed data processing platform with Hadoop, Hive & Spark
• 1+ years hands-on expertise in cloud big data technologies like Azure ADF, Azure Databricks, ADLS Gen2, GCP Dataproc, GCS etc
• Provide end-to-end technical leadership from understanding technical requirements, designing custom frameworks, building test strategy and implementing CICD pipelines using tools like looper, concord etc.
• Hands-on expertise in designing and building the scalable configurable spark frameworks in python or scala
• Hands-on expertise in scheduling and managing workflows using Apache Airflow or similar workflow orchestrator and scheduler
• Very good knowledge in unix/linux shell scripts
• 1+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
• Practice working with, processing, and managing large data sets (multi TB/PB scale).
• Background in Scrum/Agile development methodologies.
• Capable of delivering on multiple competing priorities with little supervision.
• Excellent verbal and written communication skills.
• Experience with offshore/onshore project delivery