US Citizen

Green Card

EAD (OPT/CPT/GC/H4)

H1B Work Permit

Corp-Corp

W2-Permanent

W2-Contract

Contract to Hire

Consulting/Contract

UG :- - Not Required

PG :- - Not Required

No of position :- ( 1 )

Post :- 6th May 2025

Develop and maintain scalable, high-performance data processing pipelines leveraging Apache Spark and PySpark for batch and real-time data processing.

Optimize and fine-tune PySpark jobs for performance, efficiency, and resource management across large-scale datasets.

Design, implement, and support data pipeline architectures that integrate with multiple data sources, ensuring high availability and reliability.

Collaborate with cross-functional teams including data scientists, architects, and business stakeholders to design optimal data solutions.

Provide expertise in cluster management and troubleshooting issues related to distributed computing frameworks.

Ensure data integrity, quality, and efficient management of workflows within the Spark ecosystem.

Implement best practices for data governance and maintain compliance with organizational policies.