US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 18th Jun 2025
We are looking for a Senior Big Data engineer to drive Data and AI/ML development for our enterprise data platform. This role requires a deep understanding of enterprise data needs to create seamless data experiences for business users.Key Responsibilities:• Hands on development experience of Big Data initiatives.• Big Data Engineer with technical expertise with Spark, Python, Hive and Shell Scripting• Focused on Designing, developing and maintaining scalable data processing systems• Hands on experience of handling large data sets using Apache Spark and other big data technologies• Develop Data transformation and aggregation logic using Python, and Spark SQL for efficient querying and processing of data.• Work with Hive for writing complex HiveQL queries for data storage, transformation and analysis.• Implement Shell Scripting to automate data processing, System Monitoring and data integration tasks.• Collaborate with Data Scientist, Analysts and other stakeholders to ensure data availability and integrity.• Monitor and troubleshoot production data pipelines, ensuring timely data delivery and minimal downtime.• Drive A/B testing and user research to optimize data platform interfaces.Qualifications:• Bachelors or master’s degree in Computer Science, Engineering or related field.• Experience with Cloud-based Platforms (GCP etc.)• Experience in designing and launching enterprise-grade data platforms.• Familiarity with Kubernetes or containerized environments..• Strong analytical, problem-solving, and communication skills.