H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 15th Feb 2025
Data Pipeline Development: Design, build, and maintain scalable, robust data pipelines using Python and Databricks to ingest, process, and transform large datasets from various sources (internal and external).
Databricks Integration: Leverage Databricks to create and optimize ETL workflows, manage data lakes, and perform complex data transformations.
Automation & Optimization: Automate data ingestion, processing, and transformation tasks to ensure consistency, accuracy, and efficiency in data processing workflows.
Collaborate with Data Teams: Work closely with data scientists, analysts, and business intelligence teams to understand data requirements and support data-driven initiatives.
Data Modeling & Architecture: Develop and optimize data models and schema designs to ensure efficient storage and querying in cloud environments.
Performance Tuning: Monitor the performance of data pipelines and implement improvements to ensure data processing is optimized for speed and scalability.
Cloud Infrastructure: Work with cloud technologies (e.g., AWS, Azure, or Google Cloud) to ensure that data pipelines are deployed and managed effectively.