US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 12th Feb 2025
Design, develop, and maintain Databricks Lakehouse solutions sourcing from cloud platforms such as Azure Synapse and GCP.
Implement and manage DevOps and CICD workflows using tools like GitHub.
Apply best practices in test-driven development, code review, branching strategies, and deployment processes.
Build, manage, and optimize Python packages using tools like setup, poetry, wheels, and artifact registries.
Develop and optimize data pipelines and workflows in Databricks, utilizing PySpark and Databricks Asset Bundles.
Manage and query SQL databases (Unity Catalog, SQL Server, Hive, Postgres).
Implement orchestration solutions using Databricks Workflows, Airflow, and Dagster.
Work with event-driven architectures using Kafka, Azure Event Hub, and Google+C4 Cloud Pub/Sub.
Develop and maintain Change Data Capture (CDC) solutions using tools like Debezium.
Extensive experience in design and implementation of data migration projects specifically involving Azure Synapse and Databricks Lakehouse
Manage cloud storage solutions, including Azure Data Lake Storage and Google Cloud Storage.
Configure and manage identity and access solutions using Azure Active Directory, including AD Groups, Service Principals, and Managed Identities.