10+ years Hands-on experience with - Azure Data Bricks . Must be well versed with the platform
Design and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure Databricks
Developing scalable and re-usable frameworks for ingesting of data sets
Ensure data quality and integrity throughout the entire data pipeline, implementing robust data validation and cleansing mechanisms
Working with event based / streaming technologies to ingest and process data.
Develop and maintain data pipelines on Snowflake and Azure platforms. Assist in deploying applications with Kubernetes and Dockers. Contribute to event streaming and processing using KAFKA.
Must have 3+ years of relevant experience Java development background with strong Azure knowledge, develop and maintain Java applications using Springboot, Jboss, and other technologies.
Azure Cloud Experience – hands-on experience with Storage Format, provisioning options and single tenant and multi-tenant concepts.
Bigdata Experience : Proficient in ETL development with Talend, Big Data processing and storage, MDM implementation for data consistency
Python/Spark/Scala development > 5+ years coding experience .
Lead the design and implementation of cloud-based data solutions.
The candidate should be very well versed with Cloud technology and Java is a must.