Experience with advanced Bigdata technologies like Hadoop, Spark, Hive, SQL and NoSQL.
Strong in programming languages with Hands-on experience: Scala and/or python.
Experience with Public cloud technologies such as AWS, DataBricks is required.
Collaborate with stakeholders to understand data requirements, assess existing data structures, and design appropriate solutions.
Develop and implement data migration strategies, including data extraction, transformation, and loading (ETL) processes, leveraging Databricks' capabilities and best practices.
Design and optimize data models within the Databricks environment, ensuring scalability, efficiency, and adherence to data governance standards.
Work closely with data engineers, and other stakeholders to support analytics, reporting, and machine learning initiatives on the Databricks platform.
Provide technical guidance and mentorship to team members involved in the migration process, ensuring alignment with industry best practices and standards.
Collaborate with other teams/applications to ensure compatibility, performance optimization, and scalability of DB and environments.
Apply emerging technologies, trends, and best practices in data management, analytics, and cloud computing, and apply them to enhance the Databricks migration process.