Looking for 10+ years of Data Architect with Transportation Management experience.
Lead the design and implementation of a scalable and robust data lake architecture using best practices and industry standards.
Architect end-to-end solutions that integrate Data Lake and Data Bricks to enable efficient data processing, analysis, and machine learning.
Design and implement data pipelines for data ingestion, transformation, and storage into the Data Lake.
Ensure data quality, integrity, and security throughout the data lifecycle.
Leverage Azure cloud platform to architect, deploy, and manage the data ecosystem.
Utilize cloud-native services to optimize cost, performance, and scalability.
Collaborate with data scientists and analysts to provide the necessary infrastructure for advanced analytics and machine learning projects using DataBricks.
Identify and resolve bottlenecks, optimize query performance, and ensure efficient data processing within the Data Lake and DataBricks environment.
Implement security measures to protect sensitive data within the Data Lake and ensure compliance with multi-geo data regulations.
Create detailed architectural documentation, diagrams, and guidelines for data engineers and other relevant teams.
Communicate complex technical concepts to non-technical stakeholders.
Provide technical leadership and guidance to a team of data engineers and architects.
Mentor junior team members, fostering skill development and knowledge sharing.
Stay updated with emerging technologies, tools, and trends in the data engineering and analytics space.
Propose and implement innovative solutions to enhance the organization's data capabilities.
Proven experience in designing and implementing data architectures, with a focus on Data Lakes and Data Bricks.
Strong expertise in Azure cloud platform.
Proficiency in programming languages such as Python, Scala, or .NET.
Experience with data modeling, ETL/ELT processes, and data warehousing concepts.
Familiarity with big data technologies (Hadoop, Spark, etc.) and distributed computing.
Excellent problem-solving skills and the ability to troubleshoot complex issues.
Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Leadership experience and a track record of mentoring and guiding technical teams.