- Overall, 15 Years experience in IT Industry
- Minimum 3 years of experience as Architect on Analytics Solutions
- Minimum 8 years’ experience in Data Cloud Programs
- Experience in architecting data ingestion and ETL frameworks capable of processing structured un semi – structured data set in batch
- Experience in performing Design Development and deployment using Azure Services – ADF Azure Data Lake Databricks Python etc
- Develop and maintain Scalable Architecture database design and data pipelines
- Design and Develop the data lake data warehouse using Databricks Azure Cloud Services
- Work with business and application stakeholders to implement data strategies build data flows and develop Data Models
- Provide technical guidance mentoring and code review design level technical best practices
Job Summary
- We are looking for a highly experienced and motivated Data ETL Architect to join our team This position will be responsible for designing and implementing data architectures to power our Databricks applications The successful candidate will have a deep understanding of data modelling data warehouse design and implementation and the ability to develop and maintain data pipelines
Responsibilities
- Design develop and implement data architectures for Databricks applications including data models data warehouses and ETL pipelines
- Design data structures for efficient access and query performance
- Develop and maintain data pipelines for effective data extraction transformation and loading
Optimize data architectures for scalability reliability and performance
Collaborate with cross functional teams to identify data requirements and design solutions
Monitor and optimize data performance in production
Develop and maintain data quality standards
Evaluate and recommend new technologies and tools to improve data architecture
Develop and maintain data security standards
Provide technical guidance and mentorship to junior team members
Qualifications
- Bachelor’s degree in Computer Science Information Systems or related field
- 8 years’ experience in data architecture data modeling data warehousing and ETL
- Expertise in Databricks and other cloud technologies
- Strong understanding of data security standards
- Highly organized detail oriented and able to adapt to changing priorities
- Excellent written and verbal communication skills with the ability to effectively communicate with technical and non technical audiences
- Ability to work independently and collaboratively in a fast paced environment
- Organize and Collaborate with key stakeholders to define functional and non functional CPQ data requirements
- Understand and document data transformation requirements
Finalize ETL tools if any and effort estimates