The Snowflake Data Engineer is responsible for:
- Design, develop, and maintain complex snowflake data warehouses, including data modeling, ETL processes, and data quality control.
- Ensure data integrity, quality, and security across all data warehousing activities.
- Develop and maintain data pipelines to integrate data from various internal and external sources.
- Develop and maintain data pipelines using tools for data transformation, testing, and deployment. Ensure data pipelines are scalable, reliable, and efficient.
- Write Python code to automate data processing, transformation, and loading tasks, including data ingestion, data quality control, and data visualization.
- Collaborate with data analysts and business stakeholders to understand data requirements and develop data solutions that meet business needs.
- Develop and maintain data visualizations and reports using Snowflake's built-in visualization tools or third-party tools like Tableau.
- Ensure data quality, integrity, and security by developing data validation rules, data cleansing processes, and data access controls.
- Optimize snowflake data warehouse performance, scalability, and reliability, including monitoring and troubleshooting data issues.
- Develop and maintain technical documentation, including data dictionary, data flow diagrams, and code comments.
- Participate in code reviews and provide feedback to ensure high-quality code and adherence to coding standards.
- Work closely with the agency’s data team and the overall state technology team to ensure alignment on data strategy and technology standards.
- Communicate complex data findings to non-technical stakeholders in a clear and concise manner
- Provide technical guidance and mentorship to junior analysts and other team members