5+ years of experience in data engineering or a related field, with a solid understanding of cloud platforms and big data technologies.
Previous experience functioning as a team lead on a data engineering team.
Strong proficiency in Python or another programming language commonly used in data engineering, such as Java.
Excellent SQL skills with ability to work with data across different SQL databases including Postgres, Databricks, SQL Server etc. NoSQL databases is a plus
Knowledge of elastic Search/log stash implementation skills very desirable
Experience in building and optimizing ETL/ELT processes, data pipelines, and workflows, using tools like Apache Nifi, or Apache Kafka.
Familiarity with data modeling, data warehousing concepts, and data governance best practices.
Strong problem-solving and troubleshooting skills, with the ability to identify and resolve data quality and performance issues.
Experience with version control systems, such as Git, and knowledge of CI/CD practices in a data engineering context.
Knowledge of data security and privacy principles, as well as experience implementing data access controls and managing sensitive data.
Understanding of distributed computing principles and experience with distributed data processing frameworks like Apache Spark or Hadoop.
Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams and translate business requirements into technical solutions.
Mentoring more junior resources to keep our projects on track.