Looking for databricks architect with AWS experience.
- experience building/implementing data pipelines using Databricks or similar cloud database.
- Experience in DLT.
- Expert level knowledge of using SQL to write complex, highly optimized queries across large volumes of data.
- Hands-on object-oriented programming experience using Python is required.
- Professional work experience building real-time data streams using Spark and Experience in Spark.
- Knowledge or experience in architectural best practices in building data lakes
- Experience with 2 or more scripting languages such as Python, Bash.
- A solid understanding of containerization and orchestration technologies such as Docker, Kubernetes, or ECS.
- Understanding of infrastructure as code paradigm, specifically provisioning AWS infrastructure utilizing Terraform and/or Cloud Formation.