Bachelor's degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field required.
Master's degree in computer science, information systems, data science, management information systems, mathematics, physics, engineering, statistics, economics, and/or a related field preferred.
Minimum of eight (8) years of experience as a data engineer with full-stack capabilities
Minimum of ten (10) years of Experience in programming
Minimum of five (5) years in Cloud technologies like Azure, Aws or Google.
Strong SQL Knowledge
Experience in ML and ML Pipeline a plus
Experience in real-time integration, developing intelligent apps and data products.
Proficiency in Python and experience with CI/CD practices
Strong background in IAAS platforms and infrastructure
Hands-on experience with Databricks, Spark, Fabric, or similar technologies
Experience in Agile methodologies
Hands-on experience in the design and development of data pipelines and data products
Experience in developing data ingestion, data processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions.
Hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
Extensive experience in Big Data technologies such as Apache Spark and streaming technologies such as Kafka, EventHub, etc.
Extensive experience in designing data applications in a cloud environment.