- Provide subject matter expertise and hands on delivery of data capture, curation and consumption pipelines on Azure
- Ability to build Azure data solutions and provide technical perspective on storage, big data platform services, serverless architectures, Hadoop ecosystem, vendor products, RDBMS, DW/DM, NoSQL databases and security.
- Participate in deep architectural discussions to build confidence and ensure team success when building new solutions and migrating existing data applications on the Azure platform.
- Conduct full technical discovery, identifying pain points, business and technical requirements, “as is” and “to be” scenarios.
- Understand the strategic direction set by senior management as it relates to team goals.
- Use considerable judgment to define solution and seeks guidance on complex problems.
-
Qualifications
- Bachelors or higher degree in Computer Science or a related discipline. Master's degree in a technical field preferred.
- Extensive experience providing practical direction within the Azure Native services and Hadoop
- Extensive hands-on experience implementing data migration and data processing using Azure services: ADLS, Azure Data Factory, Azure Functions, Synapse/DW, Azure SQL DB, Event Hub, IOT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks Azure Data Catalog, Cosmo Db, ML Studio, AI/ML, etc.
- Minimum of 5 years of hands-on experience in Azure and Big Data technologies such as Powershell, C#, Java, Node.js, Python, SQL, ADLS/Blob, Spark/SparkSQL, Databricks, Hive and streaming technologies such as Kafka, EventHub, NiFI etc.
- Cloud migration methodologies and processes including tools like Azure Data Factory, Data
- Minimum of 5 years of RDBMS experience
- Experience in using Big Data File Formats and compression techniques
- Experience working with Developer tools such as Azure DevOps, Bitbucket, Jira
- Experience with private and public cloud architectures, pros/cons, and migration considerations.
Nice-to-Have Certifications
- DP-200 Implementing an Azure Data Solution
- DP-201 Designing an Azure Data Solution
- AZ-400: Designing and Implementing Microsoft DevOps Solutions
Nice-to-Have Skills/Qualifications:
- DevOps on an Azure platform
- Experience developing and deploying ETL solutions on Azure
- IoT, event-driven, microservices, Containers/Kubernetes in the cloud
- Familiarity with the technology stack available in the industry for metadata management: Data
- Governance, Data Quality, MDM, Lineage, Data Catalog etc.
- Familiarity with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc.
- Multi-cloud experience a plus - Azure, AWS, Google