• US Citizen

• Green Card

• EAD (OPT/CPT/GC/H4)

• H1B Work Permit

• Corp-Corp

• W2-Permanent

• W2-Contract

• Contract to Hire

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 30th Aug 2025

Data Architecture:
Design end-to-end data architecture leveraging Microsoft Fabric's capabilities.
Design data flows within the Microsoft Fabric environment.
Implement OneLake storage strategies.
Configure Synapse Analytics workspaces.
Establish Power BI integration patterns.

Integration Design:
Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric.
Design Delta Lake architecture for IES Gateway data.
Implement medallion architecture (Bronze/Silver/Gold layers).
Create real-time data ingestion patterns.
Establish data quality frameworks.

Lakehouse Architecture:
Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance.

Data Governance:
Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance.

Implement row-level security.
Configure Microsoft Purview policies.
Establish data masking for sensitive information.
Design audit logging mechanisms.

Pipeline Development:
Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration.

Performance Optimization:
Implement performance tuning strategies for large-scale data processing and analytics workloads.
Optimize Spark configurations.
Implement partitioning strategies.
Design caching mechanisms.
Establish monitoring frameworks.

Security Framework:
Design and implement security patterns aligned with federal and state requirements for sensitive data handling.

Required Qualifications:
Education:
 Bachelor’s degree in computer science or related field.

Experience:
6+ years of experience in data architecture and engineering.
2+ years hands-on experience with Azure Databricks and Spark.
Recent experience with Microsoft Fabric platform.

Technical Skills:
Microsoft Fabric Expertise:
Data Integration: Combining and cleansing data from various sources.
Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines.
Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets.
Data Visualization Techniques: Representing data graphically in impactful and informative ways.
Optimization and Security: Optimizing queries, improving performance, and securing data
Azure Databricks Experience:
Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics.
Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes.
Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement.
Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations.
Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination)
Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics.
Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools.
Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview 

Programming & Query Languages:
SQL: Proficiency in SQL for querying and managing databases, including skills in SELECT statements, JOINs, subqueries, and window functions12.
Python: Using Python for data manipulation, analysis, and scripting, including libraries like Pandas, NumPy, and PySpark

Data Modeling:
Dimensional modeling
Real-time data modeling patterns
Soft Skills:
Strong analytical and problem-solving abilities
Excellent communication skills for technical and non-technical audiences
Experience working with government stakeholders
Preferred Experience:
Azure DevOps
Infrastructure as Code (Terraform)
CI/CD for data pipelines
Data mesh architecture
Certifications (preferred):
Microsoft Azure Data Engineer Associate
Databricks Data Engineer Professional
Microsoft Fabric certifications (as they become available)
Project-Specific Requirements:
Experience designing data architectures for grant management systems
Knowledge of federal/state compliance requirements for data handling
Understanding of financial data processing requirements
Experience with real-time integration patterns

This position requires strong expertise in modern data architecture with specific focus on Microsoft's data platform. The successful candidate will play a crucial role in designing and implementing scalable data solutions that enable efficient data processing and analytics for state-level grant management and reporting systems.