US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 27th Nov 2023
EXPERIENCE – 15+YEARS AS A DATA AND SOFTWARE ENGINEER Seasoned and Agile Technology leader with comprehensive experience in Data Engineering. Well-rounded and results focused, and technically proficient in multiple languages and platforms, including Azure, SPARK, .NET, Power BI and SQL. I specialize in building and coaching high performing data engineering teams. My passion for data, quick adaptation to new digital technologies, and ability to simplify complex problems have empowered me to prioritize team satisfaction, customer delight, build strong relationship with business while building quality, accurate and reliable software solutions. I have a proven track record of delivering big data solutions for product growth, driving large-scale projects impacting thousands of users globally, and building and leading collaborative data engineering teams that influence stakeholder decisions and expand business capabilities. I’m optimistic, motivated, and energetic and looking for my next opportunity that will allow me to apply my people and technical skills and deliver outstanding results at my next engagement! TECHNICAL
LEAD - DATA ENGINEERING Nov 2021 - June 2023 TECHNOLOGY + INNOVATION LAB, ENBRIDGE INC.
STRENGTHS
? Experience in Microsoft Stack
? Coaching and mentoring
? Structured + Methodical
? Good at developing best practices, standardized process and managing + empowering large high performing teams.
? Technical design and solutions aligned to best Architecture.
? Liaison between business and IT - strong relationship + communication skills
? Dedicated team player
? Ability to multitask on projects and shift priorities to meet goals.
? Willingness to work hard to achieve employer objectives.
? Advanced problem-solving abilities.
? Quick learner
? Continuously learning, iterating and experimenting to keep abreast of latest practices and technology. CERTIFICATIONS Azure Fundamentals- AZ 900 Azure Data Fundamentals- DP 900 Azure AI Fundamentals - AI 900 EDUCATION Masters - Information Systems, Texas A&M University -Dec 07 Bachelor’s - Computer Science and Information Technology, Jawaharlal Nehru Technological University, April-06 DATA ENGINEER/TEAM LEAD Mar 2017- Oct 2021 ENBRIDGE INC.
? Engage with product teams, IT, and business leaders to align objectives, working closely with data scientists and analysts for data requirements. ? Engage in agile development processes, participating in sprint planning, daily standups, and retrospectives.
? Assist in maintaining databases, executing tasks like backups, indexing, and basic optimizations.
? Developing data solutions that employ Infrastructure as Code and Configuration as Code practices.
? Assisted with containerized deployments ARM Templates
? Handle raw data preprocessing, ensure ETL process integrity, and validate data outputs through testing.
? Develop and execute unit tests for data processes, ensuring accuracy and reliability.
? Ensure data solutions are optimized for performance and stay abreast of cuttingedge engineering practices.
? Utilize tools like Python, Spark SQL, Spark Streaming, and Spark ML Libraries for advanced data processing and analysis.
? Leverage Azure services, especially Azure Data Factory, Databricks, and Azure SQL Database, integrating tools like Pandas, PySpark, and Scala.
? Design predictive data models, leverage advanced data tools, and execute complex data processing.
? Optimize SPARK Databricks data pipelines and integrate Azure services for robust solutions.
? Support the DevOps team in building CI/CD pipelines and manage the release pipeline in Azure DevOps.
? Utilize tools like Power BI for reporting and managing CI/CD pipelines with tools like GIT and Azure DevOps.
? Guide and mentor junior data engineers, fostering a growth mindset.
? Showcase proficiency in both NoSQL (e.g., Cosmos DB) and SQL, mastering complex queries, ETL processes, and advanced data design methodologies.
? Contribute to the development of generic libraries, such as the open-source Great Exceptions data quality library, and models for data quality metrics.
? Collaborate with senior data engineers, taking a lead role in strategizing data approaches, and ensuring overall data strategy aligns with the company's objectives and deliverables.
? Experience in Source Control tools like GIT, TFS SR. BI DEVELOPER Mar 2013 - Feb 2017 SPECTRA ENERGY
? Collaborated with stakeholders to convert business requirements into Power BI insights using advanced DAX for efficient data retrieval.
? Created interactive Power BI reports and dashboards ensuring optimal performance.
? Developed comprehensive reports including drill-down, sub-reports, and trend analysis using SQL-BIDS and Crystal Reports.
? Transformed data from various sources into SQL and Oracle DB using SSIS for validation and error logging.
? Performed complex ad-hoc SQL queries and implemented complex PL/SQL process.
? Heavily involved in designing and modeling Data warehouse architecture -Star Schema
? Stayed updated with the latest Power BI technologies, implementing innovative solutions for evolving business needs. EXPERTISE
? DATABASES ? Microsoft SQL Server Azure/2019/17/16/12/08/05 ? ORACLE 10i/11i ? NoSQL DB – COSMOS
? AZURE CLOUD ? Azure Data Lake ? Azure Delta Tables ? Azure Blob Storage ? Azure DevOps ? Azure Data Factory ? Azure ML ? Azure Databricks ? Azure Synapse
? DATABRICKS ? Jupyter Notebooks ? Great Expectations ? Spark Sql ? PySpark ? Spark Streaming ? Spark ML Library
? DEV. LANGUAGES ? SQL ? PL/SQL ? PYTHON ? SCALA ? .NET - C# ? VB ? HTML/CSS/JAVASCRIPT ? DAX
? REPORTING / BI ? POWER BI ? SSRS ? CRYSTAL-REPORTS
? PRODUCTIVITY TOOLS ? SHARE POINT ? VISIO ? EXCEL ? POWERPOINT ? WORD
? DATA FORMATS: ? CSV ? XML/XSLT ? JSON ? PARQUET
? INTEGRATION TECHNOLOGY ? SONIC MQ ? WEB SERVICES ? SSIS
? GEOSPATIAL TOOLS ? ARC MAP (ESRI TOOLS) ? PODS DATA MODEL
? SOURCE CONTROL ? GIT ? TFS 2018//2012 ? VSS .NET DEVELOPER/BI DEVELOPER Jul 2008 - Feb 2013 SPECTRA ENERGY
? Leveraged ASP.NET MVC for web application development and implemented Web API services for seamless data exchange.
? Developed custom integration modules between different systems using C#, VB.net, XML, XSD and Sonic message queue.
? Utilized Entity Framework for ensuring data integrity and optimal performance.
? Worked using HTML/CSS/JavaScript to integrate responsive designs.
? Administrative experience in hosting web applications and services on IIS.
? Lead end-user training to technical and non-technical users
? Developed Reports using SSRS and crystal reports.
? Designed Database, tables, views, triggers and stored procedures, User defined functions, CTE's using SQL Server 2005/2008
? Manage all the source code and documentation with in TFS-Team Foundation Server JR. SOFTWARE DEVELOPER Oct 2007- Jun 2008 HEWLETT PACKARD - HP
? Used MS Visio for Process Diagrams, Class Diagrams, and Entity Relationship Models.
? Developed Windows Forms using C# .NET in converting Excel data into XML data.
? Developed logging mechanism, to track the file conversion and performed Unit Testing
? Collaborated with QA teams to align testing scenarios with business requirements.