Responsibilities:
Skills
Requirement
Experience
Snowflake Stored Procs (Using JS)
Must Have
Azure Data Factory
Must Have
ETL/Data warehouse
Must Have
Azure ARM Template Deployment (CI/CD)
Nice to have
Azure Logic Apps
Nice to have
Healthcare Experience
Nice to have
Position Summary
- Top level data expert whose primary job responsibilities involve preparing data for analytical or operational uses.
- Commonly deals with both structured and unstructured data sets – as a result, they must be versed in different approaches to data architecture and applications.
- Please add more points about Snowflake, ETL/Warehouse and Azure Data Factory in the resume so that profile will fly easily
- Must be comfortable with a wide array of technologies and programming languages.
- Must possess knowledge of and skills in all of the following: Building and designing large-scale applications, database architecture and data warehousing.
- Must possess a deep knowledge of the cloud-based platform ecosystems and the tools that can transfer data to a big data platform or address stream processing.
- Mainly responsible for using data to identify efficiencies, problem areas, and possible improvements.
- The Sr. Data Engineer will also need to ensure that the architecture that is in place supports the requirements of the data scientists and the stakeholders.
- Discover opportunities for data acquisition.
- Develop data set processes for data modeling, mining and production.
Experience Requirements
- 5+ years of experience as a data engineer or in a similar role
- 5+ years of cloud-based data architecture and/or engineering
- 5+ years of experience designing, developing and maintaining ETL and ELT processes
- 5+ years working with healthcare systems analysis/programming preferred
- 5+ years of data lake/enterprise data warehouse experience
- Experience with several querying languages, schema definition languages, and scripting languages
- Experience with writing and optimizing SQL queries in a business environment with large-scale, complex data sets
- Experience with working with large data sets, data warehouse technical architecture, infrastructure components, ETL, and reporting/analytic tools and environments
- Strong knowledge of various data warehousing methodologies and data modeling concepts. Hands on modelling experience is highly desired
- Knowledge of professional software engineering practices for the full software development lifecycle, including coding standards, code reviews, source control management, build processes, testing and operations
Essential Functions
- Design, implement, and automate deployment of our distributed system for collecting and processing log events from multiple sources
- Design data schema and operate internal data warehouses and SQL database systems
- Own the design, development and maintenance of ongoing metrics, reports, analyses, and dashboards to drive key business decisions.
- Monitor and troubleshoot operational or data issues in the data pipelines.
- Drive architectural plans and implementation for future data storage, reporting, and analytic solutions.
- Work collaboratively with business analysts, data scientists, and other internal partners to identify opportunities/problems.
- Provide assistance to the team with troubleshooting, researching the root cause, and thoroughly resolving defects in the event of an error.