We are looking to fill a Lead data engineer contractor position for US to support an upcoming project. The required skillsets are as below. Can you please assist identifying suitable profiles for review. We are looking to fill this in ASAP. Please let me know for any questions.
Sr. /Lead Data Engineer:
- Strong data knowledge on Asset Management
- Develop ingestion pipelines to consume data from various sources – structured and unstructured
- Design and develop the data services and reusable data frameworks for Investment Product data to enable easy access for all the consuming platforms
- Design and implementation of highly complex data solution(s) end-to-end from ingestion to curation to development of the operational & analytical areas of a data platform
- Play a key role in architecting the integrated data platform solutions
- Co-ordinate with other internal IT teams to release code changes and as needed to resolve system / technical issues for the team
- This role will be leaned on as a subject matter-expert when it comes to all-things on the investment product data
- This role will be able to balance multiple initiatives with fast iteration and coordinate with the rest of the team. Therefore, a commitment to collaborative problem solving is very important
- Work closely with key stakeholders to understand use cases, design solutions and lead from inception to production
- Collaborate with various user experience channels enabling enhanced data consumption experience.
- Must have good experience and working knowledge with –
- Data engineering solutions on AWS Cloud platform
- Databases like Oracle, MY-SQL, and Snowflake (must)
- Must have good working knowledge on AWS Glue
- Programming using Python, PySpark
- Building APIs (XML & JSON structures) AWS API gateway.