• US Citizen

• Green Card

• EAD (OPT/CPT/GC/H4)

• H1B Work Permit

• Corp-Corp

• W2-Permanent

• W2-Contract

• Contract to Hire

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 15th Apr 2023

This role is ideal for an experienced engineer who has a keen interest in working with large data sets to design and develop client facing platforms (measurement, attribution, reports, visualization, data feeds, yield, audience creation) for the complex Media & Advertising industry.

Responsibilities:

Responsible for driving the design and implementation of specific data models to drive better business decisions through insights from a combination of 3rd party and 1st party data assets. Accountable for developing the necessary enablers and data platform in a cloud Environment and has the responsibility of maintaining its integrity during the life cycle phases. Define data requirements, gather and mine large scale of structured and unstructured data, and validate data by running various data tools.

Support the standardization, customization, and ad-hoc data analysis, and will develop the mechanisms to ingest, analyze, validate, normalize, and clean data. Develop and maintain data engineering best practices and contribute to Insights on data analytics and visualization concepts, methods, and techniques.

• Design and develop data applications using selected tools and frameworks as required and requested.
• Collaborate with Engineers and Business to build intuitive products that address the needs of our customers.
• Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
• Gather and process raw data at scale.
• Perform tasks such as writing scripts, web scraping, calling-writing APIs, write SQL queries, etc.
• Work closely with the engineering team to integrate your work into our production systems.
• Process unstructured data into a form suitable for analysis. Analyze processed data.
• Participate in design and code reviews to ensure the quality of the products we deliver.
• Mentor more junior engineers on designing robust applications and implementing maintainable code.
• Establish a good working rapport with Development group, System Engineers, Quality Assurance/Testers, and Business users
• Develop scripts or workflows to facilitate complex ingress processes
• Design Participate in Daily Scrum calls as well as quarterly sprint planning sessions to support development efforts
• Willing to coordinate an offshore team (different time zone).

Mandatory Skills Description:

• 10 + years of recent experience in data engineering and/or software development, ETL work
• A solid track record of data management showing your flawless execution and attention to detail.
• Programming experience, ideally in Python, Java Script and a willingness to learn new programming languages to meet goals and objectives.
• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
• Good Understanding of Databases and Datawarehouse tools
• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
• A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.

Must be an expert:
• Python: Boto3, Multiprocessing, Classes
• Java Script (Snowflake SP)
• AWS: Lambda, Triggers, EC2, S3, CloudWatch, Security.
• Snowflake: SQL & Stored Procedures
• Airflow: Celery, MQRabbit, Postgress
• Unix-Linux: Shell Scripting, admin experience
• Experience building APIs

Nice-to-Have Skills:

Good to know:
• Looker
• Informatica
• Teradata