Tagcor

Required Skills

ETL Developer

Work Authorization

US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit

Preferred Employment

Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire

Employment Type

Consulting/Contract

education qualification

UG :- - Not Required
PG :- - Not Required

Other Information

No of position :- ( 1 )
Post :- 15th Jul 2023

JOB DETAIL

• Python deep knowledge(Lead Expert): Boto3, Multiprocessing, Classes
• UNIX deep knowledge in development and scripting
• API development using AWS
• Snowflake expertise
• Java Script (Snowflake SP)
• AWS: Lambda, Triggers, EC2, S3, CloudWatch, Security.
• Snowflake: SQL & Stored Procedures
• Airflow: Celery, MQRabbit, Postgress
• Unix-Linux: Shell Scripting, admin experience
• Experience building APIs

Looker
• Informatica
• Teradata

• 10 years of recent experience in data engineering and/or softwaredevelopment, ETL work
• A solid track record of data management showing your flawless execution andattention to detail.

•Programming experience,ideally in Python, Java Script and a willingness to learn new programminglanguages to meet goals and objectives.
• Knowledge of data cleaning, wrangling, visualization and reporting, with anunderstanding of the best, most efficient use of associated tools andapplications to complete these tasks.
• Good Understanding of Databases and Data warehouse tools

This role is ideal for an experienced engineer whohas a keen interest in working with large data sets to design and developclient facing platforms (measurement, attribution, reports, visualization, datafeeds, yield, audience creation) for the complex Media & Advertisingindustry.

Responsibilities
Responsiblefor driving the design and implementation of specific data models to drivebetter business decisions through insights from a combination of 3rd party and1st party data assets. Accountable for developing the necessary enablers anddata platform in a cloud Environment and has the responsibility of maintainingits integrity during the life cycle phases. Define data requirements, gatherand mine large scale of structured and unstructured data, and validate data byrunning various data tools.

Support the standardization, customization, and ad-hoc data analysis, and willdevelop the mechanisms to ingest, analyze, validate, normalize, and clean data.Develop and maintain data engineering best practices and contribute to Insightson data analytics and visualization concepts, methods, and techniques.

• Design and develop data applications using selected tools and frameworks asrequired and requested.
• Collaborate with Engineers and Business to build intuitive products thataddress the needs of our customers.
• Read, extract, transform, stage and load data to selected tools andframeworks as required and requested.
• Gather and process raw data at scale.
• Perform tasks such as writing scripts, web scraping, calling-writing APIs,write SQL queries, etc.
• Work closely with the engineering team to integrate your work into ourproduction systems.
• Process unstructured data into a form suitable for analysis. Analyzeprocessed data.
• Participate in design and code reviews to ensure the quality of the productswe deliver.
• Mentor more junior engineers on designing robust applications andimplementing maintainable code.
• Establish a good working rapport with Development group, System Engineers,Quality Assurance/Testers, and Business users
• Develop scripts or workflows to facilitate complex ingress processes
• Design Participate in Daily Scrum calls as well as quarterly sprint planningsessions to support development efforts
• Willing to coordinate an offshore team (different time zone).

Need for ‘gurus’ in Python and UNIX, inaddition to the other listed required skills. Understanding in depth Pythonlike memory management (RAM level), Python to AWS locking, running Python withAWS Lambda, virtual environments, containers. UNIX exposure to deep commandsand scripting like arch, filters and socket manipulation.