• US Citizen

• Green Card

• EAD (OPT/CPT/GC/H4)

• H1B Work Permit

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 28th Jul 2022

Job Description:
As a WEB SCRAPING FOCUSED DATA ENGINEER, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role you will own the creation process of these tools, services, and workflows to improve crawl scrape analysis, reports and data management. We will rely on you to test the data and the scrape to insure accuracy and quality. You will own the process to identify and rectify any issues with breaks as well as scale scrapes as needed

Experience running large scale web scrapes
Solid Python knowledge
Familiarity with Linux UNIX, HTTP, HTML, Javascript and Networking
Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, pandas, map reduce, SQL, BeautifulSoup, etc).
Experience with system monitoring administration tools
Experience with version control, open source practices, and code review
Experience with applications designed to display archived web content
Great communication skills (written and Spoken in English)
Bachelor s Degree in Computer Science or a related field or the equivalent demonstrated experience