Job Title

Job Responsibilities: Develop and maintain web scraping scripts using Javascript, Python and Selenium to extract data from websites and APIs Understanding requirement of customer needs, identify source and scrape/collect data. Writing efficient, reusable, testable, and testing scalable code. Build code that is easily readable, properly documented, and follows key coding standards. Use Brightdata, Beautiful Soup, Selenium and other scraping tools to clean and process data for analysis Research and learn new technologies to design code reviews and application enhancements/ upgrades Performance tuning and automation of application. Maintain communication with corporate clients, Coordination with team and management. Coordinating with development teams to determine application requirements. Prioritized daily workflows, including all projects and taskExperience: 3 years in web scraping to develop and maintain web scraping solutions Proficiency with Javascript, Python, Brightdata, Selenium and Beautiful Soup Depth knowledge of Operators, Datatypes, Casting, Methods, Conditions, Loops, Functions, Arrays, OOPS concept, iterators, Modules and Python Strong understanding of web scraping techniques and best practices HTML, CSS, XPATH, Regex and HTML DOM Knowledge of Libraries like Selenium, Requests, Scrappy, BeautifulSoup, NumPy, Pandas. Good hands-on experience in Python languages and debugging with GDB File Format: JSON, XML, Excel, CSV Development Tools: Microsoft Visual Studio, Visual Code Experience with data storage and retrieval in AWS S3. Knowledge of serverless architecture using AWS Lambda.