Senior Web Scraping Engineer at Wellist

At Wellist, we are a mission-driven digital health organization dedicated to providing effective consumer navigation at scale. Our flagship product, the Wellist Directory, serves as a vital resource for patients and employees at leading health systems, such as Yale New Haven Health and HCA, as well as various corporate partners. By connecting individuals with the right services at the right time, we help reduce costs and improve strategic engagement. We are proud to be recognized for our innovation by organizations including Fast Company, MassTLC, and the American Business Awards. We are currently looking for a Senior Web Scraping Engineer to join our professional engineering team in Boston, MA, to take ownership of the data acquisition operations that power our directory.

Key outcomes

• Design, develop, and refine automated code to extract data from diverse online sources with high reliability.
• Manage complex data retrieval challenges, including pagination and dynamic content loaded via AJAX or JavaScript.
• Standardize and clean extracted data to ensure it meets our rigorous quality and structural requirements.
• Architect efficient storage solutions that prioritize data integrity and rapid access.
• Oversee the continuous monitoring of scraping processes to identify and resolve technical obstacles.
• Collaborate closely with our product and engineering teams to ensure the data we provide remains relevant and impactful for our users.

Requirements

• Proven expertise in extracting data from complex websites with minimal supervision.
• Strong proficiency in Python and JavaScript, including hands-on experience with tools like BeautifulSoup, Scrapy, and Selenium.
• Solid understanding of asynchronous programming, multithreading, and distributed scraping techniques.
• Comprehensive knowledge of HTML, CSS, and the DOM.
• Experience in designing storage solutions and managing large-scale data integrity.
• Ability to work on-site in Boston, MA.
• Fluency in English.

Preferred qualifications

• Experience applying machine learning algorithms for predictive analysis, data cleaning, or categorization.
• Demonstrated ability to leverage AI-based platforms, such as OpenAI, in past projects.
• Familiarity with cloud services, particularly AWS, for deploying and scaling scraping infrastructure.

Compensation

We offer a comprehensive benefits package designed to support our team members. This includes:

• Medical and dental insurance coverage.
• Life and disability insurance.
• A 401k retirement plan.
• Paid time off.

How to apply

If you are interested in joining a mission-driven team and making a tangible difference for patients and families, we invite you to apply. We look forward to reviewing your experience and discussing how you can contribute to our growing healthcare startup.