Impress employers and recruiters.
Choose from hundreds of resume examples.

Target Resume Now

About the Role

Mindrift is seeking highly skilled Senior Python Data Scraping Engineers for the Tendem project to drive specialized data scraping workflows within a hybrid AI + human system. In this AI Pilot role, you will collaborate with Tendem Agents on repetitive tasks, providing critical thinking, domain expertise, and quality control for accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction, and processing.

Responsibilities

Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets.
Leverage internal tools (Apify, OpenRouter) and custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements.
Ensure reliable extraction from dynamic and interactive web sources, adapting approaches for JavaScript-rendered content and changing site behavior.
Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification.
Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes.

Requirements

5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong technical foundation and practical experience with scripting, automation, and AI-assisted workflows.
Ability to solve non-trivial problems.
Ability to work confidently with LLMs.
Ability to systematically collect, structure, and validate data from diverse sources.
Methodical, detail-oriented approach.
Ability to work independently.
Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML).
Solid background in data cleaning, normalization, and validation, delivering structured datasets.
Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
Strong attention to detail and commitment to data accuracy.
Self-directed work ethic with ability to troubleshoot independently.
English proficiency: Upper-intermediate (B2) or above.
Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields (plus).
A link to GitHub (plus).

Skills

Python web scraping (BeautifulSoup, Selenium or similar)
Dynamic content extraction (JS, AJAX, infinite scroll)
API usage for data extraction
Data cleaning
Data normalization
Data validation
Structured datasets (CSV, JSON, Google Sheets)
Cloud infrastructure (AWS or equivalent)
Containerization (Docker)
LLM frameworks (LangChain, OpenRouter, or similar)

Location

Remote

Work Type

Part-time
Freelance

Experience Level

Senior
5+ years of relevant experience

Education Level

Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields (plus)

Salary/Compensations

Up to $45 per hour equivalent

About the Company

Mindrift connects specialists with AI projects from major tech innovators.
Mindrift's mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.
This role is for the Tendem project, handling data scraping tasks requiring technical precision for web extraction and processing, utilizing tools like Apify and OpenRouter.