logo

Scraping Project Manager – Web Data Operations

LIVETREND
Décryptage du poste par Postule AI

About Livetrend

Livetrend is a B2B SaaS company in the fashion-tech space that transforms large volumes of market data into actionable insights, helping brands make better decisions and reduce waste. Data is at the core of both the product and this role.

The Role

We are hiring a Scraping Project Manager to run our scraping operations (~400 web scrapers in production daily). This is a hands-on, senior role focused on technical ownership and decision-making—not ticket coordination or people management. You will specify requirements, challenge deliverables, review junior engineers' code, and contribute code yourself when needed.

Main Responsibilities

  • Own scraping projects end-to-end in production, from specification through deliverable validation
  • Make technical decisions: select approaches for each site, articulate costs and trade-offs
  • Challenge deliverables and guarantee quality by reviewing and verifying code
  • Review code from junior engineers and raise the standard of shipped work
  • Manage and optimize a proxy mix (datacenter, residential, mobile, unlocker) for each site's constraints
  • Size scraper throughput according to targets and technical constraints, tracking and optimizing cost per site
  • Handle complex scraping challenges: CDN interception, aggressive anti-bot protection, closed APIs, mobile/residential IP management, and large catalogs

Technical Stack

Python and Scrapy (running on Zyte), Playwright and Camoufox for harder targets. You should be comfortable in this stack; deep expertise in every tool is not required.

Required Qualifications

  • ~2 years of hands-on experience running scraping in production
  • Proven experience managing a proxy mix (datacenter, residential, mobile, unlocker)
  • Experience with throughput sizing and cost-per-site tracking
  • At least 1 year tackling complex challenges: CDN bypassing, large retailers with anti-bot protection, closed catalog APIs, mobile/residential IP work, large catalogs
  • Ability to specify requirements, challenge deliverables, and write Python code
  • Comfortable reviewing code and providing direct, constructive feedback
  • Professional working proficiency in English

What We Offer

  • Fully remote position with a small, focused team
  • Permanent contract (CDI)
  • English as the working language

Cette description d'emploi a pu être reformatée par Postule pour améliorer sa lisibilité et sa présentation. Le contenu et les informations restent fidèles à l'offre d'emploi originale. .