Skip to main content
SERVICE // 02

WEB SCRAPING & DATA MINING.

I build Python scrapers that collect public data from websites and turn it into clean, structured files or databases you can use straight away, from a one-time extract to scheduled daily runs.

WHAT I DO

01

Website and listing scraping

Product catalogues, prices, directories, property and job listings, reviews and other public pages, including sites that load content with JavaScript.

02

Scheduled scraping and monitoring

Scrapers that run daily or hourly, track changes such as price drops or new listings, and alert you or update a sheet.

03

Data mining and cleaning

Deduplicating, normalising and enriching scraped records, then finding patterns, trends and outliers in the result.

04

Delivery in your format

Excel, CSV, JSON, Google Sheets, a PostgreSQL database or an API endpoint, whatever fits your workflow.

TOOLS I USE

  • Python
  • Scrapy
  • Playwright
  • Selenium
  • BeautifulSoup
  • Requests
  • Pandas
  • PostgreSQL

TYPICAL PROJECTS

  • Tracking competitor prices across e-commerce sites every day
  • Building a lead list from public business directories
  • Collecting property, job or classified listings into a spreadsheet
  • Alerting you when a product comes back in stock or a price drops

HOW IT WORKS

  1. 01

    Brief

    Send what you need and any sample files or links. I reply by email with any questions.

  2. 02

    Quote

    You get a clear scope, timeline and fixed price, or an hourly estimate for open-ended work.

  3. 03

    Build

    I work in small steps and share progress, so you can correct course early instead of at the end.

  4. 04

    Deliver

    You receive the working result, the source code or files, and a short handover so you can run it yourself.

QUESTIONS

Which websites can you scrape?
Most public websites. I only collect publicly available data, respect each site's terms and rate limits, and will tell you up front if a target is not a good idea.
Can you scrape sites that need JavaScript or a login?
Yes. Dynamic pages are handled with a headless browser such as Playwright. Logged-in scraping is possible for accounts you own and are permitted to automate.
What happens when the website changes?
Scrapers are built to fail loudly rather than return bad data, and maintenance plans cover updating them when a site's layout changes.
How long does a project take?
Small scripts and cleanups often take a few days. Larger builds take a few weeks. You get a timeline in the quote, after I have seen your requirements.
What do I need to share to get a quote?
A short description of the goal, any sample files, spreadsheets or website links, and your deadline. Rough notes are fine. I will ask for anything missing.

START A PROJECT.

Remote work for clients across India and worldwide. Send a brief and I’ll reply by email.

GET IN TOUCH
ALL SERVICES