WEB SCRAPING & DATA MINING.
I build Python scrapers that collect public data from websites and turn it into clean, structured files or databases you can use straight away, from a one-time extract to scheduled daily runs.
WHAT I DO
Website and listing scraping
Product catalogues, prices, directories, property and job listings, reviews and other public pages, including sites that load content with JavaScript.
Scheduled scraping and monitoring
Scrapers that run daily or hourly, track changes such as price drops or new listings, and alert you or update a sheet.
Data mining and cleaning
Deduplicating, normalising and enriching scraped records, then finding patterns, trends and outliers in the result.
Delivery in your format
Excel, CSV, JSON, Google Sheets, a PostgreSQL database or an API endpoint, whatever fits your workflow.
TOOLS I USE
- Python
- Scrapy
- Playwright
- Selenium
- BeautifulSoup
- Requests
- Pandas
- PostgreSQL
TYPICAL PROJECTS
- Tracking competitor prices across e-commerce sites every day
- Building a lead list from public business directories
- Collecting property, job or classified listings into a spreadsheet
- Alerting you when a product comes back in stock or a price drops
HOW IT WORKS
- 01
Brief
Send what you need and any sample files or links. I reply by email with any questions.
- 02
Quote
You get a clear scope, timeline and fixed price, or an hourly estimate for open-ended work.
- 03
Build
I work in small steps and share progress, so you can correct course early instead of at the end.
- 04
Deliver
You receive the working result, the source code or files, and a short handover so you can run it yourself.
QUESTIONS
- Which websites can you scrape?
- Most public websites. I only collect publicly available data, respect each site's terms and rate limits, and will tell you up front if a target is not a good idea.
- Can you scrape sites that need JavaScript or a login?
- Yes. Dynamic pages are handled with a headless browser such as Playwright. Logged-in scraping is possible for accounts you own and are permitted to automate.
- What happens when the website changes?
- Scrapers are built to fail loudly rather than return bad data, and maintenance plans cover updating them when a site's layout changes.
- How long does a project take?
- Small scripts and cleanups often take a few days. Larger builds take a few weeks. You get a timeline in the quote, after I have seen your requirements.
- What do I need to share to get a quote?
- A short description of the goal, any sample files, spreadsheets or website links, and your deadline. Rough notes are fine. I will ask for anything missing.
START A PROJECT.
Remote work for clients across India and worldwide. Send a brief and I’ll reply by email.
RELATED SERVICES
- Data Processing & AnalysisTurn scraped records into clean datasets, reports and dashboards.
- Python AutomationSchedule scrapers and push their results into your sheets and systems.
- Data Entry & ExcelGet scraped data delivered as organised, formatted Excel workbooks.