Tutorials, comparisons,
engineering notes.
How we build scrapers, what we learn shipping them, and how to use them in your pipelines.
Pull the Top 100 Best Sellers for Every Amazon Subcategory in One Run
Walk an Amazon department with Amazon Bestsellers Scraper and get the top 100 of every subcategory in one run, with a hard cap on lists and cost.
Benchmark LinkedIn Post Engagement Across Company Pages
Compare reactions and comments per post across LinkedIn company pages, scaled by follower count, with the LinkedIn Company Posts Scraper. No login.
Build a Labeled Image Dataset From Google Images Search Terms
Turn one search term per class into a labeled image manifest with Google Images Scraper: full size URLs, width, height and the source page to check.
Build a List of Funded Startups That Are Hiring on Wellfound
Turn Wellfound job listings into one row per startup with website, stage, total raised and latest round, using the Wellfound Jobs Scraper.
Compare an App's App Store Reviews Across Countries
Read one app's App Store reviews in many countries in one run with App Store Reviews Scraper, then compare ratings and top complaints country by country.
Compare Salary Bands in Lakhs by City and Experience on Foundit
Build a salary table for one role across Indian cities and experience bands from Foundit.in listings that publish pay, and drop the placeholder figures.
Compare Pay for a Role by Experience Level on Shine
Run one Shine.com search per experience band, keep the listings that show pay, and turn them into salary ranges in lakhs for each band.
Compare Startup Salary and Equity Ranges by Role on Wellfound
Pull Wellfound jobs for several roles and cities, then compute median salary and equity ranges per role with the Wellfound Jobs Scraper and Python.
Post a Daily Feed of New Tech Jobs to Slack or Telegram
Send each morning's new Hirist.tech jobs for your stack and cities to a Slack or Telegram channel, with repeats filtered out by job id, using Python.
Export Every Image and Caption From Instagram Carousel Posts
Export every slide image link, slide type and caption from Instagram carousel posts to a CSV, by profile or by post link, with Instagram Post Scraper.
Export a YouTube Video's Comments and Replies to CSV
Pull a YouTube video's comments and their replies into one CSV with YouTube Comments Scraper, each thread rebuilt from parent_comment_id.
Export a Creator's Instagram Reels With Play Counts to a Spreadsheet
Export one creator's reels with plays, likes, comments, length and audio to a CSV, then compute median plays to vet them, with Instagram Reel Scraper.
Find the Decision Makers at Your Target Accounts by Job Title
Turn a list of company domains into a CRM-ready CSV of people by job title, with LinkedIn URLs, labeled emails and a company check on every row.
Find Entry-Level AI and ML Jobs in Bangalore Posted This Week
Pull fresh AI and ML jobs for 0 to 2 years of experience from Hirist.tech, merge several searches and rank them by seniority and age with Python.
Find the Highest-Reach TikTok Ads in Any EU Country
Rank the TikTok ads that reached the most people in an EU country over any date range, with per-country reach, using the TikTok Ads Library Scraper.
Find Paid Partnership Posts on Any Instagram Profile
List the paid partnership and branded posts on any public Instagram profile, and the brands behind them, using Instagram Post Scraper and Python.
Find the Skills Employers Ask for Most in a Role on Foundit
Count the skill tags on Foundit.in (Monster India) jobs for one role and city, merge spelling variants, and rank skills by how many employers want them.
Map Which Companies Are Hiring for a Tech Stack Across Indian Cities
Turn Hirist.tech job listings into a table of employers by city for one tech stack, with job counts, ratings and top skills, using Python.