Tutorials, comparisons,
engineering notes.
How we build scrapers, what we learn shipping them, and how to use them in your pipelines.
GitHub Repo Intelligence: Vet Any Dependency Before You Add It
Pull stars, forks, contributors, commit recency, latest release and full README for any public GitHub repo in one call. No token required, MCP-ready for agents doing dependency checks.
Bilibili Scraper: Video, Creator and Search Data in Python
Pull Bilibili videos by keyword, URL or creator ID: titles, view and like counts, duration, author stats. Plain HTTP, no cookies, no login required.
Bundesanzeiger Scraper: German Company Filings Without a Data Subscription
Pull German company filings from the Bundesanzeiger by name: annual accounts, insolvency proceedings, ad hoc disclosures and voting rights notices. No login, no API key.
SEEK Jobs Scraper: Australian Job Listings in Python
How to pull SEEK.com.au job listings by keyword, location, work type and salary band in Python: title, company, salary range, apply link, no login or API key.
Find Any US Importer's Overseas Suppliers From Customs Records
US customs bill of lading records name who ships to whom. How to pull an importer's overseas suppliers, shipment volumes and HTS codes without a trade data subscription.
Weibo Scraper: Posts and Profiles by User ID
Pull Weibo posts and profile data by numeric user ID: text, repost and like counts, images, follower stats. Why a China residential IP is mandatory, not optional.
Amazon vs AliExpress Product Scraper: Which One for Sourcing and Price Tracking
Amazon and AliExpress both return price, rating, and demand signal from a keyword search, but they answer different sourcing questions and one costs 2.5x the other. What each returns, and where Shopify Store Scraper fits a job neither of them does.
B2B Lead Generation Tools Compared: Maps Leads vs B2B Leads Finder vs Website Contact Finder
Four actors covering B2B contact discovery, extraction, and validation. Different email sourcing methods, different verification depth, different jobs. A field-by-field comparison of what each actually returns.
LinkedIn Scraping Tools Compared: Which Actor for Which Job
Five LinkedIn actors covering companies, employees, profiles, jobs, and posts. They are not competing for the same query, they are five stages of one sourcing pipeline. A field-by-field look at what each returns and how they chain together.
MagicBricks vs 99acres vs Housing.com vs NoBroker: Which India Property Data Source to Scrape
MagicBricks, 99acres, Housing.com and NoBroker all cover Indian real estate, but three overlap and one is a structurally different market. A field-by-field comparison of coverage, RERA data, coordinates, and access method.
Naukri vs Instahyre vs Hirist vs Shine: Which Indian Job Board API for Sourcing
Naukri, Instahyre, Hirist, Shine, CutShort and Foundit all cover Indian tech and corporate hiring, but none of them overlap the way they look like they should. A field-by-field comparison of access method, salary coverage, and pricing.
Amazon Retail Price vs AliExpress Supplier Cost: The Sourcing Check in One Call
Before you sell a product, you want to know what it costs to source. Here is how to pull an Amazon listing's retail price and reviews against real AliExpress supplier prices in a single call, and what the spread actually tells you.
Federal Contracts, Campaign Finance & UK Company Records as Structured JSON (No Login)
Three official government data sources, SAM.gov contract opportunities, FEC campaign finance, and UK Companies House, turned into clean JSON APIs for GovCon capture, compliance, and political research. No browser, no login, pay only for results delivered.
Five Scholarly Databases in One Call: OpenAlex, Crossref, arXiv, PubMed and OpenCitations
A literature scan means five sources with five query languages and five response shapes. Here is how to pull published works, canonical metadata, preprints, biomedical hits and a citation graph for one topic in a single call, and which source to trust for what.
How to Scrape CutShort Jobs for India Tech Hiring Data (No API)
CutShort is where Indian startups post engineering and product roles, and it has no public jobs API. Learn how to extract titles, companies, salary ranges, skills, and experience bands as structured JSON for recruiting feeds and talent market research.
Zestimate vs Redfin Estimate: Which Home Value Is More Accurate?
Redfin publishes a 1.85% median error rate on listed homes. What that hides, why Zestimate and Redfin Estimate disagree, and how to test accuracy in your own ZIP.
Best Threads Scrapers Compared (2026): Prices, Success Rates, and What Each One Misses
Eight Threads scrapers on the Apify Store compared with public data: price per 1,000 posts, start fees, run success, ratings, and modes. Including where ours is not the right pick.
Reddit Data for Market Research After the API Changes: What Still Works in 2026
Reddit locked down its API: enterprise-only commercial access, no self-serve pricing, and the old .json endpoints gone. Here are the working options for market research teams, with honest costs.