# The Mine Works

> Production-grade web scrapers and data APIs on the Apify Store. Pay-per-result billing. Failed and empty results are never charged. AI-native structured JSON output.

The Mine Works builds and maintains a portfolio of web scrapers and structured data APIs on Apify. All actors use pay-per-event (PPE) billing. Users pay per result delivered, plus a small start fee per run on most actors. Failed and empty results are never charged. Output is MCP-compatible and RAG-ready structured JSON.

## What we build

Web scrapers targeting specific data sources where the dominant alternative is unreliable, overpriced, or non-existent. Each actor targets a gap in the market.

## Live scrapers

- Reddit Scraper | https://themineworks.com/actors/reddit-scraper/ | Pay-per-result Reddit posts and full nested comment trees. No API key required.
- RAG Crawler | https://themineworks.com/actors/rag-crawler/ | Converts any website to chunked, token-counted markdown for RAG pipelines. Firecrawl alternative.
- Google Trends Pro | https://themineworks.com/actors/google-trends-pro/ | Reliable Google Trends data on cloud servers. pytrends alternative.
- ATS Jobs Scraper | https://themineworks.com/actors/ats-jobs/ | Greenhouse, Lever, and Ashby job board data via public APIs. No auth required.
- SEC EDGAR Filings | https://themineworks.com/actors/sec-edgar-filings/ | 10-K, 10-Q, 8-K filings as structured JSON. RAG-ready.
- Threads Scraper | https://themineworks.com/actors/threads-scraper/ | Meta Threads profiles and posts. No official API exists.
- Instagram Profile Scraper | https://themineworks.com/actors/instagram-profile-scraper/ | Public Instagram profile data and post metadata. No API key required.
- CourtListener Scraper | https://themineworks.com/actors/courtlistener-court-records/ | US court opinions, dockets, and case law.
- USAspending Federal Awards | https://themineworks.com/actors/usaspending-federal-awards/ | US federal contracts, grants, and loans.
- ClinicalTrials Scraper | https://themineworks.com/actors/clinicaltrials-scraper/ | Clinical study data from ClinicalTrials.gov.
- FDA Recalls Scraper | https://themineworks.com/actors/fda-recalls-scraper/ | Drug, device, and food recall reports.
- Federal Register Scraper | https://themineworks.com/actors/federal-register-scraper/ | US rules, proposed rules, and executive orders.
- OpenAlex Scholarly Works | https://themineworks.com/actors/openalex-scholarly-works/ | 250M+ research papers and citations.
- Crossref Scraper | https://themineworks.com/actors/crossref-scholarly-metadata/ | 150M scholarly works and DOI metadata.
- World Bank Indicators | https://themineworks.com/actors/worldbank-indicators/ | GDP, inflation, and 1,400+ development indicators.
- Global Trade Data | https://themineworks.com/actors/global-trade-data/ | Import and export flows from World Bank WITS.
- India Gov Data | https://themineworks.com/actors/india-data-gov-scraper/ | Any dataset from India data.gov.in.
- Socrata Open Data | https://themineworks.com/actors/socrata-open-data/ | CDC, HHS, NYC, Texas, and 200+ Socrata portals.
- NPI Registry Scraper | https://themineworks.com/actors/npi-registry-healthcare/ | US healthcare provider NPI lookup from CMS.

## Recently added (August 2026)

- Skip Trace Lookup | https://themineworks.com/actors/skip-trace-lookup/ | Name or phone to current address, two public directories.
- LinkedIn Email Finder | https://themineworks.com/actors/linkedin-email-finder/ | Name plus company, SMTP-confirmed work email.
- Username Checker | https://themineworks.com/actors/username-checker/ | Verify a handle across 14 developer and creator platforms.
- Tech Stack Detector | https://themineworks.com/actors/tech-stack-detector/ | 19 verified CMS, framework, and CDN signatures, one request.
- Domain.com.au Property Scraper | https://themineworks.com/actors/domain-property-scraper/ | Domain.com.au listings by suburb: price, agent, and photos.
- realestate.com.au Scraper | https://themineworks.com/actors/realestate-com-au-scraper/ | realestate.com.au listings by suburb: buy, rent, and sold.
- Carsales.com.au Scraper | https://themineworks.com/actors/carsales-scraper/ | Carsales.com.au vehicle listings by make and model.
- SEEK Jobs Scraper | https://themineworks.com/actors/seek-jobs-scraper/ | Australian job listings by keyword, location and salary.
- Threads Profile Scraper | https://themineworks.com/actors/threads-profile-scraper/ | Every public post from a Threads profile, by username.
- Threads Hashtag Scraper | https://themineworks.com/actors/threads-hashtag-scraper/ | Threads posts by hashtag, with a standing tag watch.
- Threads Search Scraper | https://themineworks.com/actors/threads-search-scraper/ | Threads posts by keyword, with a standing brand watch.
- Bilibili Scraper | https://themineworks.com/actors/bilibili-scraper/ | Bilibili videos, creators and keyword search.
- Weibo Scraper | https://themineworks.com/actors/weibo-scraper/ | Weibo posts and profiles by user ID.
- Semrush Authority Score Scraper | https://themineworks.com/actors/semrush-scraper/ | Authority score, backlinks, and traffic, no Semrush account.
- Similarweb Scraper | https://themineworks.com/actors/similarweb-scraper/ | Website traffic, rank, and channel mix, no Similarweb login.
- Backlink Building Agent | https://themineworks.com/actors/backlink-building-agent/ | 3-stage pipeline: discover, contact, draft. Pay per outcome.
- Google Ads Transparency Scraper | https://themineworks.com/actors/google-ads-transparency/ | Every ad a domain runs, from the public Ads Transparency Center.
- Zillow ZIP Code Bulk Search Scraper | https://themineworks.com/actors/zillow-zip-bulk-search/ | Zillow listings across dozens of ZIP codes in one run.
- Zillow Photos Scraper | https://themineworks.com/actors/zillow-photos/ | Full resolution photos from any Zillow listing.
- Zillow Agent & Broker Leads Scraper | https://themineworks.com/actors/zillow-agent-leads/ | Real estate agents and brokers, sourced from live Zillow listings.
- Kleinanzeigen Scraper | https://themineworks.com/actors/kleinanzeigen-scraper/ | German classifieds listings: price, location, and postal code.
- Bundesanzeiger Monitor | https://themineworks.com/actors/germany-bundesanzeiger-monitor/ | German company filings straight from the federal gazette.
- GST Taxpayer Lookup | https://themineworks.com/actors/gst-taxpayer-lookup/ | Verify any Indian GSTIN against the official GST portal.
- Y Combinator Scraper | https://themineworks.com/actors/y-combinator-scraper/ | 6,100+ YC startups with founder LinkedIn, no API.
- Healthcare Provider Intelligence | https://themineworks.com/actors/healthcare-provider-intelligence/ | NPI identity, pharma payments, and Rx volume, one row.
- ASO Keyword Rank Tracker | https://themineworks.com/actors/aso-keyword-rank-tracker/ | App Store and Google Play rank tracking, one dataset.
- App Review Monitor | https://themineworks.com/actors/app-reviews-monitor/ | App Store and Google Play reviews, past the 500-review cap.
- Building Permits Scraper | https://themineworks.com/actors/building-permits-construction-leads/ | Contractor leads from 12 city building permit portals.
- Podcast Episode Scraper | https://themineworks.com/actors/podcast-episode-scraper/ | RSS feed to episode metadata, audio URLs, and transcripts.
- Substack Scraper | https://themineworks.com/actors/substack-scraper/ | Newsletter archives, full text, reactions, and paywall status.
- Telegram Channel Scraper | https://themineworks.com/actors/telegram-channel-scraper/ | Public channel posts, view counts, and links, no login.
- Pinterest Search Scraper | https://themineworks.com/actors/pinterest-search-scraper/ | Keyword to pins: image, save count, board, and destination link.
- Reddit Search Scraper | https://themineworks.com/actors/reddit-search-scraper/ | Keyword monitor across all subreddits.
- Tennis Match & Player Data Scraper | https://themineworks.com/actors/tennis-match-data/ | ATP and WTA match results with serve and return stats.
- Instagram Followers & Following Scraper | https://themineworks.com/actors/instagram-followers-scraper/ | Real follower/following lists, not just counts.
- US Import Supplier Intelligence | https://themineworks.com/actors/us-import-supplier-intelligence/ | Find any US importer's supplier network from shipment records.
- 2GIS Scraper | https://themineworks.com/actors/2gis-places-search/ | Business listings across Russia, Central Asia, Cyprus and the UAE.
- Domain to LinkedIn Resolver | https://themineworks.com/actors/domain-to-linkedin-resolver/ | Resolve a company domain to its LinkedIn company page, homepage-first.
- Company Domain Finder | https://themineworks.com/actors/company-domain-finder/ | Resolve a company name to its official website, not the first search result.
- Telegram Channel Finder | https://themineworks.com/actors/telegram-channel-finder/ | Discover public Telegram channels matching any keyword.
- LinkedIn Newsletter Scraper | https://themineworks.com/actors/linkedin-newsletter-scraper/ | Discover public LinkedIn newsletters matching a keyword.
- Xiaohongshu (RED) Scraper | https://themineworks.com/actors/xiaohongshu-explore-scraper/ | Discovery feeds and creator profiles from Xiaohongshu / RedNote.
- eBay Search Scraper | https://themineworks.com/actors/ebay-search-scraper/ | eBay listings across 8 sites: price, condition, seller feedback.
- Ozon Product Search | https://themineworks.com/actors/ozon-product-search/ | Russia's largest marketplace: price, discount, rating by keyword.
- Etsy Search Scraper | https://themineworks.com/actors/etsy-search-scraper/ | Handmade and vintage marketplace listings by keyword.
- Yandex Maps Scraper | https://themineworks.com/actors/yandex-maps-search/ | Business listings across Russia and the CIS: phone, rating, hours.

## MCP servers

The Mine Works publishes Model Context Protocol (MCP) servers that expose our scrapers as tools any AI agent can call directly (Claude Desktop, Claude Code, Cursor, Windsurf, ChatGPT, and any MCP-compatible client). Each server groups related tools behind one endpoint, so an agent connects once instead of wiring up a dozen separate scrapers.

Nine domain-specific servers, each on the Apify Store:

- Company Diligence MCP | https://themineworks.com/actors/company-diligence-mcp/ | Official-registry company diligence for AI agents, 13 tools behind one endpoint. SEC EDGAR, court records, federal awards, LEI, VAT, US state registries.
- Social Research MCP | https://themineworks.com/actors/social-research-mcp/ | Reddit, X, Threads, LinkedIn, YouTube, News, and Google Trends behind one MCP endpoint.
- Recruiting & Jobs MCP | https://themineworks.com/actors/recruiting-jobs-mcp/ | ATS postings, LinkedIn, Indeed, and candidate sourcing in one MCP server.
- Real Estate MCP | https://themineworks.com/actors/real-estate-mcp/ | Zillow, Redfin, Realtor and Airbnb property data in one MCP server.
- Lead Generation MCP | https://themineworks.com/actors/lead-generation-mcp/ | Verified-email B2B leads, local leads, and reputation checks in one MCP server.
- E-commerce Intel MCP | https://themineworks.com/actors/ecommerce-intel-mcp/ | Amazon, Shopify, TikTok Shop, and Meta Ad Library behind one MCP endpoint.
- Academic Research MCP | https://themineworks.com/actors/academic-research-mcp/ | OpenAlex, Crossref, arXiv, OpenCitations, and PubMed behind one MCP endpoint.
- India Jobs MCP | https://themineworks.com/actors/india-jobs-mcp/ | Naukri and 8 more India job boards, plus LinkedIn candidate sourcing.
- India Real Estate MCP | https://themineworks.com/actors/india-real-estate-mcp/ | 99acres, MagicBricks, NoBroker, and Housing.com in one MCP server.

How to connect:

- Any single actor as a tool: https://mcp.apify.com/?tools=themineworks/<actor-name>
- A whole server: https://mcp.apify.com/?tools=themineworks/<server-name> (e.g. themineworks/company-diligence-mcp)
- Docs and one-click client config: https://themineworks.com/mcp/
- All servers are also listed in the official MCP registry as com.themineworks/<server-name>

Example: ask your agent "check out this company before I sign" and Company Diligence MCP pulls filings, litigation and registry records in one call; or "what are people saying about X on Reddit and Threads this week" and Social Research MCP handles both. Billing is pay-per-result, so a tool call that returns nothing is never charged.

## Pricing model

Pay-per-event (PPE). No monthly fee. 25 free results included per actor. Failed and empty results are never charged. All 149 actors (as of September 2026) are on the Apify Store. Full catalogue: https://themineworks.com/actors/

## Technical output

All actors return structured JSON. Output is MCP-compatible (Model Context Protocol) for direct use by AI agents. RAG-ready for LangChain, LlamaIndex, and vector databases.

## Blog

Tutorials, comparisons, and engineering guides: https://themineworks.com/blog/

### Tutorials
- How to Aggregate Job Postings from 500+ Companies Using Public ATS APIs | https://themineworks.com/blog/aggregate-job-postings-ats-api/
- The Agentic Data Stack 2025: How to Pick the Right Scrapers for Your AI Workflow | https://themineworks.com/blog/agentic-data-stack-2025/
- ClinicalTrials.gov API v2: How to Search 500,000 Studies and Track Trial Status | https://themineworks.com/blog/clinicaltrials-scraper-tutorial/
- CourtListener API: How to Search US Court Records and Case Law Programmatically | https://themineworks.com/blog/courtlistener-court-records-api/
- Crossref API: 150 Million DOIs, Citation Counts, and Bibliographic Data for Free | https://themineworks.com/blog/crossref-doi-metadata-api/
- FDA Recall Data API: How to Monitor Drug, Device, and Food Recalls Programmatically | https://themineworks.com/blog/fda-recalls-api/
- Federal Register API: How to Track US Rules, Proposed Rules, and Executive Orders | https://themineworks.com/blog/federal-register-api/
- India Government Data API: How to Pull Any data.gov.in Dataset Without the Documentation Confusion | https://themineworks.com/blog/india-government-data-api/
- Naukri API 2025: How to Programmatically Access India's Largest Job Board | https://themineworks.com/blog/naukri-api-job-data-india/
- NPI Registry API: How to Look Up Any US Healthcare Provider Programmatically | https://themineworks.com/blog/npi-registry-healthcare-lookup/
- OpenAlex API: 250 Million Research Papers, Free, No Rate-Limit Workarounds Needed | https://themineworks.com/blog/openalex-scholarly-api/
- Building a RAG Pipeline on SEC EDGAR Filings: A Step-by-Step Guide | https://themineworks.com/blog/rag-pipeline-sec-edgar-filings/
- How to Build a RAG Pipeline Using Web-Scraped Content | https://themineworks.com/blog/rag-pipeline-web-scraping/
- How to Scrape Reddit Without an API Key in 2025 | https://themineworks.com/blog/scrape-reddit-without-api-key/
- Socrata API: How to Pull CDC, HHS, NYC, and 200+ Government Data Portals | https://themineworks.com/blog/socrata-open-data-api/
- Threads Has No Public API: Here Is How to Get Profile and Post Data Anyway | https://themineworks.com/blog/threads-scraper-no-api/
- USASpending.gov API: How to Pull Federal Contracts, Grants, and Awards Programmatically | https://themineworks.com/blog/usaspending-federal-contracts-api/
- World Bank API in Python 2025: GDP, Inflation, and 1,400 Indicators Without the SOAP Hell | https://themineworks.com/blog/world-bank-api-python-2025/
- World Bank Trade Data API: How to Pull Global Import and Export Statistics | https://themineworks.com/blog/world-bank-trade-data-api/

### Comparisons
- Apify vs Bright Data vs ScraperAPI vs Oxylabs: The 2025 Data Platform Comparison | https://themineworks.com/blog/apify-vs-bright-data-scraperapi/
- The Best Apify Actors for AI and LLM Projects in 2025 | https://themineworks.com/blog/best-apify-actors-ai-llm/
- Greenhouse vs Lever vs Ashby: Which ATS Has the Best Public Job API? | https://themineworks.com/blog/greenhouse-lever-ashby-api-comparison/
- Job Board Scraping 2025: Which Platforms Allow It and How to Do It Right | https://themineworks.com/blog/job-board-scraping-2025/
- Pay-Per-Result vs Subscription Scraping: Why Billing Models Matter More Than You Think | https://themineworks.com/blog/pay-per-result-vs-subscription-scraping/
- pytrends is Dead: The Best Google Trends Alternatives in 2025 | https://themineworks.com/blog/pytrends-dead-google-trends-alternatives/
- Threads vs Twitter/X Data: A Developer Comparison for Social Listening | https://themineworks.com/blog/threads-vs-twitter-data-comparison/

### Engineering
- From Raw HTML to Clean Dataset: Data Pipeline Architecture for AI Teams | https://themineworks.com/blog/web-scraping-data-pipeline-architecture/
- Web Scraping Legality in 2025: What Developers Actually Need to Know | https://themineworks.com/blog/web-scraping-legal-guide-2025/
- Web Scraping Without Getting Blocked in 2025: Proxies, Stealth, and Session Strategy | https://themineworks.com/blog/web-scraping-without-getting-blocked/

### Use Cases
- How to Build a Competitor Intelligence System Using Web Scrapers | https://themineworks.com/blog/competitor-intelligence-web-scrapers/
- Using Google Trends Data for Market Research: A Developer's Playbook | https://themineworks.com/blog/google-trends-market-research/
- Using Google Trends to Find Untapped SEO Opportunities in 2025 | https://themineworks.com/blog/google-trends-seo-opportunities/
- India Tech Hiring Trends 2025: What the Job Data Actually Shows | https://themineworks.com/blog/india-tech-hiring-trends-2025/
- Building a Job Market Intelligence Dashboard with Free ATS Data | https://themineworks.com/blog/job-market-intelligence-dashboard/
- How to Monitor Competitor Job Postings to Predict Their Strategy | https://themineworks.com/blog/monitor-competitor-job-postings-strategy/
- Monitor Federal Regulations: A Compliance Watch with the Federal Register API | https://themineworks.com/blog/monitor-federal-regulations-compliance/
- Recruitment Automation: Building a Job Intelligence Pipeline with Free ATS Data | https://themineworks.com/blog/recruitment-automation-ats-api/
- Reddit Data for LLM Fine-Tuning: Quality, Licensing, and What Actually Works | https://themineworks.com/blog/reddit-data-llm-training/
- Reddit Sentiment Analysis Pipeline: From Raw Posts to Actionable Insights | https://themineworks.com/blog/reddit-sentiment-analysis-pipeline/
- Social Media Data for AI: Reddit, Threads, and the Open Web | https://themineworks.com/blog/social-media-data-ai-llm/
- Web Scraping for AI Training Data: Legal, Technical, and Quality Considerations | https://themineworks.com/blog/web-scraping-ai-training-data/

## Contact

hello@themineworks.com
https://apify.com/themineworks