Search fresh public links, source activity, and ready-to-use post angles for Scrapy.
Fresh curated links around Scrapy are collected here so marketers can spot useful updates and turn timely ideas into posts faster.
Recent items include:
Recent curated links from global sources. Generate one free draft from any story, then use SocialBu to schedule and refine your content calendar.
The crawling and scraping Vessel project is back with pluggable drivers, the fields API, middleware pipeline, proxy rotation, cookies, retries, and callbacks. See what's new and ho...
BeautifulSoup, Scrapy, Selenium и Playwright часто сравнивают как аналоги, хотя это инструменты разных уровней. Я собрала тестовый стенд и сравнила их на статическом HTML, JavaScri...
If you need to extract basic structured data from a static, publicly accessible website, it can be tempting to immediately reach for frameworks like Selenium, Scrapy, or Playwright...
Learn about some of the best and most popular tools for web scraping. From Open Source tools like Scrapy and Crawlee all the way to scraping platform providers and search APIs.
Learn how to build your own web scraper in multiple programming languages, from basic HTML parsing to automated web browsers.
I wanted a small research database to grow from one subreddit to ten communities where people talk about building with Claude Code and automation. Doing it properly was estimated a...
I need a reliable script that pulls profile-level data from a website that presents its users in listing form. The site shows one profile per detail page; I want a scraper that mov...
Scrape Zillow real estate listings with SerpApi in Python, JavaScript, Ruby, or with just plain cURL. Retrieve homes for sale, rentals, and recently sold properties in structured J...
You need the data, but collecting it has become a chore. Let ChatGPT and Apify handle the work for you.
Build a tracker that scrapes a category on a schedule and logs every run into Google Sheets, no code required.
While searching for quality I found scrap. SCRAP is by Robert C. Martin (Uncle Bob): github.com/unclebob/scrap. The algorithm, the metrics, the smells and the policy numbers in scr...
Describe your data needs in plain language and turn websites into a continuous source of fresh data.
Every one of our Actors is HTTP-only — no Puppeteer, no Playwright, no headless Chromium in production. We say this is faster and cheaper. This post is the measurement, not the ass...
With SerpApi, you can fetch Play Store search results, home pages, and app listings in structured JSON or Markdown format.
Scrape a website into LlamaIndex with Apify, update the index without re-embedding unchanged pages, and stop partial crawls from deleting pages that still exist.
The new eBay Seller API turns any eBay store or user profile into clean, structured JSON. Learn what seller, listing, auction, and feedback data it exposes, test requests in the Pl...
A fresh guide on how to scrape websites using Java. This is your web scraping 101.
Fetch and analyze reviews for any app on the Google Play Store with SerpApi, in simple JSON or Markdown format.
We benchmarked Crawl4AI against Apify's Website Content Crawler on 1,000 Shopify help pages. Here's how they compare on quality, speed, and cost.
A detailed comparison of Firecrawl's unified AI-driven scraping and Apify's comprehensive, flexible ecosystem. We explain what each does best.
A retrieval benchmark for RAG pipelines.
Fetch new releases, search results, and current deals from Google's movies and TV show storefronts, in simple JSON or Markdown format.
How a developer who bids on Spanish public contracts filtered the PLACSP tender feed into something an AI agent can query, then connected his Actor to Claude Desktop through the Ap...
Originally appeared on Sam Ruby.I built these for Roundhouse, which compiles Rails applications, and Campfire needs all three: Action Text sanitizes every message through rails-htm...
Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.