11 Pull requests merged by 5 people

• docs: Add architecture overview guide and more

  #1306 merged Jul 18, 2025

• docs: Improve API doc groups

  #1309 merged Jul 18, 2025

• feat: Prevent overloading system memory when running locally

  #1270 merged Jul 17, 2025

• chore(deps): update dependency types-cachetools to ~=6.1.0.20250717

  #1310 merged Jul 17, 2025

• chore(deps): update dependency pytest-asyncio to ~=1.1.0

  #1308 merged Jul 16, 2025

• chore: Refactor HttpClient implementations tests

  #1299 merged Jul 15, 2025

• feat: add ImpitHttpClient http-client client using the impit library

  #1151 merged Jul 15, 2025

• chore(deps): update dependency mypy to ~=1.17.0

  #1304 merged Jul 15, 2025

• chore(deps): update typescript-eslint monorepo to v8.37.0

  #1305 merged Jul 15, 2025

• chore: Re-use optional dependencies for all

  #1303 merged Jul 14, 2025

• chore(deps): lock file maintenance

  #1300 merged Jul 12, 2025

1 Pull request opened by 1 person

• refactor!: Replace `HttpxHttpClient` with `ImpitHttpClient` as default HTTP client

  #1307 opened Jul 15, 2025

8 Issues closed by 3 people

• Architecture overview

  #603 closed Jul 18, 2025

• Document the crawler & context iheritance

  #766 closed Jul 18, 2025

• Improve grouping in API docs

  #1293 closed Jul 18, 2025

• Autoscaling failsafe to prevent using up all memory when running locally

  #1232 closed Jul 17, 2025

• Parametrize `HttpClient` implementations tests to remove code duplication

  #1292 closed Jul 15, 2025

• Add a CI script that generates "all" extra group

  #995 closed Jul 14, 2025

• Enhance `PlaywrightCrawler` testing with mocked Playwright API

  #197 closed Jul 14, 2025

• SitemapRequestLoader not available for Python

  #1301 closed Jul 14, 2025

1 Issue opened by 1 person

• Add docs versioning

  #1302 opened Jul 14, 2025

5 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• docs: Add guide about integrating Stagehand

  #1290 commented on Jul 18, 2025 • 4 new comments

• Crawling very slow and timeout error

  #354 commented on Jul 14, 2025 • 0 new comments

• Create optimization guide for Crawlers

  #1298 commented on Jul 14, 2025 • 0 new comments

• Persist the `SitemapRequestLoader` state

  #1269 commented on Jul 14, 2025 • 0 new comments

• feat: Persist RequestList state

  #1274 commented on Jul 17, 2025 • 0 new comments