Skip to content

feat: add crawl pages support#97

Merged
FrancescoSaverioZuppichini merged 1 commit into
mainfrom
feat/crawl-pages-types
May 28, 2026
Merged

feat: add crawl pages support#97
FrancescoSaverioZuppichini merged 1 commit into
mainfrom
feat/crawl-pages-types

Conversation

@FrancescoSaverioZuppichini
Copy link
Copy Markdown
Member

@FrancescoSaverioZuppichini FrancescoSaverioZuppichini commented May 28, 2026

Summary

  • add sync and async crawl.pages(...) wrappers for /crawl/{id}/pages
  • add crawl pages query/response models and export renamed public type aliases matching the JS SDK
  • add sync/async crawl-pages examples that page through scraped crawl results
  • update docs and client test coverage for paginated crawl pages

Tests

  • uv run ruff check src/scrapegraph_py tests examples/crawl/crawl_pages.py examples/crawl/crawl_pages_async.py
  • uv run pytest

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 28, 2026

Dependency Review

✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.

Scanned Files

None

@FrancescoSaverioZuppichini FrancescoSaverioZuppichini merged commit 1712ba1 into main May 28, 2026
6 checks passed
github-actions Bot pushed a commit that referenced this pull request May 28, 2026
# [2.2.0](v2.1.2...v2.2.0) (2026-05-28)

### Features

* add crawl pages support ([#97](#97)) ([1712ba1](1712ba1))
@github-actions
Copy link
Copy Markdown

🎉 This PR is included in version 2.2.0 🎉

The release is available on GitHub release

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant