Tidy Interface for Reproducible Web Crawling R package crawlee version 0.1.0 A tidy, pipe-friendly toolkit for reproducible web crawling and structured data collection, inspired by the architecture of the 'Crawlee' library. Provides a unified crawler with a deduplicating, resumable request queue, content-type aware handlers, structured storage backends and rich console logging via 'cli'. Supports crawling HTML pages, sitemaps, RSS and Atom feeds and PDF documents, with optional headless-browser rendering and helpers for retrieval-augmented generation. Software Depends: R (>= 4.1.0) Imports: cli, httr2, R6, rlang, rvest, tibble, vctrs, xml2 Suggests: arrow, chromote, DBI, dplyr, duckdb, httptest2, jsonlite, knitr, later, nanoparquet, pdftools, polite, promises, rmarkdown, testthat (>= 3.0.0) Andre Leite <leite@castlab.org> Comprehensive R Archive Network (CRAN) Andre Leite [aut, cre], Marcos Wasilew [aut], Hugo Vasconcelos [aut], Carlos Amorin [aut], Diogo Bezerra [aut] MIT + file LICENSE (https://CRAN.R-project.org/package=crawlee/LICENSE) 2026-07-03 application/tgz https://CRAN.R-project.org/package=crawlee doi:10.32614/CRAN.package.crawlee en-US