Package: Rcrawler 0.1.9-1

Rcrawler: Web Crawler and Scraper

Performs parallel web crawling and web scraping. It is designed to crawl, parse and store web pages to produce data that can be directly used for analysis application. For details see Khalil and Fakir (2017) <doi:10.1016/j.softx.2017.04.004>.

Authors:Salim Khalil [aut, cre]

Rcrawler_0.1.9-1.tar.gz
Rcrawler_0.1.9-1.zip(r-4.5)Rcrawler_0.1.9-1.zip(r-4.4)Rcrawler_0.1.9-1.zip(r-4.3)
Rcrawler_0.1.9-1.tgz(r-4.4-any)Rcrawler_0.1.9-1.tgz(r-4.3-any)
Rcrawler_0.1.9-1.tar.gz(r-4.5-noble)Rcrawler_0.1.9-1.tar.gz(r-4.4-noble)
Rcrawler_0.1.9-1.tgz(r-4.4-emscripten)Rcrawler_0.1.9-1.tgz(r-4.3-emscripten)
Rcrawler.pdf |Rcrawler.html✨
Rcrawler/json (API)

# Install 'Rcrawler' in R:
install.packages('Rcrawler', repos = c('https://salimk.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/salimk/rcrawler/issues

On CRAN:

crawlercrawlersscraperwebcrawlerwebscraperwebscrapingwebscrapping

6.86 score 350 stars 103 scripts 565 downloads 4 mentions 16 exports 33 dependencies

Last updated 5 years agofrom:f9f403e2c3. Checks:OK: 1 NOTE: 6. Indexed: yes.

TargetResultDate
Doc / VignettesOKNov 08 2024
R-4.5-winNOTENov 08 2024
R-4.5-linuxNOTENov 08 2024
R-4.4-winNOTENov 08 2024
R-4.4-macNOTENov 08 2024
R-4.3-winNOTENov 08 2024
R-4.3-macNOTENov 08 2024

Exports:browser_pathContentScraperDrv_fetchpageGetencodinginstall_browserLinkExtractorLinkNormalizationLinkparametersLinkparamsfilterListProjectsLoadHTMLFilesLoginSessionRcrawlerRobotParserrun_browserstop_browser

Dependencies:askpassbase64enccallrclicodetoolscrayoncurldata.tabledebugmedoParallelforeachgluehttriteratorsjsonlitelifecyclemagrittrmimeopensslpngprocessxpsR6rlangselectrshowimagestringistringrsysvctrswebdriverwithrxml2