Package: Rcrawler 0.1.9-1

Rcrawler: Web Crawler and Scraper

Performs parallel web crawling and web scraping. It is designed to crawl, parse and store web pages to produce data that can be directly used for analysis application. For details see Khalil and Fakir (2017) <doi:10.1016/j.softx.2017.04.004>.

Authors:Salim Khalil [aut, cre]

Rcrawler_0.1.9-1.tar.gz
Rcrawler_0.1.9-1.zip(r-4.5)Rcrawler_0.1.9-1.zip(r-4.4)Rcrawler_0.1.9-1.zip(r-4.3)
Rcrawler_0.1.9-1.tgz(r-4.4-any)Rcrawler_0.1.9-1.tgz(r-4.3-any)
Rcrawler_0.1.9-1.tar.gz(r-4.5-noble)Rcrawler_0.1.9-1.tar.gz(r-4.4-noble)
Rcrawler_0.1.9-1.tgz(r-4.4-emscripten)Rcrawler_0.1.9-1.tgz(r-4.3-emscripten)
Rcrawler.pdf |Rcrawler.html
Rcrawler/json (API)

# Install 'Rcrawler' in R:
install.packages('Rcrawler', repos = c('https://salimk.r-universe.dev', 'https://cloud.r-project.org'))

Peer review:

Bug tracker:https://github.com/salimk/rcrawler/issues

On CRAN:

crawlercrawlersscraperwebcrawlerwebscraperwebscrapingwebscrapping

6.86 score 350 stars 103 scripts 604 downloads 4 mentions 16 exports 33 dependencies

Last updated 4 years agofrom:f9f403e2c3. Checks:OK: 1 NOTE: 6. Indexed: yes.

TargetResultDate
Doc / VignettesOKOct 09 2024
R-4.5-winNOTEOct 09 2024
R-4.5-linuxNOTEOct 09 2024
R-4.4-winNOTEOct 09 2024
R-4.4-macNOTEOct 09 2024
R-4.3-winNOTEOct 09 2024
R-4.3-macNOTEOct 09 2024

Exports:browser_pathContentScraperDrv_fetchpageGetencodinginstall_browserLinkExtractorLinkNormalizationLinkparametersLinkparamsfilterListProjectsLoadHTMLFilesLoginSessionRcrawlerRobotParserrun_browserstop_browser

Dependencies:askpassbase64enccallrclicodetoolscrayoncurldata.tabledebugmedoParallelforeachgluehttriteratorsjsonlitelifecyclemagrittrmimeopensslpngprocessxpsR6rlangselectrshowimagestringistringrsysvctrswebdriverwithrxml2