René's URL Explorer Experiment


Title: Statistics | API | Crawlee for Python · Fast, reliable Python web crawlers.

Open Graph Title: Statistics | API | Crawlee for Python · Fast, reliable Python web crawlers.

Description: A class for collecting, tracking, and logging runtime statistics for requests.

Open Graph Description: A class for collecting, tracking, and logging runtime statistics for requests.

Opengraph URL: https://crawlee.dev/python/api/class/Statistics

Generator: Docusaurus v3.10.2

direct link

Domain: crawlee.dev


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[]}

twitter:cardsummary_large_image
og:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
twitter:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
og:localeen
docusaurus_localeen
docsearch:languageen
docusaurus_version1.11
docusaurus_tagdocs-default-1.11
docsearch:version1.11
docsearch:docusaurus_tagdocs-default-1.11

Links:

Skip to main contenthttps://crawlee.dev/python/api/class/Statistics#__docusaurus_skipToContent_fallback
Crawlee for Pythonhttps://crawlee.dev/python/
https://crawlee.dev/js
https://crawlee.dev/python/
https://crawlee.dev
Docshttps://crawlee.dev/python/docs/quick-start
APIhttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Bloghttps://crawlee.dev/blog
1.11https://crawlee.dev/python/api
Nexthttps://crawlee.dev/python/api/next
1.11https://crawlee.dev/python/api
0.6https://crawlee.dev/python/api/0.6
Get startedhttps://crawlee.dev/python/docs/quick-start
Crawlee for Pythonhttps://crawlee.dev/python/
Overviewhttps://crawlee.dev/python/api
Autoscalinghttps://crawlee.dev/python/api/class/AutoscaledPool
Browser managementhttps://crawlee.dev/python/api/class/BrowserController
Configurationhttps://crawlee.dev/python/api/class/ConcurrencySettings
Crawlershttps://crawlee.dev/python/api/class/AbstractHttpCrawler
Crawling contextshttps://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlingContext
Errorshttps://crawlee.dev/python/api/class/ContextPipelineFinalizationError
Event datahttps://crawlee.dev/python/api/enum/Event
Event managershttps://crawlee.dev/python/api/class/EventManager
Functionshttps://crawlee.dev/python/api/class/AddRequestsFunction
HTTP clientshttps://crawlee.dev/python/api/class/CurlImpersonateHttpClient
HTTP parsershttps://crawlee.dev/python/api/class/AbstractHttpParser
Request loadershttps://crawlee.dev/python/api/class/RequestList
Session managementhttps://crawlee.dev/python/api/class/CookieParam
Statisticshttps://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlerStatisticState
AdaptivePlaywrightCrawlerStatisticStatehttps://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlerStatisticState
FinalStatisticshttps://crawlee.dev/python/api/class/FinalStatistics
Statisticshttps://crawlee.dev/python/api/class/Statistics
StatisticsStatehttps://crawlee.dev/python/api/class/StatisticsState
Storage clientshttps://crawlee.dev/python/api/class/FileSystemStorageClient
Storage datahttps://crawlee.dev/python/api/class/AddRequestsResponse
Storageshttps://crawlee.dev/python/api/class/Dataset
Otherhttps://crawlee.dev/python/api/class/BasePydanticAiHtmlDistiller
https://crawlee.dev/python/
_NonPersistentStatisticshttps://crawlee.dev/python/api/class/_NonPersistentStatistics
https://crawlee.dev/python/api/class/Statistics#Index
__aenter__https://crawlee.dev/python/api/class/Statistics#__aenter__
__aexit__https://crawlee.dev/python/api/class/Statistics#__aexit__
__init__https://crawlee.dev/python/api/class/Statistics#__init__
calculatehttps://crawlee.dev/python/api/class/Statistics#calculate
record_request_processing_deferralhttps://crawlee.dev/python/api/class/Statistics#record_request_processing_deferral
record_request_processing_failurehttps://crawlee.dev/python/api/class/Statistics#record_request_processing_failure
record_request_processing_finishhttps://crawlee.dev/python/api/class/Statistics#record_request_processing_finish
record_request_processing_starthttps://crawlee.dev/python/api/class/Statistics#record_request_processing_start
register_status_codehttps://crawlee.dev/python/api/class/Statistics#register_status_code
replace_state_modelhttps://crawlee.dev/python/api/class/Statistics#replace_state_model
resethttps://crawlee.dev/python/api/class/Statistics#reset
with_default_statehttps://crawlee.dev/python/api/class/Statistics#with_default_state
activehttps://crawlee.dev/python/api/class/Statistics#active
statehttps://crawlee.dev/python/api/class/Statistics#state
https://crawlee.dev/python/api/class/Statistics#Methods
https://crawlee.dev/python/api/class/Statistics#__aenter__
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L162
Statistics.__aenter__https://crawlee.dev/python/api/class/Statistics#__aenter__
https://crawlee.dev/python/api/class/Statistics#__aexit__
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L184
Statistics.__aexit__https://crawlee.dev/python/api/class/Statistics#__aexit__
typehttps://crawlee.dev/python/api/class/SitemapSource#type
https://crawlee.dev/python/api/class/Statistics#__init__
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L75
Statistics.__init__https://crawlee.dev/python/api/class/Statistics#__init__
KeyValueStorehttps://crawlee.dev/python/api/class/KeyValueStore
typehttps://crawlee.dev/python/api/class/SitemapSource#type
TStatisticsStatehttps://crawlee.dev/python/api#TStatisticsState
https://crawlee.dev/python/api/class/Statistics#calculate
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L269
FinalStatisticshttps://crawlee.dev/python/api/class/FinalStatistics
FinalStatisticshttps://crawlee.dev/python/api/class/FinalStatistics
https://crawlee.dev/python/api/class/Statistics#record_request_processing_deferral
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L248
https://crawlee.dev/python/api/class/Statistics#record_request_processing_failure
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L255
https://crawlee.dev/python/api/class/Statistics#record_request_processing_finish
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L226
https://crawlee.dev/python/api/class/Statistics#record_request_processing_start
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L219
https://crawlee.dev/python/api/class/Statistics#register_status_code
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L212
https://crawlee.dev/python/api/class/Statistics#replace_state_model
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L117
Statisticshttps://crawlee.dev/python/api/class/Statistics
TNewStatisticsStatehttps://crawlee.dev/python/api#TNewStatisticsState
typehttps://crawlee.dev/python/api/class/SitemapSource#type
TNewStatisticsStatehttps://crawlee.dev/python/api#TNewStatisticsState
Statisticshttps://crawlee.dev/python/api/class/Statistics
TNewStatisticsStatehttps://crawlee.dev/python/api#TNewStatisticsState
https://crawlee.dev/python/api/class/Statistics#reset
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L288
https://crawlee.dev/python/api/class/Statistics#with_default_state
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L131
Statisticshttps://crawlee.dev/python/api/class/Statistics
StatisticsStatehttps://crawlee.dev/python/api/class/StatisticsState
KeyValueStorehttps://crawlee.dev/python/api/class/KeyValueStore
Statisticshttps://crawlee.dev/python/api/class/Statistics
StatisticsStatehttps://crawlee.dev/python/api/class/StatisticsState
https://crawlee.dev/python/api/class/Statistics#Properties
https://crawlee.dev/python/api/class/Statistics#active
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L158
https://crawlee.dev/python/api/class/Statistics#state
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/statistics/_statistics.py#L208
TStatisticsStatehttps://crawlee.dev/python/api#TStatisticsState
PreviousFinalStatisticshttps://crawlee.dev/python/api/class/FinalStatistics
NextStatisticsStatehttps://crawlee.dev/python/api/class/StatisticsState
__aenter__https://crawlee.dev/python/api/class/Statistics#__aenter__
__aexit__https://crawlee.dev/python/api/class/Statistics#__aexit__
__init__https://crawlee.dev/python/api/class/Statistics#__init__
calculatehttps://crawlee.dev/python/api/class/Statistics#calculate
record_request_processing_deferralhttps://crawlee.dev/python/api/class/Statistics#record_request_processing_deferral
record_request_processing_failurehttps://crawlee.dev/python/api/class/Statistics#record_request_processing_failure
record_request_processing_finishhttps://crawlee.dev/python/api/class/Statistics#record_request_processing_finish
record_request_processing_starthttps://crawlee.dev/python/api/class/Statistics#record_request_processing_start
register_status_codehttps://crawlee.dev/python/api/class/Statistics#register_status_code
replace_state_modelhttps://crawlee.dev/python/api/class/Statistics#replace_state_model
resethttps://crawlee.dev/python/api/class/Statistics#reset
with_default_statehttps://crawlee.dev/python/api/class/Statistics#with_default_state
activehttps://crawlee.dev/python/api/class/Statistics#active
statehttps://crawlee.dev/python/api/class/Statistics#state
https://crawlee.dev
Quick starthttps://crawlee.dev/python/docs/quick-start
Guideshttps://crawlee.dev/python/docs/guides
API referencehttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Discordhttps://discord.com/invite/jyEM2PRvMU
Stack Overflowhttps://stackoverflow.com/questions/tagged/crawlee-python
Twitterhttps://twitter.com/apify
YouTubehttps://www.youtube.com/apify
Apify platformhttps://apify.com
Docusaurushttps://docusaurus.io
GitHubhttps://github.com/apify/crawlee-python

Viewport: width=device-width, initial-scale=1.0


URLs of crawlers that visited me.