René's URL Explorer Experiment


Title: RequestWithLock | API | Crawlee for Python · Fast, reliable Python web crawlers.

Open Graph Title: RequestWithLock | API | Crawlee for Python · Fast, reliable Python web crawlers.

Description: A crawling request with information about locks.

Open Graph Description: A crawling request with information about locks.

Opengraph URL: https://crawlee.dev/python/api/class/RequestWithLock

Generator: Docusaurus v3.10.2

direct link

Domain: crawlee.dev


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[]}

twitter:cardsummary_large_image
og:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
twitter:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
og:localeen
docusaurus_localeen
docsearch:languageen
docusaurus_version1.11
docusaurus_tagdocs-default-1.11
docsearch:version1.11
docsearch:docusaurus_tagdocs-default-1.11

Links:

Skip to main contenthttps://crawlee.dev/python/api/class/RequestWithLock#__docusaurus_skipToContent_fallback
Crawlee for Pythonhttps://crawlee.dev/python/
https://crawlee.dev/js
https://crawlee.dev/python/
https://crawlee.dev
Docshttps://crawlee.dev/python/docs/quick-start
APIhttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Bloghttps://crawlee.dev/blog
1.11https://crawlee.dev/python/api
Nexthttps://crawlee.dev/python/api/next
1.11https://crawlee.dev/python/api
0.6https://crawlee.dev/python/api/0.6
Get startedhttps://crawlee.dev/python/docs/quick-start
Crawlee for Pythonhttps://crawlee.dev/python/
Overviewhttps://crawlee.dev/python/api
Autoscalinghttps://crawlee.dev/python/api/class/AutoscaledPool
Browser managementhttps://crawlee.dev/python/api/class/BrowserController
Configurationhttps://crawlee.dev/python/api/class/ConcurrencySettings
Crawlershttps://crawlee.dev/python/api/class/AbstractHttpCrawler
Crawling contextshttps://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlingContext
Errorshttps://crawlee.dev/python/api/class/ContextPipelineFinalizationError
Event datahttps://crawlee.dev/python/api/enum/Event
Event managershttps://crawlee.dev/python/api/class/EventManager
Functionshttps://crawlee.dev/python/api/class/AddRequestsFunction
HTTP clientshttps://crawlee.dev/python/api/class/CurlImpersonateHttpClient
HTTP parsershttps://crawlee.dev/python/api/class/AbstractHttpParser
Request loadershttps://crawlee.dev/python/api/class/RequestList
Session managementhttps://crawlee.dev/python/api/class/CookieParam
Statisticshttps://crawlee.dev/python/api/class/AdaptivePlaywrightCrawlerStatisticState
Storage clientshttps://crawlee.dev/python/api/class/FileSystemStorageClient
Storage datahttps://crawlee.dev/python/api/class/AddRequestsResponse
Storageshttps://crawlee.dev/python/api/class/Dataset
Otherhttps://crawlee.dev/python/api/class/BasePydanticAiHtmlDistiller
https://crawlee.dev/python/
Requesthttps://crawlee.dev/python/api/class/Request
https://crawlee.dev/python/api/class/RequestWithLock#Index
from_urlhttps://crawlee.dev/python/api/class/RequestWithLock#from_url
get_query_param_from_urlhttps://crawlee.dev/python/api/class/RequestWithLock#get_query_param_from_url
crawl_depthhttps://crawlee.dev/python/api/class/RequestWithLock#crawl_depth
crawlee_datahttps://crawlee.dev/python/api/class/RequestWithLock#crawlee_data
enqueue_strategyhttps://crawlee.dev/python/api/class/RequestWithLock#enqueue_strategy
forefronthttps://crawlee.dev/python/api/class/RequestWithLock#forefront
handled_athttps://crawlee.dev/python/api/class/RequestWithLock#handled_at
labelhttps://crawlee.dev/python/api/class/RequestWithLock#label
last_proxy_tierhttps://crawlee.dev/python/api/class/RequestWithLock#last_proxy_tier
loaded_urlhttps://crawlee.dev/python/api/class/RequestWithLock#loaded_url
lock_expires_athttps://crawlee.dev/python/api/class/RequestWithLock#lock_expires_at
max_retrieshttps://crawlee.dev/python/api/class/RequestWithLock#max_retries
methodhttps://crawlee.dev/python/api/class/RequestWithLock#method
model_confighttps://crawlee.dev/python/api/class/RequestWithLock#model_config
no_retryhttps://crawlee.dev/python/api/class/RequestWithLock#no_retry
payloadhttps://crawlee.dev/python/api/class/RequestWithLock#payload
retry_counthttps://crawlee.dev/python/api/class/RequestWithLock#retry_count
session_idhttps://crawlee.dev/python/api/class/RequestWithLock#session_id
session_rotation_counthttps://crawlee.dev/python/api/class/RequestWithLock#session_rotation_count
statehttps://crawlee.dev/python/api/class/RequestWithLock#state
unique_keyhttps://crawlee.dev/python/api/class/RequestWithLock#unique_key
urlhttps://crawlee.dev/python/api/class/RequestWithLock#url
was_already_handledhttps://crawlee.dev/python/api/class/RequestWithLock#was_already_handled
https://crawlee.dev/python/api/class/RequestWithLock#Methods
https://crawlee.dev/python/api/class/RequestWithLock#from_url
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L245
Request.from_urlhttps://crawlee.dev/python/api/class/Request#from_url
HttpMethodhttps://crawlee.dev/python/api#HttpMethod
https://crawlee.dev/python/api/class/RequestWithLock#get_query_param_from_url
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L344
Request.get_query_param_from_urlhttps://crawlee.dev/python/api/class/Request#get_query_param_from_url
https://crawlee.dev/python/api/class/RequestWithLock#Properties
https://crawlee.dev/python/api/class/RequestWithLock#crawl_depth
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L369
Request.crawl_depthhttps://crawlee.dev/python/api/class/Request#crawl_depth
Request.crawl_depthhttps://crawlee.dev/python/api/class/Request#crawl_depth
https://crawlee.dev/python/api/class/RequestWithLock#crawlee_data
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L360
CrawleeRequestDatahttps://crawlee.dev/python/api/class/CrawleeRequestData
Request.crawlee_datahttps://crawlee.dev/python/api/class/Request#crawlee_data
https://crawlee.dev/python/api/class/RequestWithLock#enqueue_strategy
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L401
EnqueueStrategyhttps://crawlee.dev/python/api#EnqueueStrategy
Request.enqueue_strategyhttps://crawlee.dev/python/api/class/Request#enqueue_strategy
Request.enqueue_strategyhttps://crawlee.dev/python/api/class/Request#enqueue_strategy
https://crawlee.dev/python/api/class/RequestWithLock#forefront
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L419
Request.forefronthttps://crawlee.dev/python/api/class/Request#forefront
Request.forefronthttps://crawlee.dev/python/api/class/Request#forefront
https://crawlee.dev/python/api/class/RequestWithLock#handled_at
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L241
Request.handled_athttps://crawlee.dev/python/api/class/Request#handled_at
https://crawlee.dev/python/api/class/RequestWithLock#label
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L350
Request.labelhttps://crawlee.dev/python/api/class/Request#label
https://crawlee.dev/python/api/class/RequestWithLock#last_proxy_tier
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L410
Request.last_proxy_tierhttps://crawlee.dev/python/api/class/Request#last_proxy_tier
Request.last_proxy_tierhttps://crawlee.dev/python/api/class/Request#last_proxy_tier
https://crawlee.dev/python/api/class/RequestWithLock#loaded_url
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L238
Request.loaded_urlhttps://crawlee.dev/python/api/class/Request#loaded_url
https://crawlee.dev/python/api/class/RequestWithLock#lock_expires_at
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L436
https://crawlee.dev/python/api/class/RequestWithLock#max_retries
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L387
Request.max_retrieshttps://crawlee.dev/python/api/class/Request#max_retries
https://crawlee.dev/python/api/class/RequestWithLock#method
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L188
Request.methodhttps://crawlee.dev/python/api/class/Request#method
https://crawlee.dev/python/api/class/RequestWithLock#model_config
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L170
Request.model_confighttps://crawlee.dev/python/api/class/Request#model_config
https://crawlee.dev/python/api/class/RequestWithLock#no_retry
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L235
Request.no_retryhttps://crawlee.dev/python/api/class/Request#no_retry
https://crawlee.dev/python/api/class/RequestWithLock#payload
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L191
Request.payloadhttps://crawlee.dev/python/api/class/Request#payload
https://crawlee.dev/python/api/class/RequestWithLock#retry_count
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L232
Request.retry_counthttps://crawlee.dev/python/api/class/Request#retry_count
https://crawlee.dev/python/api/class/RequestWithLock#session_id
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L355
Request.session_idhttps://crawlee.dev/python/api/class/Request#session_id
https://crawlee.dev/python/api/class/RequestWithLock#session_rotation_count
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L392
Request.session_rotation_counthttps://crawlee.dev/python/api/class/Request#session_rotation_count
Request.session_rotation_counthttps://crawlee.dev/python/api/class/Request#session_rotation_count
https://crawlee.dev/python/api/class/RequestWithLock#state
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L378
RequestStatehttps://crawlee.dev/python/api/class/RequestState
Request.statehttps://crawlee.dev/python/api/class/Request#state
Request.statehttps://crawlee.dev/python/api/class/Request#state
https://crawlee.dev/python/api/class/RequestWithLock#unique_key
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L172
Request.unique_keyhttps://crawlee.dev/python/api/class/Request#unique_key
https://crawlee.dev/python/api/class/RequestWithLock#url
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L184
Request.urlhttps://crawlee.dev/python/api/class/Request#url
https://crawlee.dev/python/api/class/RequestWithLock#was_already_handled
https://github.com/apify/crawlee-python/blob/ea492fa9b5377f44082dc51d582e85d686b23c75//src/crawlee/_request.py#L428
Request.was_already_handledhttps://crawlee.dev/python/api/class/Request#was_already_handled
from_urlhttps://crawlee.dev/python/api/class/RequestWithLock#from_url
get_query_param_from_urlhttps://crawlee.dev/python/api/class/RequestWithLock#get_query_param_from_url
crawl_depthhttps://crawlee.dev/python/api/class/RequestWithLock#crawl_depth
crawlee_datahttps://crawlee.dev/python/api/class/RequestWithLock#crawlee_data
enqueue_strategyhttps://crawlee.dev/python/api/class/RequestWithLock#enqueue_strategy
forefronthttps://crawlee.dev/python/api/class/RequestWithLock#forefront
handled_athttps://crawlee.dev/python/api/class/RequestWithLock#handled_at
labelhttps://crawlee.dev/python/api/class/RequestWithLock#label
last_proxy_tierhttps://crawlee.dev/python/api/class/RequestWithLock#last_proxy_tier
loaded_urlhttps://crawlee.dev/python/api/class/RequestWithLock#loaded_url
lock_expires_athttps://crawlee.dev/python/api/class/RequestWithLock#lock_expires_at
max_retrieshttps://crawlee.dev/python/api/class/RequestWithLock#max_retries
methodhttps://crawlee.dev/python/api/class/RequestWithLock#method
model_confighttps://crawlee.dev/python/api/class/RequestWithLock#model_config
no_retryhttps://crawlee.dev/python/api/class/RequestWithLock#no_retry
payloadhttps://crawlee.dev/python/api/class/RequestWithLock#payload
retry_counthttps://crawlee.dev/python/api/class/RequestWithLock#retry_count
session_idhttps://crawlee.dev/python/api/class/RequestWithLock#session_id
session_rotation_counthttps://crawlee.dev/python/api/class/RequestWithLock#session_rotation_count
statehttps://crawlee.dev/python/api/class/RequestWithLock#state
unique_keyhttps://crawlee.dev/python/api/class/RequestWithLock#unique_key
urlhttps://crawlee.dev/python/api/class/RequestWithLock#url
was_already_handledhttps://crawlee.dev/python/api/class/RequestWithLock#was_already_handled
https://crawlee.dev
Quick starthttps://crawlee.dev/python/docs/quick-start
Guideshttps://crawlee.dev/python/docs/guides
API referencehttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Discordhttps://discord.com/invite/jyEM2PRvMU
Stack Overflowhttps://stackoverflow.com/questions/tagged/crawlee-python
Twitterhttps://twitter.com/apify
YouTubehttps://www.youtube.com/apify
Apify platformhttps://apify.com
Docusaurushttps://docusaurus.io
GitHubhttps://github.com/apify/crawlee-python

Viewport: width=device-width, initial-scale=1.0


URLs of crawlers that visited me.