René's URL Explorer Experiment


Title: HttpClient | API | Crawlee for Python · Fast, reliable Python web crawlers.

Open Graph Title: HttpClient | API | Crawlee for Python · Fast, reliable Python web crawlers.

Description: An abstract base class for HTTP clients used in crawlers (`BasicCrawler` subclasses).

Open Graph Description: An abstract base class for HTTP clients used in crawlers (`BasicCrawler` subclasses).

Opengraph URL: https://crawlee.dev/python/api/0.6/class/HttpClient

Generator: Docusaurus v3.10.2

direct link

Domain: crawlee.dev


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[]}

twitter:cardsummary_large_image
og:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
twitter:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
og:localeen
docusaurus_localeen
docsearch:languageen
docusaurus_version0.6
docusaurus_tagdocs-default-0.6
docsearch:version0.6
docsearch:docusaurus_tagdocs-default-0.6

Links:

Skip to main contenthttps://crawlee.dev/python/api/0.6/class/HttpClient#__docusaurus_skipToContent_fallback
Crawlee for Pythonhttps://crawlee.dev/python/
https://crawlee.dev/js
https://crawlee.dev/python/
https://crawlee.dev
Docshttps://crawlee.dev/python/docs/quick-start
APIhttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Bloghttps://crawlee.dev/blog
0.6https://crawlee.dev/python/api/0.6
Nexthttps://crawlee.dev/python/api/next
1.11https://crawlee.dev/python/api
0.6https://crawlee.dev/python/api/0.6
Get startedhttps://crawlee.dev/python/docs/quick-start
Crawlee for Pythonhttps://crawlee.dev/python/
Overviewhttps://crawlee.dev/python/api/0.6
Abstract classeshttps://crawlee.dev/python/api/0.6/class/AbstractHttpCrawler
AbstractHttpCrawlerhttps://crawlee.dev/python/api/0.6/class/AbstractHttpCrawler
AbstractHttpParserhttps://crawlee.dev/python/api/0.6/class/AbstractHttpParser
DatasetClienthttps://crawlee.dev/python/api/0.6/class/DatasetClient
DatasetCollectionClienthttps://crawlee.dev/python/api/0.6/class/DatasetCollectionClient
FingerprintGeneratorhttps://crawlee.dev/python/api/0.6/class/FingerprintGenerator
HttpClienthttps://crawlee.dev/python/api/0.6/class/HttpClient
KeyValueStoreClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreClient
KeyValueStoreCollectionClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreCollectionClient
RequestLoaderhttps://crawlee.dev/python/api/0.6/class/RequestLoader
RequestManagerhttps://crawlee.dev/python/api/0.6/class/RequestManager
RequestQueueClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueClient
RequestQueueCollectionClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueCollectionClient
StorageClienthttps://crawlee.dev/python/api/0.6/class/StorageClient
Classeshttps://crawlee.dev/python/api/0.6/class/AdaptivePlaywrightCrawler
Data structureshttps://crawlee.dev/python/api/0.6/class/AdaptivePlaywrightCrawlerStatisticState
Errorshttps://crawlee.dev/python/api/0.6/class/ContextPipelineFinalizationError
Event payloadshttps://crawlee.dev/python/api/0.6/class/EventAbortingData
Functionshttps://crawlee.dev/python/api/0.6/class/AddRequestsFunction
1.11https://crawlee.dev/python/api
https://crawlee.dev/python/
HttpxHttpClienthttps://crawlee.dev/python/api/0.6/class/HttpxHttpClient
CurlImpersonateHttpClienthttps://crawlee.dev/python/api/0.6/class/CurlImpersonateHttpClient
PlaywrightHttpClienthttps://crawlee.dev/python/api/0.6/class/PlaywrightHttpClient
https://crawlee.dev/python/api/0.6/class/HttpClient#Index
__aenter__https://crawlee.dev/python/api/0.6/class/HttpClient#__aenter__
__aexit__https://crawlee.dev/python/api/0.6/class/HttpClient#__aexit__
__init__https://crawlee.dev/python/api/0.6/class/HttpClient#__init__
cleanuphttps://crawlee.dev/python/api/0.6/class/HttpClient#cleanup
crawlhttps://crawlee.dev/python/api/0.6/class/HttpClient#crawl
send_requesthttps://crawlee.dev/python/api/0.6/class/HttpClient#send_request
streamhttps://crawlee.dev/python/api/0.6/class/HttpClient#stream
activehttps://crawlee.dev/python/api/0.6/class/HttpClient#active
https://crawlee.dev/python/api/0.6/class/HttpClient#Methods
https://crawlee.dev/python/api/0.6/class/HttpClient#__aenter__
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L197
HttpClienthttps://crawlee.dev/python/api/0.6/class/HttpClient
HttpClienthttps://crawlee.dev/python/api/0.6/class/HttpClient
https://crawlee.dev/python/api/0.6/class/HttpClient#__aexit__
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L209
https://crawlee.dev/python/api/0.6/class/HttpClient#__init__
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L79
https://crawlee.dev/python/api/0.6/class/HttpClient#cleanup
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L189
HttpClient.cleanuphttps://crawlee.dev/python/api/0.6/class/HttpClient#cleanup
https://crawlee.dev/python/api/0.6/class/HttpClient#crawl
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L100
HttpCrawlingResulthttps://crawlee.dev/python/api/0.6/class/HttpCrawlingResult
HttpClient.crawlhttps://crawlee.dev/python/api/0.6/class/HttpClient#crawl
Requesthttps://crawlee.dev/python/api/0.6/class/Request
Sessionhttps://crawlee.dev/python/api/0.6/class/Session
ProxyInfohttps://crawlee.dev/python/api/0.6/class/ProxyInfo
Statisticshttps://crawlee.dev/python/api/0.6/class/Statistics
HttpCrawlingResulthttps://crawlee.dev/python/api/0.6/class/HttpCrawlingResult
https://crawlee.dev/python/api/0.6/class/HttpClient#send_request
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L126
HttpResponsehttps://crawlee.dev/python/api/0.6/class/HttpResponse
HttpClient.send_requesthttps://crawlee.dev/python/api/0.6/class/HttpClient#send_request
HttpHeadershttps://crawlee.dev/python/api/0.6/class/HttpHeaders
byteshttps://crawlee.dev/python/api/0.6/class/ByteSize#bytes
Sessionhttps://crawlee.dev/python/api/0.6/class/Session
ProxyInfohttps://crawlee.dev/python/api/0.6/class/ProxyInfo
HttpResponsehttps://crawlee.dev/python/api/0.6/class/HttpResponse
https://crawlee.dev/python/api/0.6/class/HttpClient#stream
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L156
HttpResponsehttps://crawlee.dev/python/api/0.6/class/HttpResponse
HttpClient.streamhttps://crawlee.dev/python/api/0.6/class/HttpClient#stream
HttpHeadershttps://crawlee.dev/python/api/0.6/class/HttpHeaders
byteshttps://crawlee.dev/python/api/0.6/class/ByteSize#bytes
Sessionhttps://crawlee.dev/python/api/0.6/class/Session
ProxyInfohttps://crawlee.dev/python/api/0.6/class/ProxyInfo
HttpResponsehttps://crawlee.dev/python/api/0.6/class/HttpResponse
https://crawlee.dev/python/api/0.6/class/HttpClient#Properties
https://crawlee.dev/python/api/0.6/class/HttpClient#active
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/http_clients/_base.py#L95
PreviousFingerprintGeneratorhttps://crawlee.dev/python/api/0.6/class/FingerprintGenerator
NextKeyValueStoreClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreClient
__aenter__https://crawlee.dev/python/api/0.6/class/HttpClient#__aenter__
__aexit__https://crawlee.dev/python/api/0.6/class/HttpClient#__aexit__
__init__https://crawlee.dev/python/api/0.6/class/HttpClient#__init__
cleanuphttps://crawlee.dev/python/api/0.6/class/HttpClient#cleanup
crawlhttps://crawlee.dev/python/api/0.6/class/HttpClient#crawl
send_requesthttps://crawlee.dev/python/api/0.6/class/HttpClient#send_request
streamhttps://crawlee.dev/python/api/0.6/class/HttpClient#stream
activehttps://crawlee.dev/python/api/0.6/class/HttpClient#active
https://crawlee.dev
Quick starthttps://crawlee.dev/python/docs/quick-start
Guideshttps://crawlee.dev/python/docs/guides
API referencehttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Discordhttps://discord.com/invite/jyEM2PRvMU
Stack Overflowhttps://stackoverflow.com/questions/tagged/crawlee-python
Twitterhttps://twitter.com/apify
YouTubehttps://www.youtube.com/apify
Apify platformhttps://apify.com
Docusaurushttps://docusaurus.io
GitHubhttps://github.com/apify/crawlee-python

Viewport: width=device-width, initial-scale=1.0


URLs of crawlers that visited me.