René's URL Explorer Experiment


Title: MemoryStorageClient | API | Crawlee for Python · Fast, reliable Python web crawlers.

Open Graph Title: MemoryStorageClient | API | Crawlee for Python · Fast, reliable Python web crawlers.

Description: Represents an in-memory storage client for managing datasets, key-value stores, and request queues.

Open Graph Description: Represents an in-memory storage client for managing datasets, key-value stores, and request queues.

Opengraph URL: https://crawlee.dev/python/api/0.6/class/MemoryStorageClient

Generator: Docusaurus v3.10.2

direct link

Domain: crawlee.dev


Hey, it has json ld scripts:
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[]}

twitter:cardsummary_large_image
og:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
twitter:imagehttps://crawlee.dev/python/img/crawlee-python-og.png
og:localeen
docusaurus_localeen
docsearch:languageen
docusaurus_version0.6
docusaurus_tagdocs-default-0.6
docsearch:version0.6
docsearch:docusaurus_tagdocs-default-0.6

Links:

Skip to main contenthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#__docusaurus_skipToContent_fallback
Crawlee for Pythonhttps://crawlee.dev/python/
https://crawlee.dev/js
https://crawlee.dev/python/
https://crawlee.dev
Docshttps://crawlee.dev/python/docs/quick-start
APIhttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Bloghttps://crawlee.dev/blog
0.6https://crawlee.dev/python/api/0.6
Nexthttps://crawlee.dev/python/api/next
1.11https://crawlee.dev/python/api
0.6https://crawlee.dev/python/api/0.6
Get startedhttps://crawlee.dev/python/docs/quick-start
Crawlee for Pythonhttps://crawlee.dev/python/
Overviewhttps://crawlee.dev/python/api/0.6
Abstract classeshttps://crawlee.dev/python/api/0.6/class/AbstractHttpCrawler
Classeshttps://crawlee.dev/python/api/0.6/class/AdaptivePlaywrightCrawler
AdaptivePlaywrightCrawlerhttps://crawlee.dev/python/api/0.6/class/AdaptivePlaywrightCrawler
AutoscaledPoolhttps://crawlee.dev/python/api/0.6/class/AutoscaledPool
BasicCrawlerhttps://crawlee.dev/python/api/0.6/class/BasicCrawler
BeautifulSoupCrawlerhttps://crawlee.dev/python/api/0.6/class/BeautifulSoupCrawler
BrowserforgeFingerprintGeneratorhttps://crawlee.dev/python/api/0.6/class/BrowserforgeFingerprintGenerator
BrowserPoolhttps://crawlee.dev/python/api/0.6/class/BrowserPool
ContextPipelinehttps://crawlee.dev/python/api/0.6/class/ContextPipeline
CurlImpersonateHttpClienthttps://crawlee.dev/python/api/0.6/class/CurlImpersonateHttpClient
Datasethttps://crawlee.dev/python/api/0.6/class/Dataset
DefaultRenderingTypePredictorhttps://crawlee.dev/python/api/0.6/class/DefaultRenderingTypePredictor
EventManagerhttps://crawlee.dev/python/api/0.6/class/EventManager
HeaderGeneratorhttps://crawlee.dev/python/api/0.6/class/HeaderGenerator
HttpCrawlerhttps://crawlee.dev/python/api/0.6/class/HttpCrawler
HttpxHttpClienthttps://crawlee.dev/python/api/0.6/class/HttpxHttpClient
KeyValueStorehttps://crawlee.dev/python/api/0.6/class/KeyValueStore
LocalEventManagerhttps://crawlee.dev/python/api/0.6/class/LocalEventManager
MemoryStorageClienthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient
ParselCrawlerhttps://crawlee.dev/python/api/0.6/class/ParselCrawler
PlaywrightBrowserControllerhttps://crawlee.dev/python/api/0.6/class/PlaywrightBrowserController
PlaywrightBrowserPluginhttps://crawlee.dev/python/api/0.6/class/PlaywrightBrowserPlugin
PlaywrightCrawlerhttps://crawlee.dev/python/api/0.6/class/PlaywrightCrawler
ProxyConfigurationhttps://crawlee.dev/python/api/0.6/class/ProxyConfiguration
RenderingTypePredictorhttps://crawlee.dev/python/api/0.6/class/RenderingTypePredictor
RequestListhttps://crawlee.dev/python/api/0.6/class/RequestList
RequestManagerTandemhttps://crawlee.dev/python/api/0.6/class/RequestManagerTandem
RequestQueuehttps://crawlee.dev/python/api/0.6/class/RequestQueue
Routerhttps://crawlee.dev/python/api/0.6/class/Router
ServiceLocatorhttps://crawlee.dev/python/api/0.6/class/ServiceLocator
SessionPoolhttps://crawlee.dev/python/api/0.6/class/SessionPool
Snapshotterhttps://crawlee.dev/python/api/0.6/class/Snapshotter
Statisticshttps://crawlee.dev/python/api/0.6/class/Statistics
SystemStatushttps://crawlee.dev/python/api/0.6/class/SystemStatus
Data structureshttps://crawlee.dev/python/api/0.6/class/AdaptivePlaywrightCrawlerStatisticState
Errorshttps://crawlee.dev/python/api/0.6/class/ContextPipelineFinalizationError
Event payloadshttps://crawlee.dev/python/api/0.6/class/EventAbortingData
Functionshttps://crawlee.dev/python/api/0.6/class/AddRequestsFunction
1.11https://crawlee.dev/python/api
https://crawlee.dev/python/
StorageClienthttps://crawlee.dev/python/api/0.6/class/StorageClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#Index
__init__https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#__init__
add_resource_client_to_cachehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#add_resource_client_to_cache
datasethttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#dataset
datasetshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets
from_confighttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#from_config
get_cached_resource_clienthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_cached_resource_client
get_rate_limit_errorshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_rate_limit_errors
key_value_storehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_store
key_value_storeshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores
purge_on_starthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#purge_on_start
request_queuehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queue
request_queueshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues
datasets_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets_directory
key_value_stores_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores_directory
persist_storagehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#persist_storage
request_queues_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues_directory
storage_dirhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#storage_dir
write_metadatahttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#write_metadata
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#Methods
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#__init__
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L59
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#add_resource_client_to_cache
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L209
ResourceClienthttps://crawlee.dev/python/api/0.6#ResourceClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#dataset
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L146
DatasetClienthttps://crawlee.dev/python/api/0.6/class/DatasetClient
StorageClient.datasethttps://crawlee.dev/python/api/0.6/class/StorageClient#dataset
DatasetClienthttps://crawlee.dev/python/api/0.6/class/DatasetClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L150
DatasetCollectionClienthttps://crawlee.dev/python/api/0.6/class/DatasetCollectionClient
StorageClient.datasetshttps://crawlee.dev/python/api/0.6/class/StorageClient#datasets
DatasetCollectionClienthttps://crawlee.dev/python/api/0.6/class/DatasetCollectionClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#from_config
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L98
MemoryStorageClienthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient
Configurationhttps://crawlee.dev/python/api/0.6/class/Configuration
MemoryStorageClienthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_cached_resource_client
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L185
TResourceClienthttps://crawlee.dev/python/api/0.6#TResourceClient
TResourceClienthttps://crawlee.dev/python/api/0.6#TResourceClient
TResourceClienthttps://crawlee.dev/python/api/0.6#TResourceClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_rate_limit_errors
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_base/_storage_client.py#L60
StorageClient.get_rate_limit_errorshttps://crawlee.dev/python/api/0.6/class/StorageClient#get_rate_limit_errors
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_store
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L154
KeyValueStoreClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreClient
StorageClient.key_value_storehttps://crawlee.dev/python/api/0.6/class/StorageClient#key_value_store
KeyValueStoreClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L158
KeyValueStoreCollectionClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreCollectionClient
StorageClient.key_value_storeshttps://crawlee.dev/python/api/0.6/class/StorageClient#key_value_stores
KeyValueStoreCollectionClienthttps://crawlee.dev/python/api/0.6/class/KeyValueStoreCollectionClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#purge_on_start
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L170
StorageClient.purge_on_starthttps://crawlee.dev/python/api/0.6/class/StorageClient#purge_on_start
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queue
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L162
RequestQueueClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueClient
StorageClient.request_queuehttps://crawlee.dev/python/api/0.6/class/StorageClient#request_queue
RequestQueueClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L166
RequestQueueCollectionClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueCollectionClient
StorageClient.request_queueshttps://crawlee.dev/python/api/0.6/class/StorageClient#request_queues
RequestQueueCollectionClienthttps://crawlee.dev/python/api/0.6/class/RequestQueueCollectionClient
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#Properties
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets_directory
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L131
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores_directory
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L136
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#persist_storage
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L121
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues_directory
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L141
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#storage_dir
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L126
https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#write_metadata
https://github.com/apify/crawlee-python/blob/02a18ea618daf8c55d9ca272249b58aa45caa4ea//crawlee/storage_clients/_memory/_memory_storage_client.py#L116
PreviousLocalEventManagerhttps://crawlee.dev/python/api/0.6/class/LocalEventManager
NextParselCrawlerhttps://crawlee.dev/python/api/0.6/class/ParselCrawler
__init__https://crawlee.dev/python/api/0.6/class/MemoryStorageClient#__init__
add_resource_client_to_cachehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#add_resource_client_to_cache
datasethttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#dataset
datasetshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets
from_confighttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#from_config
get_cached_resource_clienthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_cached_resource_client
get_rate_limit_errorshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#get_rate_limit_errors
key_value_storehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_store
key_value_storeshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores
purge_on_starthttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#purge_on_start
request_queuehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queue
request_queueshttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues
datasets_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#datasets_directory
key_value_stores_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#key_value_stores_directory
persist_storagehttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#persist_storage
request_queues_directoryhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#request_queues_directory
storage_dirhttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#storage_dir
write_metadatahttps://crawlee.dev/python/api/0.6/class/MemoryStorageClient#write_metadata
https://crawlee.dev
Quick starthttps://crawlee.dev/python/docs/quick-start
Guideshttps://crawlee.dev/python/docs/guides
API referencehttps://crawlee.dev/python/api
Changeloghttps://crawlee.dev/python/docs/changelog
Discordhttps://discord.com/invite/jyEM2PRvMU
Stack Overflowhttps://stackoverflow.com/questions/tagged/crawlee-python
Twitterhttps://twitter.com/apify
YouTubehttps://www.youtube.com/apify
Apify platformhttps://apify.com
Docusaurushttps://docusaurus.io
GitHubhttps://github.com/apify/crawlee-python

Viewport: width=device-width, initial-scale=1.0


URLs of crawlers that visited me.