René's URL Explorer Experiment


Title: Processing Data from the Cloud — Lithops documentation

direct link

Domain: lithops-cloud.github.io

docsearch:languageen

Links:

Skip to main contenthttps://lithops-cloud.github.io/docs/source/data_processing.html#main-content
Lithops v3.7.0 https://lithops-cloud.github.io/docs/index.html
Welcome to Lithops!https://lithops-cloud.github.io/docs/index.html
Architecture Designhttps://lithops-cloud.github.io/docs/source/design.html
Comparing Lithops with Other Distributed Computing Frameworkshttps://lithops-cloud.github.io/docs/source/comparing_lithops.html
Supported Cloudshttps://lithops-cloud.github.io/docs/source/supported_clouds.html
Execution Modeshttps://lithops-cloud.github.io/docs/source/execution_modes.html
Lithops Command Line Toolhttps://lithops-cloud.github.io/docs/source/cli.html
Installing Lithopshttps://lithops-cloud.github.io/docs/source/install_lithops.html
Configurationhttps://lithops-cloud.github.io/docs/source/configuration.html
Compute Backendshttps://lithops-cloud.github.io/docs/source/compute_backends.html
Localhosthttps://lithops-cloud.github.io/docs/source/compute_config/localhost.html
AWS Lambdahttps://lithops-cloud.github.io/docs/source/compute_config/aws_lambda.html
Google Cloud Run functions (v2)https://lithops-cloud.github.io/docs/source/compute_config/gcp_functions.html
Azure Functionshttps://lithops-cloud.github.io/docs/source/compute_config/azure_functions.html
Oracle Functionshttps://lithops-cloud.github.io/docs/source/compute_config/oracle_functions.html
Aliyun Function Computehttps://lithops-cloud.github.io/docs/source/compute_config/aliyun_functions.html
OpenWhiskhttps://lithops-cloud.github.io/docs/source/compute_config/openwhisk.html
IBM Cloud Code Enginehttps://lithops-cloud.github.io/docs/source/compute_config/code_engine.html
AWS Batchhttps://lithops-cloud.github.io/docs/source/compute_config/aws_batch.html
Google Cloud Runhttps://lithops-cloud.github.io/docs/source/compute_config/gcp_cloudrun.html
Azure Container Appshttps://lithops-cloud.github.io/docs/source/compute_config/azure_containers.html
Kuberneteshttps://lithops-cloud.github.io/docs/source/compute_config/kubernetes.html
Knativehttps://lithops-cloud.github.io/docs/source/compute_config/knative.html
Singularityhttps://lithops-cloud.github.io/docs/source/compute_config/singularity.html
Virtual Machinehttps://lithops-cloud.github.io/docs/source/compute_config/vm.html
IBM Virtual Private Cloudhttps://lithops-cloud.github.io/docs/source/compute_config/ibm_vpc.html
AWS Elastic Compute Cloud (EC2)https://lithops-cloud.github.io/docs/source/compute_config/aws_ec2.html
Azure Virtual Machineshttps://lithops-cloud.github.io/docs/source/compute_config/azure_vms.html
Google Compute Engine (GCE)https://lithops-cloud.github.io/docs/source/compute_config/gcp_compute_engine.html
Storage Backendshttps://lithops-cloud.github.io/docs/source/storage_backends.html
Localhosthttps://lithops-cloud.github.io/docs/source/compute_config/localhost.html
IBM Cloud Object Storagehttps://lithops-cloud.github.io/docs/source/storage_config/ibm_cos.html
AWS S3https://lithops-cloud.github.io/docs/source/storage_config/aws_s3.html
GCP Storagehttps://lithops-cloud.github.io/docs/source/storage_config/gcp_storage.html
Azure Blob Storagehttps://lithops-cloud.github.io/docs/source/storage_config/azure_blob.html
Aliyun Object Storage Servicehttps://lithops-cloud.github.io/docs/source/storage_config/aliyun_oss.html
Oracle Object Storagehttps://lithops-cloud.github.io/docs/source/storage_config/oracle_oss.html
Cephhttps://lithops-cloud.github.io/docs/source/storage_config/ceph.html
MinIOhttps://lithops-cloud.github.io/docs/source/storage_config/minio.html
Swifthttps://lithops-cloud.github.io/docs/source/storage_config/swift.html
Redishttps://lithops-cloud.github.io/docs/source/storage_config/redis.html
Infinispanhttps://lithops-cloud.github.io/docs/source/storage_config/infinispan.html
Lithops Futures APIhttps://lithops-cloud.github.io/docs/source/api_futures.html
Functions and Parametershttps://lithops-cloud.github.io/docs/source/functions.html
Worker Granularityhttps://lithops-cloud.github.io/docs/source/worker_granularity.html
Function chaininghttps://lithops-cloud.github.io/docs/source/notebooks/function_chaining.html
Execution statshttps://lithops-cloud.github.io/docs/source/api_stats.html
Storage API Detailshttps://lithops-cloud.github.io/docs/source/api_storage.html
Processing Data from the Cloudhttps://lithops-cloud.github.io/docs/source/data_processing.html
Data Partitioninghttps://lithops-cloud.github.io/docs/source/data_partitioning.html
Multiprocessing APIhttps://lithops-cloud.github.io/docs/source/api_multiprocessing.html
Storage OS APIhttps://lithops-cloud.github.io/docs/source/api_storage_os.html
Distributed Scikit-learn / Joblibhttps://lithops-cloud.github.io/docs/source/sklearn_joblib.html
Apache Airflowhttps://lithops-cloud.github.io/docs/source/airflow.html
Monitoringhttps://lithops-cloud.github.io/docs/source/monitoring.html
Custom Runtimeshttps://github.com/lithops-cloud/lithops/tree/master/runtime
Prometheus Monitoringhttps://lithops-cloud.github.io/docs/source/metrics.html
Distributed shared objectshttps://lithops-cloud.github.io/docs/source/dso.html
Applicationshttps://github.com/lithops-cloud/applications
Contributing to Lithopshttps://lithops-cloud.github.io/docs/source/contributing.html
Changeloghttps://github.com/lithops-cloud/lithops/blob/master/CHANGELOG.md
https://github.com/lithops-cloud/lithops
.rst https://lithops-cloud.github.io/docs/_sources/source/data_processing.rst
Processing Data from the Cloudhttps://lithops-cloud.github.io/docs/source/data_processing.html
Data Partitioninghttps://lithops-cloud.github.io/docs/source/data_processing.html#data-partitioning
Cloud Object Storage Integrationhttps://lithops-cloud.github.io/docs/source/data_processing.html#cloud-object-storage-integration
Accessing Object Metadatahttps://lithops-cloud.github.io/docs/source/data_processing.html#accessing-object-metadata
Accepted Input Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#accepted-input-formats
Putting It All Togetherhttps://lithops-cloud.github.io/docs/source/data_processing.html#putting-it-all-together
Processing Data from Public URLshttps://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-public-urls
Processing Data from Localhost Fileshttps://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-localhost-files
Reducer Granularityhttps://lithops-cloud.github.io/docs/source/data_processing.html#reducer-granularity
Elastic Data Processing and Cloud-Optimized Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#elastic-data-processing-and-cloud-optimized-formats
Cloud-Optimized Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#cloud-optimized-formats
Partitioning Non-Optimized Formats with Dataplughttps://lithops-cloud.github.io/docs/source/data_processing.html#partitioning-non-optimized-formats-with-dataplug
Example: Parallel Processing of a Cloud-Hosted LIDAR Filehttps://lithops-cloud.github.io/docs/source/data_processing.html#example-parallel-processing-of-a-cloud-hosted-lidar-file
#https://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-the-cloud
#https://lithops-cloud.github.io/docs/source/data_processing.html#data-partitioning
#https://lithops-cloud.github.io/docs/source/data_processing.html#cloud-object-storage-integration
#https://lithops-cloud.github.io/docs/source/data_processing.html#accessing-object-metadata
#https://lithops-cloud.github.io/docs/source/data_processing.html#accepted-input-formats
#https://lithops-cloud.github.io/docs/source/data_processing.html#putting-it-all-together
#https://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-public-urls
map_reduce_url.pyhttps://github.com/lithops-cloud/lithops/blob/master/examples/map_reduce_url.py
#https://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-localhost-files
map_reduce_localhost.pyhttps://github.com/lithops-cloud/lithops/blob/master/examples/map_reduce_localhost.py
#https://lithops-cloud.github.io/docs/source/data_processing.html#reducer-granularity
#https://lithops-cloud.github.io/docs/source/data_processing.html#elastic-data-processing-and-cloud-optimized-formats
#https://lithops-cloud.github.io/docs/source/data_processing.html#cloud-optimized-formats
#https://lithops-cloud.github.io/docs/source/data_processing.html#partitioning-non-optimized-formats-with-dataplug
DATAPLUGhttps://github.com/CLOUDLAB-URV/dataplug
#https://lithops-cloud.github.io/docs/source/data_processing.html#example-parallel-processing-of-a-cloud-hosted-lidar-file
previous Storage API Details https://lithops-cloud.github.io/docs/source/api_storage.html
next Data Partitioning https://lithops-cloud.github.io/docs/source/data_partitioning.html
Processing Data from the Cloudhttps://lithops-cloud.github.io/docs/source/data_processing.html
Data Partitioninghttps://lithops-cloud.github.io/docs/source/data_processing.html#data-partitioning
Cloud Object Storage Integrationhttps://lithops-cloud.github.io/docs/source/data_processing.html#cloud-object-storage-integration
Accessing Object Metadatahttps://lithops-cloud.github.io/docs/source/data_processing.html#accessing-object-metadata
Accepted Input Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#accepted-input-formats
Putting It All Togetherhttps://lithops-cloud.github.io/docs/source/data_processing.html#putting-it-all-together
Processing Data from Public URLshttps://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-public-urls
Processing Data from Localhost Fileshttps://lithops-cloud.github.io/docs/source/data_processing.html#processing-data-from-localhost-files
Reducer Granularityhttps://lithops-cloud.github.io/docs/source/data_processing.html#reducer-granularity
Elastic Data Processing and Cloud-Optimized Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#elastic-data-processing-and-cloud-optimized-formats
Cloud-Optimized Formatshttps://lithops-cloud.github.io/docs/source/data_processing.html#cloud-optimized-formats
Partitioning Non-Optimized Formats with Dataplughttps://lithops-cloud.github.io/docs/source/data_processing.html#partitioning-non-optimized-formats-with-dataplug
Example: Parallel Processing of a Cloud-Hosted LIDAR Filehttps://lithops-cloud.github.io/docs/source/data_processing.html#example-parallel-processing-of-a-cloud-hosted-lidar-file

Viewport: width=device-width, initial-scale=1

URLs of crawlers that visited me.