| Skip to content | https://deeplearningdispatch.com#content |
| Tech Blogs | https://deeplearningdispatch.com/ |
|
| https://deeplearningdispatch.com/ |
| Agent2Agent | https://deeplearningdispatch.com/category/agent2agent/ |
| AgenticAI | https://deeplearningdispatch.com/category/agenticai/ |
| AI | https://deeplearningdispatch.com/category/ai/ |
| GoogleADK | https://deeplearningdispatch.com/category/googleadk/ |
| Running Multiple A2A Agents on a Single Server | https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/ |
| A2A Protocol Specification | https://a2a-protocol.org/latest/ |
| A2A Project Discussions | https://github.com/a2aproject/A2A/discussions/166 |
| Google ADK Documentation | https://google.github.io/adk-docs/ |
| A2A Samples Repository | https://github.com/a2aproject/a2a-samples |
| Multiple Agents on a Single A2A Server | https://github.com/satendrakumar/multiple-agents-on-single-a2a-server |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/?share=reddit |
| August 16, 2025August 16, 2025 | https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/ |
| Agent2Agent | https://deeplearningdispatch.com/tag/agent2agent/ |
| Agentic-AI | https://deeplearningdispatch.com/tag/agentic-ai/ |
| Architecture | https://deeplearningdispatch.com/tag/architecture/ |
| FastAPI | https://deeplearningdispatch.com/tag/fastapi/ |
| GoogleADK | https://deeplearningdispatch.com/tag/googleadk/ |
| Leave a comment | https://deeplearningdispatch.com/2025/08/16/running-multiple-a2a-agents-on-a-single-server/#respond |
| Embedding | https://deeplearningdispatch.com/category/embedding/ |
| Huggingface | https://deeplearningdispatch.com/category/huggingface/ |
| LanceDB | https://deeplearningdispatch.com/category/lancedb/ |
| LLM | https://deeplearningdispatch.com/category/llm/ |
| RAG | https://deeplearningdispatch.com/category/rag-2/ |
| How to Build a Simple Retrieval-Augmented Generation (RAG) System | https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/ |
| climate science data | https://www.ipcc.ch/report/ar6/syr/downloads/report/IPCC_AR6_SYR_LongerReport.pdf |
| https://deeplearningdispatch.com/wp-content/uploads/2025/07/rag-architecture-2.jpg |
| docling | https://docling-project.github.io/docling/ |
| code repository | https://github.com/satendrakumar/simple-rag-example |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/?share=reddit |
| July 18, 2025July 19, 2025 | https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/ |
| AIML | https://deeplearningdispatch.com/tag/aiml/ |
| Embeddings | https://deeplearningdispatch.com/tag/embeddings/ |
| LLM | https://deeplearningdispatch.com/tag/llm/ |
| Prompt | https://deeplearningdispatch.com/tag/prompt/ |
| QWEN | https://deeplearningdispatch.com/tag/qwen/ |
| RAG | https://deeplearningdispatch.com/tag/rag/ |
| Leave a comment | https://deeplearningdispatch.com/2025/07/18/how-to-build-a-simple-retrieval-augmented-generation-rag/#respond |
| AIML, LLM, vLLM, LiteLLM | https://deeplearningdispatch.com/category/ml-ai/aiml/aiml-llm-vllm-litellm/ |
| Unified Inference Server with LiteLLM: Simplifying Multi-LLM Deployments | https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/ |
| Llama 3.1 8B | https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct |
| Mistral 7B | https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3 |
| LiteLLM | https://www.litellm.ai/ |
| http://xx.0.139.5:4000/ | http://xx.0.139.5:4000/ |
| https://deeplearningdispatch.com/wp-content/uploads/2025/04/image.png |
| http://xx.0.139.5:4000/ui | http://xx.0.139.5:4000/ui |
| https://deeplearningdispatch.com/wp-content/uploads/2025/04/image-1.png |
| http://xx.0.139.5:4000/ui/?userID=default_user_id | http://xx.0.139.5:4000/ui/?userID=default_user_id |
| https://deeplearningdispatch.com/wp-content/uploads/2025/04/image-2.png |
| https://github.com/satendrakumar/LiteLLM-deployment | https://github.com/satendrakumar/LiteLLM-deployment |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/?share=reddit |
| April 6, 2025April 10, 2025 | https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/ |
| AIML | https://deeplearningdispatch.com/tag/aiml/ |
| Deployment | https://deeplearningdispatch.com/tag/deployment/ |
| LiteLLM | https://deeplearningdispatch.com/tag/litellm/ |
| LLM | https://deeplearningdispatch.com/tag/llm/ |
| VLLM | https://deeplearningdispatch.com/tag/vllm/ |
| Leave a comment | https://deeplearningdispatch.com/2025/04/06/unified-inference-server-with-litellm-simplifying-multi-llm-deployments/#respond |
| AIML | https://deeplearningdispatch.com/category/ml-ai/aiml/ |
| AWS | https://deeplearningdispatch.com/category/aws/ |
| GPU | https://deeplearningdispatch.com/category/gpu/ |
| Hugging Face | https://deeplearningdispatch.com/category/hugging-face/ |
| Triton Inference Server | https://deeplearningdispatch.com/category/triton-inference-server/ |
| Deploying Hugging Face model on NVIDIA Triton inference Server | https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/ |
| Hugging face Model | https://huggingface.co/ |
| NVIDIA Triton inference Server | https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/getting_started/quickstart.html |
| AWS EC2 p3.2xlarge | https://aws.amazon.com/ec2/instance-types/p3/ |
| https://deeplearningdispatch.com/wp-content/uploads/2023/08/image.png |
| Python Models | https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/user_guide/model_repository.html#python-models |
| Hugging Face sentiment model | https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest |
| https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/getting_started/quickstart.html | https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/getting_started/quickstart.html |
| https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest | https://huggingface.co/cardiffnlp/twitter-roberta-base-sentiment-latest |
| https://github.com/triton-inference-server/tutorials/tree/main/HuggingFace | https://github.com/triton-inference-server/tutorials/tree/main/HuggingFace |
| https://github.com/satendrakumar/huggingface-triton-server | https://github.com/satendrakumar/huggingface-triton-server |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/?share=reddit |
| August 7, 2023April 6, 2025 | https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/ |
| AIML | https://deeplearningdispatch.com/tag/aiml/ |
| AWS | https://deeplearningdispatch.com/tag/aws/ |
| Hugging Face | https://deeplearningdispatch.com/tag/hugging-face/ |
| Triton Inference Server | https://deeplearningdispatch.com/tag/triton-inference-server/ |
| Leave a comment | https://deeplearningdispatch.com/2023/08/07/deploying-hugging-face-model-on-nvidia-triton-inference-server/#respond |
| Big Data | https://deeplearningdispatch.com/category/big-data/ |
| Druid | https://deeplearningdispatch.com/category/druid/ |
| EKS | https://deeplearningdispatch.com/category/eks/ |
| Spark | https://deeplearningdispatch.com/category/spark/ |
| Data ingestion into Druid | https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/ |
| other | https://druid.apache.org/docs/latest/ingestion/data-formats.html |
| more details | https://druid.apache.org/docs/latest/ingestion/index.html |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-1.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-3.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-2.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-4.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-5.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/image-6.png |
| https://druid.apache.org/docs/latest/ingestion/index.html | https://druid.apache.org/docs/latest/ingestion/index.html |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/?share=reddit |
| July 8, 2023July 8, 2023 | https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/ |
| Big Data | https://deeplearningdispatch.com/tag/big-data/ |
| Druid | https://deeplearningdispatch.com/tag/druid/ |
| EKS | https://deeplearningdispatch.com/tag/eks/ |
| Kubernetes | https://deeplearningdispatch.com/tag/kubernetes/ |
| Leave a comment | https://deeplearningdispatch.com/2023/07/08/data-ingestion-into-druid/#respond |
| AWS | https://deeplearningdispatch.com/category/aws/ |
| Big Data | https://deeplearningdispatch.com/category/big-data/ |
| EKS | https://deeplearningdispatch.com/category/eks/ |
| Kubernetes | https://deeplearningdispatch.com/category/kubernetes/ |
| S3 Magic Committer | https://deeplearningdispatch.com/category/big-data/s3-magic-committer/ |
| Scala | https://deeplearningdispatch.com/category/scala/ |
| Spark | https://deeplearningdispatch.com/category/spark/ |
| Spark On EKS: Enable S3 Magic committer | https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/ |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/dag.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/job1-stages.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/07/job-1.png |
| Spark Hadoop cloud | https://mvnrepository.com/artifact/org.apache.spark/spark-hadoop-cloud_2.12/3.4.1 |
| code | https://github.com/techmonad/postgres2S3 |
| https://spark.apache.org/ | https://spark.apache.org/ |
| S3 Magic committe | https://hadoop.apache.org/docs/r3.1.1/hadoop-aws/tools/hadoop-aws/committers.html#Using_the_Magic_committer |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/?share=reddit |
| July 2, 2023July 3, 2023 | https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/ |
| AWS | https://deeplearningdispatch.com/tag/aws/ |
| EKS | https://deeplearningdispatch.com/tag/eks/ |
| Kubernetes | https://deeplearningdispatch.com/tag/kubernetes/ |
| S3 | https://deeplearningdispatch.com/tag/s3/ |
| S3 Magic Committer | https://deeplearningdispatch.com/tag/s3-magic-committer/ |
| Scala | https://deeplearningdispatch.com/tag/scala/ |
| Spark | https://deeplearningdispatch.com/tag/spark/ |
| Leave a comment | https://deeplearningdispatch.com/2023/07/02/spark-on-eks-enable-s3-magic-committer/#respond |
| AWS | https://deeplearningdispatch.com/category/aws/ |
| Big Data | https://deeplearningdispatch.com/category/big-data/ |
| Druid | https://deeplearningdispatch.com/category/druid/ |
| EKS | https://deeplearningdispatch.com/category/eks/ |
| Kubernetes | https://deeplearningdispatch.com/category/kubernetes/ |
| OLAP | https://deeplearningdispatch.com/category/olap/ |
| Zookeeper | https://deeplearningdispatch.com/category/zookeeper/ |
| Druid cluster setup on AWS EKS | https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/ |
| Elastic Kubernetes Service | https://us-east-1.console.aws.amazon.com/eks/home?region=us-east-1#/home |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-12-21-44.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-12-33-29.png |
| taints | https://kubernetes.io/docs/concepts/scheduling-eviction/taint-and-toleration/ |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-12-36-44.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-12-41-52.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-13-12-22-1.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-13-14-43.png |
| bitnami helm charts | https://github.com/bitnami/charts/tree/main/bitnami/zookeeper |
| zookeeper configuration | https://github.com/satendrakumar/DRUID-ON-EKS/blob/develop/zookeeper/values.yaml |
| Druid operator | https://github.com/druid-io/druid-operator |
| here | https://github.com/satendrakumar/DRUID-ON-EKS |
| dev-cluster.yaml | https://github.com/satendrakumar/DRUID-ON-EKS/blob/develop/druid-cluster/dev-cluster.yaml |
| http://localhost:8088 | http://localhost:8088 |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-42-08.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-44-47.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-47-20.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-48-52.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/image.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-51-02.png |
| https://deeplearningdispatch.com/wp-content/uploads/2023/06/screenshot-from-2023-06-18-14-52-07.png |
| Druid | https://druid.apache.org/ |
| Druid-operator | https://github.com/druid-io/druid-operator |
| Zookeeper | https://github.com/bitnami/charts/tree/main/bitnami/zookeeper |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/?share=reddit |
| June 24, 2023June 24, 2023 | https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/ |
| AWS | https://deeplearningdispatch.com/tag/aws/ |
| Big Data | https://deeplearningdispatch.com/tag/big-data/ |
| Druid | https://deeplearningdispatch.com/tag/druid/ |
| EKS | https://deeplearningdispatch.com/tag/eks/ |
| Kubernetes | https://deeplearningdispatch.com/tag/kubernetes/ |
| OLAP | https://deeplearningdispatch.com/tag/olap/ |
| Leave a comment | https://deeplearningdispatch.com/2023/06/24/druid-cluster-setup-on-aws-eks/#respond |
| Akka | https://deeplearningdispatch.com/category/akka/ |
| Scala | https://deeplearningdispatch.com/category/scala/ |
| Why I love foldLeft :) | https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/ |
| Scala doc | https://www.scala-lang.org/api/2.12.2/scala/collection/immutable/List.html#foldRight[B](z:B)(op:(A,B)=>B):B |
| here | https://gist.github.com/satendrakumar/262e515f388fb3a678d19aa67dcd5d65 |
|
Click to share on X (Opens in new window)
X
| https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/?share=twitter |
|
Click to share on Facebook (Opens in new window)
Facebook
| https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/?share=facebook |
|
Click to share on LinkedIn (Opens in new window)
LinkedIn
| https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/?share=linkedin |
|
Click to share on Reddit (Opens in new window)
Reddit
| https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/?share=reddit |
| June 11, 2017June 11, 2017 | https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/ |
| Best practices | https://deeplearningdispatch.com/tag/best-practices/ |
| Scala | https://deeplearningdispatch.com/tag/scala/ |
| 2 Comments | https://deeplearningdispatch.com/2017/06/11/why-i-love-foldleft/#comments |
| Blog at WordPress.com. | https://wordpress.com/?ref=footer_blog |
|
Subscribe
| https://deeplearningdispatch.com |
|
Subscribed
| https://deeplearningdispatch.com |
|
Tech Blogs | https://deeplearningdispatch.com |
| Log in now. | https://wordpress.com/log-in?redirect_to=https%3A%2F%2Fr-login.wordpress.com%2Fremote-login.php%3Faction%3Dlink%26back%3Dhttps%253A%252F%252Fdeeplearningdispatch.com%252F2025%252F08%252F16%252Frunning-multiple-a2a-agents-on-a-single-server%252F |
|
Tech Blogs | https://deeplearningdispatch.com |
|
Subscribe
| https://deeplearningdispatch.com |
|
Subscribed
| https://deeplearningdispatch.com |
| Sign up | https://wordpress.com/start/ |
| Log in | https://wordpress.com/log-in?redirect_to=https%3A%2F%2Fr-login.wordpress.com%2Fremote-login.php%3Faction%3Dlink%26back%3Dhttps%253A%252F%252Fdeeplearningdispatch.com%252F2025%252F08%252F16%252Frunning-multiple-a2a-agents-on-a-single-server%252F |
|
Report this content | https://wordpress.com/abuse/?report_url=https://deeplearningdispatch.com |
|
View site in Reader | https://wordpress.com/reader/feeds/162214390 |
| Manage subscriptions | https://subscribe.wordpress.com/ |
| Collapse this bar | https://deeplearningdispatch.com |
|
| https://deeplearningdispatch.com |
|
| https://deeplearningdispatch.com |
|
| https://deeplearningdispatch.com |