René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Publishing to pub/sub works unstable","articleBody":"I am using exact example of publish message to pub/sub from https://cloud.google.com/pubsub/docs/publisher\r\n\r\nwith only one small modification \r\nmy loop looks like :   ` for (i in 1..1000000)` \r\nand the message has 16kb of text from Wikipedia\r\n\r\nIf loop is 1000 I see console output of ids (workds fine)\r\nbut with 10000 I already got error:\r\n\r\n```\r\nException in thread \"main\" java.util.concurrent.ExecutionException: com.google.api.gax.rpc.DeadlineExceededException: io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: deadline exceeded after 9999958540ns\r\n\tat com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:500)\r\n\tat com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:479)\r\n\tat com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:76)\r\n\tat com.google.common.util.concurrent.ForwardingFuture.get(ForwardingFuture.java:62)\r\n\tat TestRunKt.main(TestRun.kt:81)\r\nCaused by: com.google.api.gax.rpc.DeadlineExceededException: io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: deadline exceeded after 9999958540ns\r\n\tat com.google.api.gax.rpc.ApiExceptionFactory.createException(ApiExceptionFactory.java:51)\r\n\tat com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:72)\r\n\tat com.google.api.gax.grpc.GrpcApiExceptionFactory.create(GrpcApiExceptionFactory.java:60)\r\n\tat com.google.api.gax.grpc.GrpcExceptionCallable$ExceptionTransformingFuture.onFailure(GrpcExceptionCallable.java:95)\r\n\tat com.google.api.core.ApiFutures$1.onFailure(ApiFutures.java:61)\r\n\tat com.google.common.util.concurrent.Futures$4.run(Futures.java:1123)\r\n\tat com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:435)\r\n\tat com.google.common.util.concurrent.AbstractFuture.executeListener(AbstractFuture.java:900)\r\n\tat com.google.common.util.concurrent.AbstractFuture.complete(AbstractFuture.java:811)\r\n\tat com.google.common.util.concurrent.AbstractFuture.setException(AbstractFuture.java:675)\r\n\tat io.grpc.stub.ClientCalls$GrpcFuture.setException(ClientCalls.java:492)\r\n\tat io.grpc.stub.ClientCalls$UnaryStreamToFuture.onClose(ClientCalls.java:467)\r\n\tat io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:41)\r\n\tat io.grpc.internal.CensusStatsModule$StatsClientInterceptor$1$1.onClose(CensusStatsModule.java:684)\r\n\tat io.grpc.ForwardingClientCallListener.onClose(ForwardingClientCallListener.java:41)\r\n\tat io.grpc.internal.CensusTracingModule$TracingClientInterceptor$1$1.onClose(CensusTracingModule.java:391)\r\n\tat io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:475)\r\n\tat io.grpc.internal.ClientCallImpl.access$300(ClientCallImpl.java:63)\r\n\tat io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:557)\r\n\tat io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$600(ClientCallImpl.java:478)\r\n\tat io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:590)\r\n\tat io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37)\r\n\tat io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:123)\r\n\tat java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)\r\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:266)\r\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)\r\n\tat java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)\r\n\tat java.lang.Thread.run(Thread.java:748)\r\nCaused by: io.grpc.StatusRuntimeException: DEADLINE_EXCEEDED: deadline exceeded after 9999958540ns\r\n\tat io.grpc.Status.asRuntimeException(Status.java:526)\r\n\t... 19 more\r\n\r\n```\r\n\r\nIf I decrease message size to 16 byte I can send successfully 10000 or 100 000 messages without any problems.\r\n\r\nCan you explain me the problem and help to find the solution. \r\n\r\nMy main goal is to send millions of messages with as said in spec not more then 10Mb size. \r\nThanks\r\n\r\n\r\n","author":{"url":"https://github.com/pkletsko","@type":"Person","name":"pkletsko"},"datePublished":"2018-04-20T07:38:41.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/3175/google-cloud-java/issues/3175"}