René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"PrepareHostForMaintenance throws NPE when vm has custom restrained service offering","articleBody":"## Problem\n\nWhen trying to put an host in maintenance mode to trigger automatic migration of vms on it, the operation fails throwing a NullPointerException. This actually happens with both normal maintenance and rolling maintenance.\n\n## Versions\n\n- Cloudstack version: 4.22\n- Hypervisor: KVM running on oracle linux 9\n- Primary storage: local storage\n- Database: 8.0.45-36 Percona Server\n\n## The steps to reproduce the bug\n\n1. Create custom constrained offering\n```sql\nmysql\u003e select * from service_offering where uuid='c24ce908-ffaa-4ced-9610-f99fb9f8b4c8' \\G\n*************************** 1. row ***************************\n                      id: 14\n                     cpu: NULL\n                   speed: 2000\n                ram_size: NULL\n                 nw_rate: NULL\n                 mc_rate: NULL\n              ha_enabled: 0\n           limit_cpu_use: 0\n                host_tag: NULL\n             default_use: 0\n                 vm_type: NULL\n                sort_key: 0\n             is_volatile: 0\n      deployment_planner: NULL\n dynamic_scaling_enabled: 1\n                    uuid: c24ce908-ffaa-4ced-9610-f99fb9f8b4c8\n                    name: Custom-local-sparse\n            display_text: Custom-local-sparse\n             unique_name: NULL\n              customized: 1\n                 created: 2025-05-19 14:28:59\n                 removed: NULL\n                   state: Active\n        disk_offering_id: 18\n              system_use: 0\ndisk_offering_strictness: 0\n         vgpu_profile_id: NULL\n               gpu_count: NULL\n             gpu_display: 0\n1 row in set (0.00 sec)\n```\n2. Deploy vm with above offering\n3. Attempt to place the host running the VM into Maintenance mode\n# Results\n### **Normal maintenance**\n```txt\n2026-05-08 09:13:37,635 DEBUG [c.c.h.d.HostDaoImpl] (API-Job-Executor-5:[ctx-f2a20d6a, job-3207, ctx-a1adfd52]) (logid:5e43ba84) Resource state update: [id = 46; name = cslab02; old state = Enabled; event = AdminAskMaintenance; new state = PrepareForMaintenance]\n\n2026-05-08 09:13:37,640 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-5:[ctx-f2a20d6a, job-3207, ctx-a1adfd52]) (logid:5e43ba84) Trying to deploy VM [error decoding VM instance {\"id\":181,\"instanceName\":\"i-2-181-VM\",\"state\":\"Running\",\"type\":\"User\",\"uuid\":\"fe2be975-720e-4ba3-aa12-707a3c86fd58\"}] and details: Plan [{\"_dcId\":3,\"_podId\":3,\"_clusterId\":5,\"_recreateDisks\":false,\"preferredHostIds\":[],\"migrationPlan\":true,\"hostPriorities\":{}}]; avoid list [{\"_hostIds\":[46]}] and planner: [null].\n\n2026-05-08 09:13:37,642 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-5:[ctx-f2a20d6a, job-3207]) (logid:5e43ba84) Unexpected exception while executing org.apache.cloudstack.api.command.admin.host.PrepareForHostMaintenanceCmd java.lang.NullPointerException: Cannot invoke \"java.lang.Integer.intValue()\" because the return value of \"com.cloud.offering.ServiceOffering.getCpu()\" is null\n\t\tat com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:314)\n        at com.cloud.resource.ResourceManagerImpl.getDeployDestination(ResourceManagerImpl.java:1635)\n        at com.cloud.resource.ResourceManagerImpl.migrateAwayVmWithVolumes(ResourceManagerImpl.java:1619)\n        at com.cloud.resource.ResourceManagerImpl.doMaintain(ResourceManagerImpl.java:1557)\n        at com.cloud.resource.ResourceManagerImpl.maintain(ResourceManagerImpl.java:1653)\n        at com.cloud.resource.ResourceManagerImpl.maintain(ResourceManagerImpl.java:1710)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)\n        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n        at java.base/java.lang.reflect.Method.invoke(Method.java:569)\n        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n        at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:109)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)\n        at jdk.proxy3/jdk.proxy3.$Proxy217.maintain(Unknown Source)\n        at org.apache.cloudstack.api.command.admin.host.PrepareForHostMaintenanceCmd.execute(PrepareForHostMaintenanceCmd.java:99)\n        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:173)\n        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:110)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:698)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:646)\n        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n        at java.base/java.lang.Thread.run(Thread.java:840)\n\n2026-05-08 09:13:37,643 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-5:[ctx-f2a20d6a, job-3207]) (logid:5e43ba84) Complete async job-3207, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{\"uuidList\":[],\"errorcode\":\"530\",\"errortext\":\"Cannot invoke \"java.lang.Integer.intValue()\" because the return value of \"com.cloud.offering.ServiceOffering.getCpu()\" is null\"}\n```\n\n### **Rolling maintenance**\n```txt\n2026-05-08 09:06:36,950 DEBUG [c.c.h.d.HostDaoImpl] (API-Job-Executor-3:[ctx-8363e8f5, job-3205, ctx-868bd55f]) (logid:be9b63d5) Resource state update: [id = 46; name = cslab02; old state = Enabled; event = AdminAskMaintenance; new state = PrepareForMaintenance]\n\n2026-05-08 09:06:36,956 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-3:[ctx-8363e8f5, job-3205, ctx-868bd55f]) (logid:be9b63d5) Trying to deploy VM [error decoding VM instance {\"id\":181,\"instanceName\":\"i-2-181-VM\",\"state\":\"Running\",\"type\":\"User\",\"uuid\":\"fe2be975-720e-4ba3-aa12-707a3c86fd58\"}] and details: Plan [{\"_dcId\":3,\"_podId\":3,\"_clusterId\":5,\"_recreateDisks\":false,\"preferredHostIds\":[],\"migrationPlan\":true,\"hostPriorities\":{}}]; avoid list [{\"_hostIds\":[46]}] and planner: [null].\n\n2026-05-08 09:06:36,961 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-3:[ctx-8363e8f5, job-3205]) (logid:be9b63d5) Unexpected exception while executing org.apache.cloudstack.api.command.admin.resource.StartRollingMaintenanceCmd java.lang.NullPointerException: Cannot invoke \"java.lang.Integer.intValue()\" because the return value of \"com.cloud.offering.ServiceOffering.getCpu()\" is null\n\t\tat com.cloud.deploy.DeploymentPlanningManagerImpl.planDeployment(DeploymentPlanningManagerImpl.java:314)\n        at com.cloud.resource.ResourceManagerImpl.getDeployDestination(ResourceManagerImpl.java:1635)\n        at com.cloud.resource.ResourceManagerImpl.migrateAwayVmWithVolumes(ResourceManagerImpl.java:1619)\n        at com.cloud.resource.ResourceManagerImpl.doMaintain(ResourceManagerImpl.java:1557)\n        at com.cloud.resource.ResourceManagerImpl.maintain(ResourceManagerImpl.java:1653)\n        at com.cloud.resource.ResourceManagerImpl.maintain(ResourceManagerImpl.java:1710)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n        at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)\n        at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n        at java.base/java.lang.reflect.Method.invoke(Method.java:569)\n        at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n        at org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:109)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n        at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n        at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n        at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)\n        at jdk.proxy3/jdk.proxy3.$Proxy217.maintain(Unknown Source)\n        at com.cloud.resource.RollingMaintenanceManagerImpl.putHostIntoMaintenance(RollingMaintenanceManagerImpl.java:410)\n        at com.cloud.resource.RollingMaintenanceManagerImpl.startRollingMaintenanceHostInCluster(RollingMaintenanceManagerImpl.java:327)\n        at com.cloud.resource.RollingMaintenanceManagerImpl.startRollingMaintenance(RollingMaintenanceManagerImpl.java:210)\n        at org.apache.cloudstack.api.command.admin.resource.StartRollingMaintenanceCmd.execute(StartRollingMaintenanceCmd.java:129)\n        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:173)\n        at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:110)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:698)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)\n        at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)\n        at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)\n        at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:646)\n        at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)\n        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n        at java.base/java.lang.Thread.run(Thread.java:840)\n\n2026-05-08 09:06:36,962 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-3:[ctx-8363e8f5, job-3205]) (logid:be9b63d5) Complete async job-3205, jobStatus: FAILED, resultCode: 530, result: org.apache.cloudstack.api.response.ExceptionResponse/null/{\"uuidList\":[],\"errorcode\":\"530\",\"errortext\":\"Cannot invoke \"java.lang.Integer.intValue()\" because the return value of \"com.cloud.offering.ServiceOffering.getCpu()\" is null\"}\n```\n## Workaround\nUpdate service offering in the database:\n```sql\nmysql\u003e update service_offering set cpu = 2, ram_size = 2048 where uuid='c24ce908-ffaa-4ced-9610-f99fb9f8b4c8' \\G\n```\n\n### Note\nAfter applying the workaround normal migration works fine between local storages, vm is live migrated without a problem. However rolling migration still fails, is it related to the storage locality? I see in the logs that is putting the entire cluster in the disabled state\n```txt\n2026-05-08 09:16:16,047 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-7:[ctx-241b2d24, job-3209, ctx-4f1545be]) (logid:e374bad0) Trying to allocate a host and storage pools from datacenter [Zone {\"id\": \"3\", \"name\": \"zone-lab\", \"uuid\": \"80be5019-767a-47e1-8ccf-1a91d5032c0c\"}], pod [HostPod {\"id\":3,\"name\":\"pod-lab\",\"uuid\":\"0aba438c-f7a6-45db-864c-c82a49e3bcd6\"}], cluster [Cluster {id: \"5\", name: \"cluster-lab\", uuid: \"10364cd3-0b5b-4612-876a-ef28f00ff25e\"}], to deploy VM [VM instance {\"id\":181,\"instanceName\":\"i-2-181-VM\",\"state\":\"Running\",\"type\":\"User\",\"uuid\":\"fe2be975-720e-4ba3-aa12-707a3c86fd58\"}] with requested CPU [4000] and requested RAM [(2.00 GB) 2147483648].\n2026-05-08 09:16:16,048 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-7:[ctx-241b2d24, job-3209, ctx-4f1545be]) (logid:e374bad0) ROOT volume [Volume {\"id\":344,\"instanceId\":181,\"name\":\"ROOT-181\",\"uuid\":\"0b1bf8e0-3296-48b4-940b-fa6461b2b181\",\"volumeType\":\"ROOT\"}] is not ready to deploy VM [VM instance {\"id\":181,\"instanceName\":\"i-2-181-VM\",\"state\":\"Running\",\"type\":\"User\",\"uuid\":\"fe2be975-720e-4ba3-aa12-707a3c86fd58\"}].\n2026-05-08 09:16:16,050 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-7:[ctx-241b2d24, job-3209, ctx-4f1545be]) (logid:e374bad0) Adding pods [] to the avoid set because these pods are in the Disabled state.\n2026-05-08 09:16:16,051 DEBUG [c.c.d.DeploymentPlanningManagerImpl] (API-Job-Executor-7:[ctx-241b2d24, job-3209, ctx-4f1545be]) (logid:e374bad0) Adding clusters [5] of pod [3] to the void set because these clusters are in the Disabled state.\n```\n## What to do about it?\n\nI saw https://github.com/apache/cloudstack/pull/9844 that should have fixed the rolling maintenance NPE, but it seems that the file throwing the error is now the DeploymentPlanningManagerImpl.java in the planDeployment method. The fix used for rolling maintenance should be ported to the \"normal\" maintenance too","author":{"url":"https://github.com/gusmef","@type":"Person","name":"gusmef"},"datePublished":"2026-05-08T08:33:56.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/13130/cloudstack/issues/13130"}