Title: [General Inference] Improve lifecycle messages · Issue #84 · CentML/centml-python-client · GitHub
Open Graph Title: [General Inference] Improve lifecycle messages · Issue #84 · CentML/centml-python-client
X Title: [General Inference] Improve lifecycle messages · Issue #84 · CentML/centml-python-client
Description: Right new, I can create a General Inference endpoint using get_centml_client(). If I use create_inference it gives the correct response: id=3889 created_at=datetime.datetime(2025, 1, 22, 15, 34, 40, 417631, tzinfo=TzInfo(UTC)) endpoint_u...
Open Graph Description: Right new, I can create a General Inference endpoint using get_centml_client(). If I use create_inference it gives the correct response: id=3889 created_at=datetime.datetime(2025, 1, 22, 15, 34, 40...
X Description: Right new, I can create a General Inference endpoint using get_centml_client(). If I use create_inference it gives the correct response: id=3889 created_at=datetime.datetime(2025, 1, 22, 15, 34, 40...
Opengraph URL: https://github.com/CentML/centml-python-client/issues/84
X: @github
Domain: patch-diff.githubusercontent.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"[General Inference] Improve lifecycle messages","articleBody":"Right new, I can create a General Inference endpoint using get_centml_client().\nIf I use create_inference it gives the correct response:\n```\nid=3889 created_at=datetime.datetime(2025, 1, 22, 15, 34, 40, 417631, tzinfo=TzInfo(UTC)) endpoint_url='john-test.e0ccbae3.gcp.centml.org'\n```\nNow, we need to add more friendly messages for getting the status, and when deleting.\nFor example, if I delete the endpoint using delete(), I get None as response:\n```\n\u003e\u003e\u003e with get_centml_client() as cclient:\n... print(cclient.delete(3891))\n... \nNone\u003e\u003e\u003e with get_centml_client() as cclient:\n... print(cclient.delete(3891))\n... \nNone\n```\nHere we should confirm what we deleted the endpoint, give the id and saying that the request was sucessfull\n\nAnother point to consider is retrieving the status of the endpoint after deleting. As of now it raises an error:\nfor get_inference()\n```\n\u003e\u003e\u003e with get_centml_client() as cclient:\n... print(cclient.get_inference(3891))\n... \nTraceback (most recent call last):\n File \"\u003cstdin\u003e\", line 2, in \u003cmodule\u003e\n File \"/home/john/Documents/centml/platform/centml-python-client/centml/sdk/api.py\", line 28, in get_inference\n return self._api.get_inference_deployment_deployments_inference_deployment_id_get(id)\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/pydantic/_internal/_validate_call.py\", line 38, in wrapper_function\n return wrapper(*args, **kwargs)\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/pydantic/_internal/_validate_call.py\", line 111, in __call__\n res = self.__pydantic_validator__.validate_python(pydantic_core.ArgsKwargs(args, kwargs))\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/api/external_api.py\", line 4717, in get_inference_deployment_deployments_inference_deployment_id_get\n return self.api_client.response_deserialize(\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/api_client.py\", line 322, in response_deserialize\n raise ApiException.from_response(\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/exceptions.py\", line 151, in from_response\n raise NotFoundException(http_resp=http_resp, body=body, data=data)\nplatform_api_python_client.exceptions.NotFoundException: (404)\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({'date': 'Wed, 22 Jan 2025 15:57:36 GMT', 'server': 'istio-envoy', 'content-length': '38', 'content-type': 'application/json', 'x-envoy-upstream-service-time': '11'})\nHTTP response body: {\"detail\":\"Deployment does not exist\"}\n```\nFor get_status()\n```\n\u003e\u003e\u003e with get_centml_client() as cclient:\n... print(cclient.get_status(3891))\n... \nTraceback (most recent call last):\n File \"\u003cstdin\u003e\", line 2, in \u003cmodule\u003e\n File \"/home/john/Documents/centml/platform/centml-python-client/centml/sdk/api.py\", line 25, in get_status\n return self._api.get_deployment_status_deployments_status_deployment_id_get(id)\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/pydantic/_internal/_validate_call.py\", line 38, in wrapper_function\n return wrapper(*args, **kwargs)\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/pydantic/_internal/_validate_call.py\", line 111, in __call__\n res = self.__pydantic_validator__.validate_python(pydantic_core.ArgsKwargs(args, kwargs))\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/api/external_api.py\", line 3879, in get_deployment_status_deployments_status_deployment_id_get\n return self.api_client.response_deserialize(\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/api_client.py\", line 322, in response_deserialize\n raise ApiException.from_response(\n File \"/home/john/Documents/centml/platform/centml-python-client/venv/lib/python3.10/site-packages/platform_api_python_client/exceptions.py\", line 151, in from_response\n raise NotFoundException(http_resp=http_resp, body=body, data=data)\nplatform_api_python_client.exceptions.NotFoundException: (404)\nReason: Not Found\nHTTP response headers: HTTPHeaderDict({'date': 'Wed, 22 Jan 2025 15:58:05 GMT', 'server': 'istio-envoy', 'content-length': '38', 'content-type': 'application/json', 'x-envoy-upstream-service-time': '18'})\nHTTP response body: {\"detail\":\"Deployment does not exist\"}\n```\n\nBased on this information, I suggest the following:\n\n1. Return correct message when deleting endpoint\n2. Give correct status messages after endpoint is deleted and not raise an error\n\n┆Issue is synchronized with this [Notion page](https://www.notion.so/General-Inference-Improve-lifecycle-messages-18304095767d815ebb2dcd4b0450f036) by [Unito](https://www.unito.io)\n","author":{"url":"https://github.com/johncalesp","@type":"Person","name":"johncalesp"},"datePublished":"2025-01-22T16:19:22.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/84/centml-python-client/issues/84"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:045b606b-ccf3-cd29-ba3c-aa28b8b469b3 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | AED0:5D4C9:2F5491:3D467A:698EB330 |
| html-safe-nonce | 9cc9f4759e910823199c26a37293e807e0059403c709a05848612f6f0da9fd7f |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBRUQwOjVENEM5OjJGNTQ5MTozRDQ2N0E6Njk4RUIzMzAiLCJ2aXNpdG9yX2lkIjoiODQ3MjA4NzAxNzY1NTU0NjY3MiIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 0d73ad1540a5fc86d391efe5d3a1799f90db0a352fa087f34e263aae6d1989be |
| hovercard-subject-tag | issue:2804810765 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/CentML/centml-python-client/84/issue_layout |
| twitter:image | https://opengraph.githubassets.com/d680917f22b7ec8c4590630cca866ea7eb9a78ae6bd0e19e9e7a81fb90f95a9f/CentML/centml-python-client/issues/84 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/d680917f22b7ec8c4590630cca866ea7eb9a78ae6bd0e19e9e7a81fb90f95a9f/CentML/centml-python-client/issues/84 |
| og:image:alt | Right new, I can create a General Inference endpoint using get_centml_client(). If I use create_inference it gives the correct response: id=3889 created_at=datetime.datetime(2025, 1, 22, 15, 34, 40... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | johncalesp |
| hostname | github.com |
| expected-hostname | github.com |
| None | cb2828a801ee6b7be618f3ac76fbf55def35bbc30f053a9c41bf90210b8b72ba |
| turbo-cache-control | no-preview |
| go-import | github.com/CentML/centml-python-client git https://github.com/CentML/centml-python-client.git |
| octolytics-dimension-user_id | 98933447 |
| octolytics-dimension-user_login | CentML |
| octolytics-dimension-repository_id | 666050741 |
| octolytics-dimension-repository_nwo | CentML/centml-python-client |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 666050741 |
| octolytics-dimension-repository_network_root_nwo | CentML/centml-python-client |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | e6b91a7e6e46287d26887e3fb7a4161657bab8f7 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width