Title: Update time management of python test generation by tamarinvs19 · Pull Request #1893 · UnitTestBot/UTBotJava · GitHub
Open Graph Title: Update time management of python test generation by tamarinvs19 · Pull Request #1893 · UnitTestBot/UTBotJava
X Title: Update time management of python test generation by tamarinvs19 · Pull Request #1893 · UnitTestBot/UTBotJava
Description: Description New test generation strategy is: If function is fully annotated and type inference algorithm cannot infer type we use all time from UI-settings to fuzzing and test generation; If type inference and infer type we try to fuzz tests for one annotation with the following restrictions: max 150 successfully executable tests (with or without exeception) max 10 invalid tests (when we generate incorrect arguments and have TypeError or AttributeError; or we cannot generate any valid representative of the inferred type) and 5 additional tests (as a precaution) until time limit In future we can modify strategies and add it to UI. For example, wait max coverage. Fixes #1874 Fixes #1831 How to test Manual tests Fully annotated function For example, def div(a: int, b: int) : return a / b Expected: two tests (valid and with ZeroDivisionError), test generation process lasted all time from UI-settings Or, def str_test(x: str): if x[0] == 'b': if x[1] == 'a': if x[2] == 'd': return 'Very bad!' Expected: all time generation, one test with x = 'ba' or longer (with timeout 60s) and all covered branches with timeout 180s Without or partially annotated function For example, def str_test(x): if x[0] == 'b': if x[1] == 'a': if x[2] == 'd': return 'Very bad!' Expected: all time generation, one test with x = 'b', no one with 'ba' and longer (regardless of timeout) Self-check list Check off the item if the statement is true. Hint: [x] is a marked item. Please do not delete the list or its items. I've set the proper labels for my PR (at least, for category and component). PR title and description are clear and intelligible. I've added enough comments to my code, particularly in hard-to-understand areas. The functionality I've repaired, changed or added is covered with automated tests. Manual tests have been provided optionally. The documentation for the functionality I've been working on is up-to-date.
Open Graph Description: Description New test generation strategy is: If function is fully annotated and type inference algorithm cannot infer type we use all time from UI-settings to fuzzing and test generation; If type ...
X Description: Description New test generation strategy is: If function is fully annotated and type inference algorithm cannot infer type we use all time from UI-settings to fuzzing and test generation; If type ...
Opengraph URL: https://github.com/UnitTestBot/UTBotJava/pull/1893
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/checks(.:format) |
| route-controller | pull_requests |
| route-action | checks |
| fetch-nonce | v2:e932bb59-fd93-3201-2ada-d5a1c45a4bb8 |
| current-catalog-service-hash | 87dc3bc62d9b466312751bfd5f889726f4f1337bdff4e8be7da7c93d6c00a25a |
| request-id | 8980:14B4F3:35EEAA:4626EC:698F9AB2 |
| html-safe-nonce | 7b47bbc4cd5dbbe5e7133866be2a9e72a187553a49cc1c1dcb54801d261d9b0a |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiI4OTgwOjE0QjRGMzozNUVFQUE6NDYyNkVDOjY5OEY5QUIyIiwidmlzaXRvcl9pZCI6IjIxMTk3NzY3OTQyNjk2ODY0NTAiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 8a98bdfd1bb3280d29f150decd1e285a5880bf8ab06874e5ebd06011cc8bf5b0 |
| hovercard-subject-tag | pull_request:1262598399 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,checks,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/UnitTestBot/UTBotJava/pull/1893/checks |
| twitter:image | https://avatars.githubusercontent.com/u/23080942?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/23080942?s=400&v=4 |
| og:image:alt | Description New test generation strategy is: If function is fully annotated and type inference algorithm cannot infer type we use all time from UI-settings to fuzzing and test generation; If type ... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | 5f47eb8d0aaafbfcb6a8220a40bd81431acf688857c575e6489670c394cfa36f |
| turbo-cache-control | no-preview |
| go-import | github.com/UnitTestBot/UTBotJava git https://github.com/UnitTestBot/UTBotJava.git |
| octolytics-dimension-user_id | 87413538 |
| octolytics-dimension-user_login | UnitTestBot |
| octolytics-dimension-repository_id | 480810501 |
| octolytics-dimension-repository_nwo | UnitTestBot/UTBotJava |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 480810501 |
| octolytics-dimension-repository_network_root_nwo | UnitTestBot/UTBotJava |
| turbo-body-classes | logged-out env-production page-responsive full-width full-width-p-0 |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 09a8136f6e8f8fd3078d54ce5f8b7adb493d44a7 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width