Title: Non english characters not deserialized successfully · Issue #908 · msgpack/msgpack-java · GitHub
Open Graph Title: Non english characters not deserialized successfully · Issue #908 · msgpack/msgpack-java
X Title: Non english characters not deserialized successfully · Issue #908 · msgpack/msgpack-java
Description: When some non-english characters are serialized and deserialized back, the output is not as expected. All those non-english characters are lost and replaced with some generic symbols. But this is not the case with all msgpack and Java ve...
Open Graph Description: When some non-english characters are serialized and deserialized back, the output is not as expected. All those non-english characters are lost and replaced with some generic symbols. But this is n...
X Description: When some non-english characters are serialized and deserialized back, the output is not as expected. All those non-english characters are lost and replaced with some generic symbols. But this is n...
Opengraph URL: https://github.com/msgpack/msgpack-java/issues/908
X: @github
Domain: redirect.github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Non english characters not deserialized successfully","articleBody":"When some non-english characters are serialized and deserialized back, the output is not as expected. All those non-english characters are lost and replaced with some generic symbols. But this is not the case with all msgpack and Java versions.\nThe following piece of code behaves differently accross jackson-dataformat-msgpack and Java versions.\n```\nObjectMapper objectMapper = new ObjectMapper(new MessagePackFactory());\nString inputStr = \"çÇğĞıİöÖşŞüÜ\";\nbyte[] arr = objectMapper.writeValueAsBytes(inputStr);\nString outputStr = objectMapper.readValue(arr, String.class);\nSystem.out.println(outputStr);\n```\nThe case was tested with Turkish characters in Java 8 and Java 21, with jackson-dataformat-msgpack versions 0.9.8 to 0.9.10.\nHere are the results:\n- In Java 8, jackson-dataformat-msgpack versions 0.9.8, 0.9.9 and 0.9.10 all give the correct result, ie. outputStr=inputStr (çÇğĞıİöÖşŞüÜ)\n- In java 21, jackson-dataformat-msgpack version 0.9.8 give the correct result, ie. outputStr=inputStr (çÇğĞıİöÖşŞüÜ)\n- In java 21, jackson-dataformat-msgpack versions 0.9.9 and 0.9.10 give the wrong result, ie. outputStr is something like çÇğÄ?ıİöÖşÅ?üÜ\n\nAnything I'm missing here, like some new settings, or is it a bug?","author":{"url":"https://github.com/tronurg","@type":"Person","name":"tronurg"},"datePublished":"2025-08-05T18:29:19.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/908/msgpack-java/issues/908"}
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:15a45093-4d3c-7344-a254-3e79ee8f58e3 |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | EC90:2BA38A:1CB8F8:26C6DA:6A533239 |
| html-safe-nonce | ef3d7a1bc92020591dc2f5c17a154ee11b072471d40794157dfc7b5b5a0c25f0 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJFQzkwOjJCQTM4QToxQ0I4Rjg6MjZDNkRBOjZBNTMzMjM5IiwidmlzaXRvcl9pZCI6IjE0MzAwOTkzNzI2MTY2NTk1MTMiLCJyZWdpb25fZWRnZSI6ImlhZCIsInJlZ2lvbl9yZW5kZXIiOiJpYWQifQ== |
| visitor-hmac | 98ec67a0aeb8c8640ccca2c7fd2d5686a2f899967310e93e4c8efa541ac2439e |
| hovercard-subject-tag | issue:3294046199 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/msgpack/msgpack-java/908/issue_layout |
| twitter:image | https://opengraph.githubassets.com/a041dfb5e36925eee916f9c4dd192eea2682f3298a78a68838731b3f765855b3/msgpack/msgpack-java/issues/908 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/a041dfb5e36925eee916f9c4dd192eea2682f3298a78a68838731b3f765855b3/msgpack/msgpack-java/issues/908 |
| og:image:alt | When some non-english characters are serialized and deserialized back, the output is not as expected. All those non-english characters are lost and replaced with some generic symbols. But this is n... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | tronurg |
| hostname | github.com |
| expected-hostname | github.com |
| None | b9a586c06a05a7a86fc7e3f4dbd03e42f6869085879aa184aa6369456dbd50fb |
| turbo-cache-control | no-preview |
| go-import | github.com/msgpack/msgpack-java git https://github.com/msgpack/msgpack-java.git |
| octolytics-dimension-user_id | 198264 |
| octolytics-dimension-user_login | msgpack |
| octolytics-dimension-repository_id | 1971346 |
| octolytics-dimension-repository_nwo | msgpack/msgpack-java |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 1971346 |
| octolytics-dimension-repository_network_root_nwo | msgpack/msgpack-java |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 07a982c1d40157c619b364352b704c3ce66bb332 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width