Title: Get-Content -ReadCount 0 combined with -Last / -Tail seems to read ALL lines internally · Issue #11830 · PowerShell/PowerShell · GitHub
Open Graph Title: Get-Content -ReadCount 0 combined with -Last / -Tail seems to read ALL lines internally · Issue #11830 · PowerShell/PowerShell
X Title: Get-Content -ReadCount 0 combined with -Last / -Tail seems to read ALL lines internally · Issue #11830 · PowerShell/PowerShell
Description: Get-Content -ReadCount 0 is a convenient way to request that all lines be read at once, into an array and to have that array be output as a single object to the success stream. When combined with -First aka -TotalCount aka -Head, this se...
Open Graph Description: Get-Content -ReadCount 0 is a convenient way to request that all lines be read at once, into an array and to have that array be output as a single object to the success stream. When combined with -...
X Description: Get-Content -ReadCount 0 is a convenient way to request that all lines be read at once, into an array and to have that array be output as a single object to the success stream. When combined with -...
Opengraph URL: https://github.com/PowerShell/PowerShell/issues/11830
X: @github
Domain: github.com
{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Get-Content -ReadCount 0 combined with -Last / -Tail seems to read ALL lines internally","articleBody":"`Get-Content -ReadCount 0` is a convenient way to request that all lines be read _at once, into an array_ and to have that array be output _as a single_ object to the success stream.\r\n\r\nWhen combined with `-First` aka `-TotalCount` aka `-Head`, this sensibly allocates an array for and outputs _only the requested number of lines_ from the beginning, not for _all_ lines.\r\nNote: Meaningfully combining `-First` with `-ReadCount 0` was only recently implemented, in #10749.\r\n\r\nWhile combining `-Last` aka `-Tail` with `-ReadCount 0` is _functional_, performance timings suggest that _all_ lines are needlessly being read into an array behind the scenes, before only the sub-array of interest is output.\r\n\r\nIn other words: while `-Tail \u003cn> -ReadCount 0` _should_ be the same as `-Tail \u003cn> -ReadCount \u003cn>` (explicitly setting the the read count to the same number as the number of trailing lines requested), it currently isn't in terms of _performance and memory use_.\r\n\r\n# Steps to reproduce\r\n\r\n```powershell\r\n# Create a temporary file with 1 million lines\r\n$f = [IO.Path]::GetTempFileName(); (, 'foo') * 1e6 > $f\r\n# Warm up the cache.\r\n$tmp = gc $f -ReadCount 0\r\n\r\n# Read 1000 lines from the end, as a single array\r\n$n = 1000\r\n{ $v = gc $f -Tail $n -ReadCount $n },\r\n{ $v = gc $f -Tail $n -ReadCount 0 }, \r\n{ $v = gc $f -ReadCount 0 } \u003c# control: read all lines #> | % {\r\n \"$_`: \" + (Measure-Command $_).TotalSeconds \r\n}\r\n\r\nRemove-Item $f\r\n```\r\n\r\n# Expected behavior\r\n\r\n`-Tail $n -ReadCount $n` and `-Tail $n -ReadCount 0` should perform virtually the same and should be faster than `-ReadCount 0` by itself.\r\n\r\n# Actual behavior\r\n\r\n`-Tail $n -ReadCount 0` is not only slower than `-Tail $n -ReadCount $n` , but also slower than `-ReadCount 0` by itself, suggesting that _all_ lines were read behind the scenes.\r\n\r\n```none\r\n $v = gc $f -Tail $n -ReadCount $n : 0.1515997\r\n $v = gc $f -Tail $n -ReadCount 0 : 0.2118531\r\n $v = gc $f -ReadCount 0 : 0.209674\r\n```\r\n\r\n# Environment data\r\n\r\n```none\r\nPowerShell Core 7.0.0-rc.2\r\n```\r\n","author":{"url":"https://github.com/mklement0","@type":"Person","name":"mklement0"},"datePublished":"2020-02-11T18:56:39Z","url":"https://github.com/PowerShell/PowerShell/issues/11830"}
| react-profiling | 0 |
| react-import-map | react,react-dom,react-dom/client,react-dom/profiling,react-is,react/compiler-runtime,react/jsx-dev-runtime,react/jsx-runtime,scheduler@b8488ee2c322 |
| route-pattern | /_view_fragments/issues/show/:user_id/:repository/:id/issue_layout(.:format) |
| route-controller | voltron_issues_fragments |
| route-action | issue_layout |
| fetch-nonce | v2:42facc94-5685-81b8-53ef-c2c7a8fae7ef |
| current-catalog-service-hash | 81bb79d38c15960b92d99bca9288a9108c7a47b18f2423d0f6438c5b7bcd2114 |
| request-id | DCD0:2F6606:24EBC05:3392E23:6AFD44E2 |
| html-safe-nonce | 9dd0568bb959688131650ebce8341984be55d53612ca814073424e9d191494b0 |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJEQ0QwOjJGNjYwNjoyNEVCQzA1OjMzOTJFMjM6NkFGRDQ0RTIiLCJ2aXNpdG9yX2lkIjoiNDY0MzY4MTAwMTEzNjgwMDk5NCIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | 0eeb604b0694b2e6bae8acafd837ca382a3f13c61e759e46c8ec3d6e0a482832 |
| hovercard-subject-tag | issue:563408545 |
| github-keyboard-shortcuts | repository,issues,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/_view_fragments/issues/show/PowerShell/PowerShell/11830/issue_layout |
| twitter:image | https://opengraph.githubassets.com/52d8df7a8f525dfb37b754ba560dbc7a24756bd890ecb9dd847a3490880bbad1/PowerShell/PowerShell/issues/11830 |
| twitter:card | summary_large_image |
| og:image | https://opengraph.githubassets.com/52d8df7a8f525dfb37b754ba560dbc7a24756bd890ecb9dd847a3490880bbad1/PowerShell/PowerShell/issues/11830 |
| og:image:alt | Get-Content -ReadCount 0 is a convenient way to request that all lines be read at once, into an array and to have that array be output as a single object to the success stream. When combined with -... |
| og:image:width | 1200 |
| og:image:height | 600 |
| og:site_name | GitHub |
| og:type | object |
| og:author:username | mklement0 |
| hostname | github.com |
| expected-hostname | github.com |
| None | bdbacc25b921224ff0befcb9e629560a1255be51aec9991d6e3f95b5e9151474 |
| turbo-cache-control | no-preview |
| go-import | github.com/PowerShell/PowerShell git https://github.com/PowerShell/PowerShell.git |
| octolytics-dimension-user_id | 11524380 |
| octolytics-dimension-user_login | PowerShell |
| octolytics-dimension-repository_id | 49609581 |
| octolytics-dimension-repository_nwo | PowerShell/PowerShell |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 49609581 |
| octolytics-dimension-repository_network_root_nwo | PowerShell/PowerShell |
| turbo-body-classes | logged-out env-production page-responsive |
| disable-turbo | false |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | 556dd37bb0aceffb25724e151b5d858b3265b40b |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
| react-app-name | issues |
Links:
Viewport: width=device-width