René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Git, GitDB, and GitCmdObjectDB give different results when counting objects.","articleBody":"1. Use git to count the objects in a repo:\r\n```\r\n$ git rev-list --objects --all | wc -l\r\n6990030\r\n$ git rev-list --objects --all | sort | uniq | wc -l\r\n6990030\r\n```\r\n\r\n2. Parse the output from `git rev-list --objects --all`, fetch each object with name_to_object, and count each type:\r\n```\r\nCommits: 909667, Tags: 2469, Trees: 4178263, Blobs: 1899631\r\n```\r\n\r\n3. Query what is ostensibly the same information using git-python:\r\n```\r\nimport argparse\r\nimport pathlib\r\n\r\nimport git\r\n\r\ndef log(testname, a, b):\r\n    print(testname, ':', a, b)\r\n\r\ndef main():\r\n\r\n    parser = argparse.ArgumentParser(description='Git x ref.')\r\n    parser.add_argument('repository', metavar='repository', type=pathlib.Path,\r\n                        help='Path to Git repository.')\r\n\r\n    args = parser.parse_args()\r\n\r\n    repos = [\r\n        git.Repo(str(args.repository), odbt=git.GitCmdObjectDB),\r\n        git.Repo(str(args.repository), odbt=git.GitDB)\r\n    ]\r\n\r\n    log('size()', *[r.odb.size() for r in repos])\r\n    log('len(sha_iter())', *[sum(1 for x in r.odb.sha_iter()) for r in repos])\r\n    log('len(iter_trees())', *[sum(1 for x in r.iter_trees()) for r in repos])\r\n\r\n\r\nif __name__ == '__main__':\r\n    main()\r\n```\r\n\r\nResult:\r\n\r\n```\r\nsize() : 3839 8268978\r\nlen(sha_iter()) : 3839 8268978\r\nlen(iter_trees()) : 568851 568851\r\n```\r\nSo:\r\n\r\nGit thinks there are 6,990,030 objects in the database.\r\nGitDB thinks there are 8,268,978.\r\nGitCmdObjectDB thinks there are 3,839.\r\n\r\nGit thinks there are 4,178,263 trees in the database.\r\nBoth GitDB and GitCmdObjectDB think there are 568,851.","author":{"url":"https://github.com/ali1234","@type":"Person","name":"ali1234"},"datePublished":"2018-06-05T19:14:31.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":54},"url":"https://github.com/765/GitPython/issues/765"}