René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"Performance issues in your project (by P3)","articleBody":"Hello! I've found a performance issue in your project: `batch()` should be called before `map()`, which could make your program more efficient. Here is [the tensorflow document](https://tensorflow.google.cn/guide/data_performance?hl=zh_cn#vectorized_mapping) to support it.\r\n\r\nDetailed description is listed below:\r\n\r\n- /7. ResNet/train.py: `.batch(128)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/7.%20ResNet/train.py#L21) should be called before `.map(preprocess)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/7.%20ResNet/train.py#L21).\r\n- /7. ResNet/train.py: `.batch(128)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/7.%20ResNet/train.py#L24) should be called before `.map(preprocess)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/7.%20ResNet/train.py#L24).\r\n- /4. AlexNet/AlexNet.py: `.batch(32)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/4.%20AlexNet/AlexNet.py#L99) should be called before `.map(preprocess)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/4.%20AlexNet/AlexNet.py#L99).\r\n- /5. VGG11/VGG11.py: `.batch(16)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/5.%20VGG11/VGG11.py#L99) should be called before `.map(preprocess)`[(here)](https://github.com/Keyird/DeepLearning-TensorFlow2/blob/118e16981498ffd73e9b98c3805d0666fd0c70bc/5.%20VGG11/VGG11.py#L99).\r\n\r\nBesides, you need to check the function called in `map()`(e.g., `preprocess` called in `.map(preprocess)`) whether to be affected or not to make the changed code work properly. For example, if `preprocess` needs data with shape (x, y, z) as its input before fix, it would require data with shape (batch_size, x, y, z).\r\n\r\nLooking forward to your reply. Btw, I am very glad to create a PR to fix it if you are too busy.","author":{"url":"https://github.com/DLPerf","@type":"Person","name":"DLPerf"},"datePublished":"2021-08-29T12:57:00.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":1},"url":"https://github.com/5/DeepLearning-TensorFlow2/issues/5"}