René's URL Explorer Experiment

{"@context":"https://schema.org","@type":"DiscussionForumPosting","headline":"can you convert efficient to TRT by onnx offset 11","articleBody":"@arvcode  Dear \r\nI can convert effficient 5 to ONNX success by offset 11 ,but when convert the onnx model to tensorrt 8.2.1 it has error\r\n./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx  --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True\r\n\u0026\u0026\u0026\u0026 RUNNING TensorRT.trtexec [TensorRT v8202] # ./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True\r\n[01/19/2022-03:52:36] [W] --explicitBatch flag has been deprecated and has no effect!\r\n[01/19/2022-03:52:36] [W] Explicit batch dim is automatically enabled if input model is ONNX or if dynamic shapes are provided when the engine is built.\r\n[01/19/2022-03:52:36] [I] === Model Options ===\r\n[01/19/2022-03:52:36] [I] Format: ONNX\r\n[01/19/2022-03:52:36] [I] Model: outputmodel/tf_efficientnet_b5_ap_set11.onnx\r\n[01/19/2022-03:52:36] [I] Output:\r\n[01/19/2022-03:52:36] [I] === Build Options ===\r\n[01/19/2022-03:52:36] [I] Max batch: explicit batch\r\n[01/19/2022-03:52:36] [I] Workspace: 2048 MiB\r\n[01/19/2022-03:52:36] [I] minTiming: 1\r\n[01/19/2022-03:52:36] [I] avgTiming: 8\r\n[01/19/2022-03:52:36] [I] Precision: FP32+FP16\r\n[01/19/2022-03:52:36] [I] Calibration: \r\n[01/19/2022-03:52:36] [I] Refit: Disabled\r\n[01/19/2022-03:52:36] [I] Sparsity: Disabled\r\n[01/19/2022-03:52:36] [I] Safe mode: Disabled\r\n[01/19/2022-03:52:36] [I] DirectIO mode: Disabled\r\n[01/19/2022-03:52:36] [I] Restricted mode: Disabled\r\n[01/19/2022-03:52:36] [I] Save engine: efficientnet5_engine_adabin.trt\r\n[01/19/2022-03:52:36] [I] Load engine: \r\n[01/19/2022-03:52:36] [I] Profiling verbosity: 0\r\n[01/19/2022-03:52:36] [I] Tactic sources: cublas [ON], cublasLt [OFF], \r\n[01/19/2022-03:52:36] [I] timingCacheMode: local\r\n[01/19/2022-03:52:36] [I] timingCacheFile: \r\n[01/19/2022-03:52:36] [I] Input(s)s format: fp32:CHW\r\n[01/19/2022-03:52:36] [I] Output(s)s format: fp32:CHW\r\n[01/19/2022-03:52:36] [I] Input build shapes: model\r\n[01/19/2022-03:52:36] [I] Input calibration shapes: model\r\n[01/19/2022-03:52:36] [I] === System Options ===\r\n[01/19/2022-03:52:36] [I] Device: 0\r\n[01/19/2022-03:52:36] [I] DLACore: \r\n[01/19/2022-03:52:36] [I] Plugins:\r\n[01/19/2022-03:52:36] [I] === Inference Options ===\r\n[01/19/2022-03:52:36] [I] Batch: Explicit\r\n[01/19/2022-03:52:36] [I] Input inference shapes: model\r\n[01/19/2022-03:52:36] [I] Iterations: 10\r\n[01/19/2022-03:52:36] [I] Duration: 3s (+ 200ms warm up)\r\n[01/19/2022-03:52:36] [I] Sleep time: 0ms\r\n[01/19/2022-03:52:36] [I] Idle time: 0ms\r\n[01/19/2022-03:52:36] [I] Streams: 1\r\n[01/19/2022-03:52:36] [I] ExposeDMA: Disabled\r\n[01/19/2022-03:52:36] [I] Data transfers: Enabled\r\n[01/19/2022-03:52:36] [I] Spin-wait: Disabled\r\n[01/19/2022-03:52:36] [I] Multithreading: Disabled\r\n[01/19/2022-03:52:36] [I] CUDA Graph: Disabled\r\n[01/19/2022-03:52:36] [I] Separate profiling: Disabled\r\n[01/19/2022-03:52:36] [I] Time Deserialize: Disabled\r\n[01/19/2022-03:52:36] [I] Time Refit: Disabled\r\n[01/19/2022-03:52:36] [I] Skip inference: Disabled\r\n[01/19/2022-03:52:36] [I] Inputs:\r\n[01/19/2022-03:52:36] [I] === Reporting Options ===\r\n[01/19/2022-03:52:36] [I] Verbose: Enabled\r\n[01/19/2022-03:52:36] [I] Averages: 10 inferences\r\n[01/19/2022-03:52:36] [I] Percentile: 99\r\n[01/19/2022-03:52:36] [I] Dump refittable layers:Disabled\r\n[01/19/2022-03:52:36] [I] Dump output: Disabled\r\n[01/19/2022-03:52:36] [I] Profile: Disabled\r\n[01/19/2022-03:52:36] [I] Export timing to JSON file: \r\n[01/19/2022-03:52:36] [I] Export output to JSON file: \r\n[01/19/2022-03:52:36] [I] Export profile to JSON file: \r\n[01/19/2022-03:52:36] [I] \r\n[01/19/2022-03:52:36] [I] === Device Information ===\r\n[01/19/2022-03:52:36] [I] Selected Device: GeForce RTX 2080 Ti\r\n[01/19/2022-03:52:36] [I] Compute Capability: 7.5\r\n[01/19/2022-03:52:36] [I] SMs: 68\r\n[01/19/2022-03:52:36] [I] Compute Clock Rate: 1.635 GHz\r\n[01/19/2022-03:52:36] [I] Device Global Memory: 11019 MiB\r\n[01/19/2022-03:52:36] [I] Shared Memory per SM: 64 KiB\r\n[01/19/2022-03:52:36] [I] Memory Bus Width: 352 bits (ECC disabled)\r\n[01/19/2022-03:52:36] [I] Memory Clock Rate: 7 GHz\r\n[01/19/2022-03:52:36] [I] \r\n[01/19/2022-03:52:36] [I] TensorRT version: 8.2.2\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::GridAnchor_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::GridAnchorRect_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::NMS_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Reorg_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Region_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Clip_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::LReLU_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::PriorBox_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Normalize_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ScatterND version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::RPROI_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::BatchedNMS_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::BatchedNMSDynamic_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::FlattenConcat_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::CropAndResize version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::DetectionLayer_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_ONNX_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::EfficientNMS_TFTRT_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Proposal version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ProposalLayer_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::PyramidROIAlign_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::ResizeNearest_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::Split version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::SpecialSlice_TRT version 1\r\n[01/19/2022-03:52:36] [V] [TRT] Registered plugin creator - ::InstanceNormalization_TRT version 1\r\n[01/19/2022-03:52:36] [I] [TRT] [MemUsageChange] Init CUDA: CPU +297, GPU +0, now: CPU 300, GPU 320 (MiB)\r\n[01/19/2022-03:52:37] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 300 MiB, GPU 320 MiB\r\n[01/19/2022-03:52:37] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 319 MiB, GPU 320 MiB\r\n[01/19/2022-03:52:37] [I] Start parsing network model\r\n[01/19/2022-03:52:37] [I] [TRT] ----------------------------------------------------------------\r\n[01/19/2022-03:52:37] [I] [TRT] Input filename:   outputmodel/tf_efficientnet_b5_ap_set11.onnx\r\n[01/19/2022-03:52:37] [I] [TRT] ONNX IR version:  0.0.7\r\n[01/19/2022-03:52:37] [I] [TRT] Opset version:    11\r\n[01/19/2022-03:52:37] [I] [TRT] Producer name:    pytorch\r\n[01/19/2022-03:52:37] [I] [TRT] Producer version: 1.10\r\n[01/19/2022-03:52:37] [I] [TRT] Domain:           \r\n[01/19/2022-03:52:37] [I] [TRT] Model version:    0\r\n[01/19/2022-03:52:37] [I] [TRT] Doc string:       \r\n[01/19/2022-03:52:37] [I] [TRT] ----------------------------------------------------------------\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::GridAnchor_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::GridAnchorRect_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::NMS_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Reorg_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Region_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Clip_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::LReLU_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::PriorBox_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Normalize_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ScatterND version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::RPROI_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::BatchedNMS_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::BatchedNMSDynamic_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::FlattenConcat_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::CropAndResize version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::DetectionLayer_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_ONNX_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::EfficientNMS_TFTRT_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Proposal version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ProposalLayer_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::PyramidROIAlign_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::ResizeNearest_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::Split version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::SpecialSlice_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Plugin creator already registered - ::InstanceNormalization_TRT version 1\r\n[01/19/2022-03:52:37] [V] [TRT] Adding network input: input0 with dtype: float32, dimensions: (-1, 3, 480, 640)\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: input0 for ONNX tensor: input0\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.0.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.3.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.1.4.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.3.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.2.4.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.3.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.4.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.5.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.3.6.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.3.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.4.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.5.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.4.6.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.3.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.4.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.5.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.6.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.7.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.5.8.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.0.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.1.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_reduce.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_reduce.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_expand.weight\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: blocks.6.2.se.conv_expand.bias\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1666\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1667\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1669\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1670\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1672\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1673\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1675\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1676\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1678\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1679\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1681\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1682\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1684\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1685\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1687\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1688\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1690\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1691\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1693\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1694\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1696\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1697\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1699\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1700\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1702\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1703\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1705\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1706\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1708\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1709\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1711\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1712\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1714\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1715\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1717\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1718\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1720\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1721\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1723\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1724\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1726\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1727\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1729\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1730\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1732\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1733\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1735\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1736\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1738\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1739\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1741\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1742\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1744\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1745\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1747\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1748\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1750\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1751\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1753\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1754\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1756\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1757\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1759\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1760\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1762\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1763\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1765\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1766\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1768\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1769\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1771\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1772\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1774\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1775\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1777\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1778\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1780\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1781\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1783\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1784\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1786\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1787\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1789\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1790\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1792\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1793\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1795\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1796\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1798\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1799\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1801\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1802\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1804\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1805\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1807\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1808\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1810\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1811\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1813\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1814\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1816\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1817\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1819\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1820\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1822\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1823\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1825\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1826\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1828\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1829\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1831\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1832\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1834\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1835\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1837\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1838\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1840\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1841\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1843\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1844\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1846\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1847\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1849\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1850\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1852\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1853\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1855\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1856\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1858\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1859\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1861\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1862\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1864\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1865\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1867\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1868\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1870\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1871\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1873\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1874\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1876\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1877\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1879\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1880\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1882\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1883\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1885\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1886\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1888\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1889\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1891\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1892\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1894\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1895\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1897\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1898\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1900\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1901\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1903\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1904\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1906\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1907\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1909\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1910\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1912\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1913\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1915\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1916\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1918\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1919\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1921\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1922\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1924\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1925\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1927\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1928\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1930\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1931\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1933\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1934\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1936\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1937\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1939\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1940\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1942\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1943\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1945\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1946\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1948\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1949\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1951\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1952\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1954\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1955\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1957\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1958\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1960\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1961\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1963\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1964\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1966\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1967\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1969\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1970\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1972\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1973\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1975\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1976\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1978\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1979\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1981\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1982\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1984\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1985\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1987\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1988\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1990\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1991\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1993\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1994\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1996\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1997\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 1999\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2000\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2002\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2003\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2005\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2006\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2008\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2009\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2011\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2012\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2016\r\n[01/19/2022-03:52:37] [W] [TRT] onnx2trt_utils.cpp:366: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2017\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2021\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2022\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2026\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2027\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2031\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2032\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2036\r\n[01/19/2022-03:52:37] [V] [TRT] Importing initializer: 2037\r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: ConstantOfShape_0 [ConstantOfShape]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 2016\r\n[01/19/2022-03:52:37] [V] [TRT] ConstantOfShape_0 [ConstantOfShape] inputs: [2016 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: 2016 for ONNX node: 2016\r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: ConstantOfShape_0 for ONNX node: ConstantOfShape_0\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 862 for ONNX tensor: 862\r\n[01/19/2022-03:52:37] [V] [TRT] ConstantOfShape_0 [ConstantOfShape] outputs: [862 -\u003e (4)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Concat_1 [Concat]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 2017\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 862\r\n[01/19/2022-03:52:37] [V] [TRT] Concat_1 [Concat] inputs: [2017 -\u003e (4)[INT32]], [862 -\u003e (4)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: 2017 for ONNX node: 2017\r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Concat_1 for ONNX node: Concat_1\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 863 for ONNX tensor: 863\r\n[01/19/2022-03:52:37] [V] [TRT] Concat_1 [Concat] outputs: [863 -\u003e (8)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_2 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_2 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_2 [Constant] outputs: [864 -\u003e (2)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Reshape_3 [Reshape]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 863\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 864\r\n[01/19/2022-03:52:37] [V] [TRT] Reshape_3 [Reshape] inputs: [863 -\u003e (8)[INT32]], [864 -\u003e (2)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Reshape_3 for ONNX node: Reshape_3\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 865 for ONNX tensor: 865\r\n[01/19/2022-03:52:37] [V] [TRT] Reshape_3 [Reshape] outputs: [865 -\u003e (4, 2)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_4 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_4 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_4 [Constant] outputs: [866 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_5 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_5 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_5 [Constant] outputs: [867 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_6 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_6 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Weight at index 0: -9223372036854775807 is out of range. Clamping to: -2147483648\r\n[01/19/2022-03:52:37] [W] [TRT] onnx2trt_utils.cpp:392: One or more weights outside the range of INT32 was clamped\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_6 [Constant] outputs: [868 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_7 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_7 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_7 [Constant] outputs: [869 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Slice_8 [Slice]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 865\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 867\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 868\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 866\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 869\r\n[01/19/2022-03:52:37] [V] [TRT] Slice_8 [Slice] inputs: [865 -\u003e (4, 2)[INT32]], [867 -\u003e (1)[INT32]], [868 -\u003e (1)[INT32]], [866 -\u003e (1)[INT32]], [869 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Slice_8 for ONNX node: Slice_8\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 870 for ONNX tensor: 870\r\n[01/19/2022-03:52:37] [V] [TRT] Slice_8 [Slice] outputs: [870 -\u003e (4, 2)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Transpose_9 [Transpose]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 870\r\n[01/19/2022-03:52:37] [V] [TRT] Transpose_9 [Transpose] inputs: [870 -\u003e (4, 2)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Transpose_9 for ONNX node: Transpose_9\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 871 for ONNX tensor: 871\r\n[01/19/2022-03:52:37] [V] [TRT] Transpose_9 [Transpose] outputs: [871 -\u003e (2, 4)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_10 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_10 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_10 [Constant] outputs: [872 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Reshape_11 [Reshape]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 871\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 872\r\n[01/19/2022-03:52:37] [V] [TRT] Reshape_11 [Reshape] inputs: [871 -\u003e (2, 4)[INT32]], [872 -\u003e (1)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Reshape_11 for ONNX node: Reshape_11\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 873 for ONNX tensor: 873\r\n[01/19/2022-03:52:37] [V] [TRT] Reshape_11 [Reshape] outputs: [873 -\u003e (8)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Cast_12 [Cast]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 873\r\n[01/19/2022-03:52:37] [V] [TRT] Cast_12 [Cast] inputs: [873 -\u003e (8)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Casting to type: int32\r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Cast_12 for ONNX node: Cast_12\r\n[01/19/2022-03:52:37] [V] [TRT] Registering tensor: 874 for ONNX tensor: 874\r\n[01/19/2022-03:52:37] [V] [TRT] Cast_12 [Cast] outputs: [874 -\u003e (8)[INT32]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Constant_13 [Constant]\r\n[01/19/2022-03:52:37] [V] [TRT] Constant_13 [Constant] inputs: \r\n[01/19/2022-03:52:37] [V] [TRT] Constant_13 [Constant] outputs: [875 -\u003e ()[FLOAT]], \r\n[01/19/2022-03:52:37] [V] [TRT] Parsing node: Pad_14 [Pad]\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: input0\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 874\r\n[01/19/2022-03:52:37] [V] [TRT] Searching for input: 875\r\n[01/19/2022-03:52:37] [V] [TRT] Pad_14 [Pad] inputs: [input0 -\u003e (-1, 3, 480, 640)[FLOAT]], [874 -\u003e (8)[INT32]], [875 -\u003e ()[FLOAT]], \r\n[01/19/2022-03:52:37] [V] [TRT] Registering layer: Pad_14 for ONNX node: Pad_14\r\n[01/19/2022-03:52:37] [E] Error[4]: [shuffleNode.cpp::symbolicExecute::387] Error Code 4: Internal Error (Reshape_3: IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions: dimensions were [-1,2])\r\n[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:773: While parsing node number 14 [Pad -\u003e \"876\"]:\r\n[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:774: --- Begin node ---\r\n[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:775: input: \"input0\"\r\ninput: \"874\"\r\ninput: \"875\"\r\noutput: \"876\"\r\nname: \"Pad_14\"\r\nop_type: \"Pad\"\r\nattribute {\r\n  name: \"mode\"\r\n  s: \"constant\"\r\n  type: STRING\r\n}\r\ndoc_string: \"/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/functional.py(4174): _pad\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/padding.py(23): forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/conv2d_layers.py(111): forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/gen_efficientnet.py(260): features\\n/home/jliu/.cache/torch/hub/rwightman_gen-efficientnet-pytorch_master/geffnet/gen_efficientnet.py(278): forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1090): _slow_forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(118): wrapper\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(127): forward\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/nn/modules/module.py(1102): _call_impl\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/jit/_trace.py(1166): _get_trace_graph\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(388): _trace_and_get_graph_from_model\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(437): _create_jit_graph\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(493): _model_to_graph\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/utils.py(724): _export\\n/home/jliu/anaconda3/envs/adabins/lib/python3.9/site-packages/torch/onnx/__init__.py(28): _export\\n/home/jliu/data2/torch2trt/onnx_export.py(106): main\\n/home/jliu/data2/torch2trt/onnx_export.py(129): \u003cmodule\u003e\\n\"\r\n\r\n[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:776: --- End node ---\r\n[01/19/2022-03:52:37] [E] [TRT] ModelImporter.cpp:779: ERROR: ModelImporter.cpp:179 In function parseGraph:\r\n[6] Invalid Node - Pad_14\r\n[shuffleNode.cpp::symbolicExecute::387] Error Code 4: Internal Error (Reshape_3: IShuffleLayer applied to shape tensor must have 0 or 1 reshape dimensions: dimensions were [-1,2])\r\n[01/19/2022-03:52:37] [E] Failed to parse onnx file\r\n[01/19/2022-03:52:37] [I] Finish parsing network model\r\n[01/19/2022-03:52:37] [E] Parsing model failed\r\n[01/19/2022-03:52:37] [E] Failed to create engine from model.\r\n[01/19/2022-03:52:37] [E] Engine set up failed\r\n\u0026\u0026\u0026\u0026 FAILED TensorRT.trtexec [TensorRT v8202] # ./trtexec --explicitBatch --workspace=2048 --tacticSources=-cublasLt,+cublas --onnx=outputmodel/tf_efficientnet_b5_ap_set11.onnx --saveEngine=efficientnet5_engine_adabin.trt --verbose=True --fp16=True\r\n","author":{"url":"https://github.com/azuryl","@type":"Person","name":"azuryl"},"datePublished":"2022-01-19T15:19:51.000Z","interactionStatistic":{"@type":"InteractionCounter","interactionType":"https://schema.org/CommentAction","userInteractionCount":0},"url":"https://github.com/1/TensorRT_classifier_efficientNet/issues/1"}