2018-10-02 17:56:40.777748: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv4/my_trt_op_20_native_segment
2018-10-02 17:56:40.777756: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 75.488ms.
2018-10-02 17:56:40.777761: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 46.379ms.
2018-10-02 17:56:40.777765: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.234ms.
2018-10-02 17:56:40.777770: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 111.487ms.
2018-10-02 17:56:40.777775: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 15.929ms.
2018-10-02 17:56:40.777779: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: box_predictor/fc7_drop/dropout/my_trt_op_73_native_segment
2018-10-02 17:56:40.777785: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 101.857ms.
2018-10-02 17:56:40.777789: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 56.307ms.
2018-10-02 17:56:40.777794: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 17.826ms.
2018-10-02 17:56:40.777798: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 73.912ms.
2018-10-02 17:56:40.777803: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 18.894ms.
2018-10-02 17:56:40.777808: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: box_predictor/fc6_drop/dropout/my_trt_op_72_native_segment
2018-10-02 17:56:40.777812: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 79.862ms.
2018-10-02 17:56:40.777817: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 43.957ms.
2018-10-02 17:56:40.777822: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 18.656ms.
2018-10-02 17:56:40.777827: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 84.13ms.
2018-10-02 17:56:40.777832: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 15.831ms.
2018-10-02 17:56:40.777836: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_88_native_segment
2018-10-02 17:56:40.777841: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 112.088ms.
2018-10-02 17:56:40.777846: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 48.561ms.
2018-10-02 17:56:40.777851: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 15.32ms.
2018-10-02 17:56:40.777855: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 84.949ms.
2018-10-02 17:56:40.777860: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 15.206ms.
2018-10-02 17:56:40.777864: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv1/my_trt_op_39_native_segment
2018-10-02 17:56:40.777875: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 97.002ms.
2018-10-02 17:56:40.777880: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 49.334ms.
2018-10-02 17:56:40.777884: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.348ms.
2018-10-02 17:56:40.777889: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 75.246ms.
2018-10-02 17:56:40.777894: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.323ms.
2018-10-02 17:56:40.777898: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_2_native_segment
2018-10-02 17:56:40.777903: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 100.693ms.
2018-10-02 17:56:40.777908: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 7 nodes (0), 6 edges (0), time = 46.782ms.
2018-10-02 17:56:40.777912: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 21.77ms.
2018-10-02 17:56:40.777917: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 67.921ms.
2018-10-02 17:56:40.777922: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 13.852ms.
2018-10-02 17:56:40.777926: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_8_native_segment
2018-10-02 17:56:40.777931: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 72.786ms.
2018-10-02 17:56:40.777936: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 46.438ms.
2018-10-02 17:56:40.777940: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 14.778ms.
2018-10-02 17:56:40.777945: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 73.322ms.
2018-10-02 17:56:40.777950: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 14.568ms.
2018-10-02 17:56:40.777954: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_79_native_segment
2018-10-02 17:56:40.777959: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 93.484ms.
2018-10-02 17:56:40.777964: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 57.016ms.
2018-10-02 17:56:40.777968: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 16.567ms.
2018-10-02 17:56:40.777973: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 110.085ms.
2018-10-02 17:56:40.777978: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 19.795ms.
2018-10-02 17:56:40.777982: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_8_native_segment
2018-10-02 17:56:40.777990: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 10 nodes (0), 9 edges (0), time = 171.247ms.
2018-10-02 17:56:40.777995: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 10 nodes (0), 9 edges (0), time = 60.652ms.
2018-10-02 17:56:40.778000: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 10 nodes (0), 9 edges (0), time = 15.295ms.
2018-10-02 17:56:40.778005: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 10 nodes (0), 9 edges (0), time = 202.229ms.
2018-10-02 17:56:40.778009: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 10 nodes (0), 9 edges (0), time = 19.85ms.
2018-10-02 17:56:40.778014: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14_native_segment
2018-10-02 17:56:40.778019: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 125.611ms.
2018-10-02 17:56:40.778024: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 71.643ms.
2018-10-02 17:56:40.778028: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 23.51ms.
2018-10-02 17:56:40.778033: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 105.809ms.
2018-10-02 17:56:40.778038: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.109ms.
2018-10-02 17:56:40.778042: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: box_predictor/fc8_drop/dropout/my_trt_op_74_native_segment
2018-10-02 17:56:40.778047: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 96.14ms.
2018-10-02 17:56:40.778052: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 62.772ms.
2018-10-02 17:56:40.778057: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.635ms.
2018-10-02 17:56:40.778061: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 100.912ms.
2018-10-02 17:56:40.778066: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 19.505ms.
2018-10-02 17:56:40.778071: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_7_native_segment
2018-10-02 17:56:40.778076: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 42 nodes (0), 48 edges (0), time = 90.341ms.
2018-10-02 17:56:40.778080: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 42 nodes (0), 48 edges (0), time = 58.895ms.
2018-10-02 17:56:40.778085: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 42 nodes (0), 48 edges (0), time = 23.053ms.
2018-10-02 17:56:40.778090: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 42 nodes (0), 48 edges (0), time = 101.459ms.
2018-10-02 17:56:40.778094: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 42 nodes (0), 48 edges (0), time = 15.277ms.
2018-10-02 17:56:40.778099: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_32_native_segment
2018-10-02 17:56:40.778107: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 68.565ms.
2018-10-02 17:56:40.778112: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 43.078ms.
2018-10-02 17:56:40.778116: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 17.118ms.
2018-10-02 17:56:40.778121: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 69.783ms.
2018-10-02 17:56:40.778125: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 15.171ms.
2018-10-02 17:56:40.778130: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_5_native_segment
2018-10-02 17:56:40.778135: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 15 nodes (0), 15 edges (0), time = 81.789ms.
2018-10-02 17:56:40.778139: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 15 nodes (0), 15 edges (0), time = 58.871ms.
2018-10-02 17:56:40.778144: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 15 nodes (0), 15 edges (0), time = 21.822ms.
2018-10-02 17:56:40.778149: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 15 nodes (0), 15 edges (0), time = 103.572ms.
2018-10-02 17:56:40.778153: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 15 nodes (0), 15 edges (0), time = 21.173ms.
2018-10-02 17:56:40.778158: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_24_native_segment
2018-10-02 17:56:40.778163: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 8 edges (0), time = 76.028ms.
2018-10-02 17:56:40.778167: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 7 nodes (0), 8 edges (0), time = 47.977ms.
2018-10-02 17:56:40.778172: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 8 edges (0), time = 15.578ms.
2018-10-02 17:56:40.778177: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 8 edges (0), time = 67.261ms.
2018-10-02 17:56:40.778181: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 8 edges (0), time = 12.204ms.
2018-10-02 17:56:40.778186: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv2/my_trt_op_10_native_segment
2018-10-02 17:56:40.778191: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 66.655ms.
2018-10-02 17:56:40.778196: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 41.333ms.
2018-10-02 17:56:40.778201: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 12.683ms.
2018-10-02 17:56:40.778205: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 63.096ms.
2018-10-02 17:56:40.778210: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.835ms.
2018-10-02 17:56:40.778215: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_4_native_segment
2018-10-02 17:56:40.778222: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 94.363ms.
2018-10-02 17:56:40.778227: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 49.062ms.
2018-10-02 17:56:40.778232: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 15.634ms.
2018-10-02 17:56:40.778237: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 83.174ms.
2018-10-02 17:56:40.778242: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 16.232ms.
2018-10-02 17:56:40.778246: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv2/my_trt_op_47_native_segment
2018-10-02 17:56:40.778251: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 114.132ms.
2018-10-02 17:56:40.778256: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 69.724ms.
2018-10-02 17:56:40.778261: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 22.896ms.
2018-10-02 17:56:40.778265: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 115.544ms.
2018-10-02 17:56:40.778270: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.883ms.
2018-10-02 17:56:40.778275: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_12_native_segment
2018-10-02 17:56:40.778279: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 13 nodes (0), 12 edges (0), time = 99.906ms.
2018-10-02 17:56:40.778284: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 19 nodes (6), 20 edges (8), time = 65.87ms.
2018-10-02 17:56:40.778289: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 19 nodes (0), 20 edges (0), time = 20.68ms.
2018-10-02 17:56:40.778294: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 19 nodes (0), 20 edges (0), time = 105.972ms.
2018-10-02 17:56:40.778299: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 19 nodes (0), 20 edges (0), time = 20.176ms.
2018-10-02 17:56:40.778303: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_27_native_segment
2018-10-02 17:56:40.778308: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 96.599ms.
2018-10-02 17:56:40.778313: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 58.041ms.
2018-10-02 17:56:40.778317: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 19.126ms.
2018-10-02 17:56:40.778322: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 94.906ms.
2018-10-02 17:56:40.778327: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 19.079ms.
2018-10-02 17:56:40.778331: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_55_native_segment
2018-10-02 17:56:40.778339: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 108.69ms.
2018-10-02 17:56:40.778344: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 65.153ms.
2018-10-02 17:56:40.778349: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 20.794ms.
2018-10-02 17:56:40.778354: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 103.203ms.
2018-10-02 17:56:40.778359: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 21.007ms.
2018-10-02 17:56:40.778363: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_28_native_segment
2018-10-02 17:56:40.778368: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 19 nodes (0), 20 edges (0), time = 114.885ms.
2018-10-02 17:56:40.778373: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 19 nodes (0), 20 edges (0), time = 77.866ms.
2018-10-02 17:56:40.778378: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 19 nodes (0), 20 edges (0), time = 23.805ms.
2018-10-02 17:56:40.778383: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 19 nodes (0), 20 edges (0), time = 111.436ms.
2018-10-02 17:56:40.778387: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 19 nodes (0), 20 edges (0), time = 19.458ms.
2018-10-02 17:56:40.778400: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_94_native_segment
2018-10-02 17:56:40.778405: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 80.543ms.
2018-10-02 17:56:40.778410: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 58.339ms.
2018-10-02 17:56:40.778415: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 19.708ms.
2018-10-02 17:56:40.778419: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 87.838ms.
2018-10-02 17:56:40.778424: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.698ms.
2018-10-02 17:56:40.778429: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_30_native_segment
2018-10-02 17:56:40.778433: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 121.923ms.
2018-10-02 17:56:40.778438: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 47.098ms.
2018-10-02 17:56:40.778443: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 24.22ms.
2018-10-02 17:56:40.778448: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 108.566ms.
2018-10-02 17:56:40.778452: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 23.011ms.
2018-10-02 17:56:40.778457: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv3/my_trt_op_16_native_segment
2018-10-02 17:56:40.778465: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 101.374ms.
2018-10-02 17:56:40.778469: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 42.587ms.
2018-10-02 17:56:40.778474: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.76ms.
2018-10-02 17:56:40.778479: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 79.239ms.
2018-10-02 17:56:40.778483: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.402ms.
2018-10-02 17:56:40.778488: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_52_native_segment
2018-10-02 17:56:40.778493: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 159.819ms.
2018-10-02 17:56:40.778497: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 59.04ms.
2018-10-02 17:56:40.778502: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 24.367ms.
2018-10-02 17:56:40.778507: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 105.897ms.
2018-10-02 17:56:40.778512: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 20.263ms.
2018-10-02 17:56:40.778516: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_41_native_segment
2018-10-02 17:56:40.778521: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 119.099ms.
2018-10-02 17:56:40.778526: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 64.511ms.
2018-10-02 17:56:40.778531: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 19.904ms.
2018-10-02 17:56:40.778536: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 105.488ms.
2018-10-02 17:56:40.778540: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 16.375ms.
2018-10-02 17:56:40.778545: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_input/my_trt_op_77_native_segment
2018-10-02 17:56:40.778550: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 121.065ms.
2018-10-02 17:56:40.778555: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 49.449ms.
2018-10-02 17:56:40.778559: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 17.159ms.
2018-10-02 17:56:40.778564: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 87.813ms.
2018-10-02 17:56:40.778569: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 17.637ms.
2018-10-02 17:56:40.778574: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_36_native_segment
2018-10-02 17:56:40.778579: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 97.444ms.
2018-10-02 17:56:40.778587: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 7 nodes (0), 6 edges (0), time = 56.214ms.
2018-10-02 17:56:40.778591: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 19.357ms.
2018-10-02 17:56:40.778596: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 108.06ms.
2018-10-02 17:56:40.778601: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 16.506ms.
2018-10-02 17:56:40.778605: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_6_native_segment
2018-10-02 17:56:40.778610: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 15 nodes (0), 15 edges (0), time = 144.376ms.
2018-10-02 17:56:40.778615: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 15 nodes (0), 15 edges (0), time = 64.375ms.
2018-10-02 17:56:40.778620: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 15 nodes (0), 15 edges (0), time = 23.864ms.
2018-10-02 17:56:40.778624: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 15 nodes (0), 15 edges (0), time = 114.696ms.
2018-10-02 17:56:40.778629: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 15 nodes (0), 15 edges (0), time = 16.925ms.
2018-10-02 17:56:40.778633: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_10_native_segment
2018-10-02 17:56:40.778638: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 21 nodes (0), 20 edges (0), time = 88.207ms.
2018-10-02 17:56:40.778643: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 21 nodes (0), 20 edges (0), time = 48.169ms.
2018-10-02 17:56:40.778648: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 21 nodes (0), 20 edges (0), time = 14.026ms.
2018-10-02 17:56:40.778653: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 21 nodes (0), 20 edges (0), time = 73.447ms.
2018-10-02 17:56:40.778657: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 21 nodes (0), 20 edges (0), time = 14.421ms.
2018-10-02 17:56:40.778662: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_34_native_segment
2018-10-02 17:56:40.778666: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 97.452ms.
2018-10-02 17:56:40.778671: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 51.176ms.
2018-10-02 17:56:40.778676: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 17.601ms.
2018-10-02 17:56:40.778680: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 84.946ms.
2018-10-02 17:56:40.778685: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.067ms.
2018-10-02 17:56:40.778690: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv3/my_trt_op_53_native_segment
2018-10-02 17:56:40.778695: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 129.842ms.
2018-10-02 17:56:40.778713: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 65.908ms.
2018-10-02 17:56:40.778718: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 20.821ms.
2018-10-02 17:56:40.778723: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 86.942ms.
2018-10-02 17:56:40.778728: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.451ms.
2018-10-02 17:56:40.778732: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_bottleneck/bottleneck/my_trt_op_0_native_segment
2018-10-02 17:56:40.778737: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 94.827ms.
2018-10-02 17:56:40.778742: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 53.676ms.
2018-10-02 17:56:40.778747: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 18.177ms.
2018-10-02 17:56:40.778752: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 89.32ms.
2018-10-02 17:56:40.778756: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 16.613ms.
2018-10-02 17:56:40.778761: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_36_native_segment
2018-10-02 17:56:40.778765: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 74.077ms.
2018-10-02 17:56:40.778770: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 43.634ms.
2018-10-02 17:56:40.778775: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 14.627ms.
2018-10-02 17:56:40.778780: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 66.59ms.
2018-10-02 17:56:40.778784: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 12.386ms.
2018-10-02 17:56:40.778789: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17_native_segment
2018-10-02 17:56:40.778793: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 91.361ms.
2018-10-02 17:56:40.778798: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 62.223ms.
2018-10-02 17:56:40.778803: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 19.545ms.
2018-10-02 17:56:40.778808: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 83.007ms.
2018-10-02 17:56:40.778813: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 16.396ms.
2018-10-02 17:56:40.778817: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_84_native_segment
2018-10-02 17:56:40.778822: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 88.167ms.
2018-10-02 17:56:40.778830: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 45.84ms.
2018-10-02 17:56:40.778835: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 13.792ms.
2018-10-02 17:56:40.778840: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 78.441ms.
2018-10-02 17:56:40.778845: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 13.941ms.
2018-10-02 17:56:40.778849: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv2/my_trt_op_86_native_segment
2018-10-02 17:56:40.778854: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 82.338ms.
2018-10-02 17:56:40.778859: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 57.127ms.
2018-10-02 17:56:40.778864: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.181ms.
2018-10-02 17:56:40.778869: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 94.345ms.
2018-10-02 17:56:40.778874: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.682ms.
2018-10-02 17:56:40.778878: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv3/my_trt_op_90_native_segment
2018-10-02 17:56:40.778883: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 101.856ms.
2018-10-02 17:56:40.778888: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 61.665ms.
2018-10-02 17:56:40.778893: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 17.499ms.
2018-10-02 17:56:40.778898: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 107.398ms.
2018-10-02 17:56:40.778902: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 21.293ms.
2018-10-02 17:56:40.778907: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_0_native_segment
2018-10-02 17:56:40.778911: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 103.244ms.
2018-10-02 17:56:40.778916: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 13 nodes (4), 12 edges (4), time = 68.954ms.
2018-10-02 17:56:40.778921: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 13 nodes (0), 12 edges (0), time = 22.664ms.
2018-10-02 17:56:40.778926: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 13 nodes (0), 12 edges (0), time = 137.616ms.
2018-10-02 17:56:40.778931: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 13 nodes (0), 12 edges (0), time = 28.718ms.
2018-10-02 17:56:40.778935: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_35_native_segment
2018-10-02 17:56:40.778940: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 126.762ms.
2018-10-02 17:56:40.778947: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 7 nodes (0), 6 edges (0), time = 50.357ms.
2018-10-02 17:56:40.778952: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 18.147ms.
2018-10-02 17:56:40.778957: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 80.564ms.
2018-10-02 17:56:40.778962: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 25.198ms.
2018-10-02 17:56:40.778966: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15_native_segment
2018-10-02 17:56:40.778971: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 83.305ms.
2018-10-02 17:56:40.778976: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 40.139ms.
2018-10-02 17:56:40.778981: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 12.973ms.
2018-10-02 17:56:40.778985: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 63.052ms.
2018-10-02 17:56:40.778990: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 13.269ms.
2018-10-02 17:56:40.778995: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv4/my_trt_op_98_native_segment
2018-10-02 17:56:40.778999: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 81.518ms.
2018-10-02 17:56:40.779004: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 47.497ms.
2018-10-02 17:56:40.779009: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.047ms.
2018-10-02 17:56:40.779014: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 76.779ms.
2018-10-02 17:56:40.779019: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 15.221ms.
2018-10-02 17:56:40.779023: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_40_native_segment
2018-10-02 17:56:40.779028: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 92.461ms.
2018-10-02 17:56:40.779033: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 47.376ms.
2018-10-02 17:56:40.779038: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 17.816ms.
2018-10-02 17:56:40.779043: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 90.656ms.
2018-10-02 17:56:40.779047: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 14.102ms.
2018-10-02 17:56:40.779052: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_bottleneck/bottleneck/my_trt_op_37_native_segment
2018-10-02 17:56:40.779057: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 63.86ms.
2018-10-02 17:56:40.779065: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 38.907ms.
2018-10-02 17:56:40.779069: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 11.652ms.
2018-10-02 17:56:40.779074: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 69.803ms.
2018-10-02 17:56:40.779079: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 12.246ms.
2018-10-02 17:56:40.779084: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_18_native_segment
2018-10-02 17:56:40.779089: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 69.677ms.
2018-10-02 17:56:40.779093: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 48.913ms.
2018-10-02 17:56:40.779098: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 15.775ms.
2018-10-02 17:56:40.779103: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 78.473ms.
2018-10-02 17:56:40.779107: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 15.874ms.
2018-10-02 17:56:40.779112: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_33_native_segment
2018-10-02 17:56:40.779117: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 104.174ms.
2018-10-02 17:56:40.779121: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 59.715ms.
2018-10-02 17:56:40.779126: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 19.682ms.
2018-10-02 17:56:40.779131: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 110.365ms.
2018-10-02 17:56:40.779136: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 21.466ms.
2018-10-02 17:56:40.779140: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_4_native_segment
2018-10-02 17:56:40.779145: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 112.393ms.
2018-10-02 17:56:40.779149: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 68.502ms.
2018-10-02 17:56:40.779154: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 20.575ms.
2018-10-02 17:56:40.779159: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 107.055ms.
2018-10-02 17:56:40.779163: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 20.598ms.
2018-10-02 17:56:40.779168: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_39_native_segment
2018-10-02 17:56:40.779173: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 98.208ms.
2018-10-02 17:56:40.779181: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 7 nodes (0), 6 edges (0), time = 71.593ms.
2018-10-02 17:56:40.779195: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 16.447ms.
2018-10-02 17:56:40.779200: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 90.597ms.
2018-10-02 17:56:40.779204: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 7 nodes (0), 6 edges (0), time = 19.726ms.
2018-10-02 17:56:40.779209: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_80_native_segment
2018-10-02 17:56:40.779214: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 103.706ms.
2018-10-02 17:56:40.779218: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 66.372ms.
2018-10-02 17:56:40.779223: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 25.863ms.
2018-10-02 17:56:40.779228: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 99.486ms.
2018-10-02 17:56:40.779233: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 16.206ms.
2018-10-02 17:56:40.779237: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_26_native_segment
2018-10-02 17:56:40.779242: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 98.167ms.
2018-10-02 17:56:40.779247: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 59.385ms.
2018-10-02 17:56:40.779251: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.568ms.
2018-10-02 17:56:40.779256: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 139.949ms.
2018-10-02 17:56:40.779261: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.402ms.
2018-10-02 17:56:40.779265: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: box_predictor/fc6/my_trt_op_71_native_segment
2018-10-02 17:56:40.779270: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 146.346ms.
2018-10-02 17:56:40.779275: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 64.568ms.
2018-10-02 17:56:40.779279: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 15.238ms.
2018-10-02 17:56:40.779284: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 146.288ms.
2018-10-02 17:56:40.779289: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 20.676ms.
2018-10-02 17:56:40.779294: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv3/my_trt_op_48_native_segment
2018-10-02 17:56:40.779298: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 107.618ms.
2018-10-02 17:56:40.779306: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 65.234ms.
2018-10-02 17:56:40.779311: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 19.001ms.
2018-10-02 17:56:40.779315: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 82.546ms.
2018-10-02 17:56:40.779320: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.445ms.
2018-10-02 17:56:40.779325: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv1/conv1_1/my_trt_op_40_native_segment
2018-10-02 17:56:40.779329: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 85.819ms.
2018-10-02 17:56:40.779334: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 50.473ms.
2018-10-02 17:56:40.779339: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 16.447ms.
2018-10-02 17:56:40.779343: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 94.917ms.
2018-10-02 17:56:40.779348: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.329ms.
2018-10-02 17:56:40.779353: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_46_native_segment
2018-10-02 17:56:40.779358: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 83.529ms.
2018-10-02 17:56:40.779362: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 50.784ms.
2018-10-02 17:56:40.779367: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 14.719ms.
2018-10-02 17:56:40.779372: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 74.205ms.
2018-10-02 17:56:40.779377: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 14.43ms.
2018-10-02 17:56:40.779381: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_12_native_segment
2018-10-02 17:56:40.779387: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 83.226ms.
2018-10-02 17:56:40.779391: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 50.931ms.
2018-10-02 17:56:40.779396: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 17.027ms.
2018-10-02 17:56:40.779401: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 79.41ms.
2018-10-02 17:56:40.779405: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.315ms.
2018-10-02 17:56:40.779410: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_2_native_segment
2018-10-02 17:56:40.779415: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 120.436ms.
2018-10-02 17:56:40.779420: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 13 nodes (4), 12 edges (4), time = 70.529ms.
2018-10-02 17:56:40.779427: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 13 nodes (0), 12 edges (0), time = 21.516ms.
2018-10-02 17:56:40.779432: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 13 nodes (0), 12 edges (0), time = 95.753ms.
2018-10-02 17:56:40.779437: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 13 nodes (0), 12 edges (0), time = 16.356ms.
2018-10-02 17:56:40.779441: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_75_native_segment
2018-10-02 17:56:40.779446: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 88.041ms.
2018-10-02 17:56:40.779451: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 56.761ms.
2018-10-02 17:56:40.779455: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 17.758ms.
2018-10-02 17:56:40.779460: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 74.758ms.
2018-10-02 17:56:40.779465: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 13.811ms.
2018-10-02 17:56:40.779469: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv1/my_trt_op_43_native_segment
2018-10-02 17:56:40.779474: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 79.718ms.
2018-10-02 17:56:40.779479: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 53.626ms.
2018-10-02 17:56:40.779484: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 17.251ms.
2018-10-02 17:56:40.779489: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 81.104ms.
2018-10-02 17:56:40.779493: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.558ms.
2018-10-02 17:56:40.779498: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv1/conv1_1/my_trt_op_82_native_segment
2018-10-02 17:56:40.779503: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 115.258ms.
2018-10-02 17:56:40.779507: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 57.456ms.
2018-10-02 17:56:40.779512: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 17.428ms.
2018-10-02 17:56:40.779517: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 110.812ms.
2018-10-02 17:56:40.779521: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 15.478ms.
2018-10-02 17:56:40.779526: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv1/my_trt_op_81_native_segment
2018-10-02 17:56:40.779530: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 92.83ms.
2018-10-02 17:56:40.779535: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 50.043ms.
2018-10-02 17:56:40.779545: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.106ms.
2018-10-02 17:56:40.779550: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 93.328ms.
2018-10-02 17:56:40.779555: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 22.856ms.
2018-10-02 17:56:40.779559: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_3_native_segment
2018-10-02 17:56:40.779564: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 8 nodes (0), 7 edges (0), time = 85.217ms.
2018-10-02 17:56:40.779569: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 12 nodes (4), 11 edges (4), time = 54.623ms.
2018-10-02 17:56:40.779574: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 12 nodes (0), 11 edges (0), time = 19.887ms.
2018-10-02 17:56:40.779579: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 12 nodes (0), 11 edges (0), time = 123.271ms.
2018-10-02 17:56:40.779583: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 12 nodes (0), 11 edges (0), time = 24.725ms.
2018-10-02 17:56:40.779588: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_29_native_segment
2018-10-02 17:56:40.779593: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 141.313ms.
2018-10-02 17:56:40.779597: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (0), 10 edges (0), time = 71.323ms.
2018-10-02 17:56:40.779602: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 23.05ms.
2018-10-02 17:56:40.779607: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 118.683ms.
2018-10-02 17:56:40.779612: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 23.024ms.
2018-10-02 17:56:40.779616: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: avod_regression/my_trt_op_31_native_segment
2018-10-02 17:56:40.779621: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 136.501ms.
2018-10-02 17:56:40.779626: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 74.682ms.
2018-10-02 17:56:40.779631: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.389ms.
2018-10-02 17:56:40.779636: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 86.831ms.
2018-10-02 17:56:40.779640: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 15.856ms.
2018-10-02 17:56:40.779645: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_45_native_segment
2018-10-02 17:56:40.779650: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 87.749ms.
2018-10-02 17:56:40.779654: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 45.413ms.
2018-10-02 17:56:40.779662: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 13.229ms.
2018-10-02 17:56:40.779667: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 66.453ms.
2018-10-02 17:56:40.779671: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 16.001ms.
2018-10-02 17:56:40.779676: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv2/my_trt_op_44_native_segment
2018-10-02 17:56:40.779681: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 79.012ms.
2018-10-02 17:56:40.779685: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 46.284ms.
2018-10-02 17:56:40.779690: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.666ms.
2018-10-02 17:56:40.779695: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 73.283ms.
2018-10-02 17:56:40.779700: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 13.655ms.
2018-10-02 17:56:40.779704: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_1_native_segment
2018-10-02 17:56:40.779709: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 8 nodes (0), 7 edges (0), time = 90.175ms.
2018-10-02 17:56:40.779714: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 12 nodes (4), 11 edges (4), time = 52.019ms.
2018-10-02 17:56:40.779719: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 12 nodes (0), 11 edges (0), time = 20.334ms.
2018-10-02 17:56:40.779723: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 12 nodes (0), 11 edges (0), time = 119.619ms.
2018-10-02 17:56:40.779728: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 12 nodes (0), 11 edges (0), time = 16.267ms.
2018-10-02 17:56:40.779733: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv3/my_trt_op_92_native_segment
2018-10-02 17:56:40.779738: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 99.147ms.
2018-10-02 17:56:40.779743: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 56.728ms.
2018-10-02 17:56:40.779747: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 17.775ms.
2018-10-02 17:56:40.779752: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 86.698ms.
2018-10-02 17:56:40.779757: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 17.552ms.
2018-10-02 17:56:40.779767: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv1/my_trt_op_6_native_segment
2018-10-02 17:56:40.779773: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 90.597ms.
2018-10-02 17:56:40.779778: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 57.158ms.
2018-10-02 17:56:40.779786: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 19.502ms.
2018-10-02 17:56:40.779791: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 84.636ms.
2018-10-02 17:56:40.779796: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.075ms.
2018-10-02 17:56:40.779800: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv4/my_trt_op_57_native_segment
2018-10-02 17:56:40.779805: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 106.961ms.
2018-10-02 17:56:40.779810: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 65.187ms.
2018-10-02 17:56:40.779815: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.778ms.
2018-10-02 17:56:40.779819: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 83.257ms.
2018-10-02 17:56:40.779824: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 16.312ms.
2018-10-02 17:56:40.779829: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/conv4/my_trt_op_96_native_segment
2018-10-02 17:56:40.779833: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 76.479ms.
2018-10-02 17:56:40.779839: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 46.597ms.
2018-10-02 17:56:40.779843: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 14.137ms.
2018-10-02 17:56:40.779848: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 69.406ms.
2018-10-02 17:56:40.779853: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 13.234ms.
2018-10-02 17:56:40.779857: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_42_native_segment
2018-10-02 17:56:40.779862: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 68.474ms.
2018-10-02 17:56:40.779867: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 43.52ms.
2018-10-02 17:56:40.779872: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 26.47ms.
2018-10-02 17:56:40.779877: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 78.794ms.
2018-10-02 17:56:40.779881: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 14.8ms.
2018-10-02 17:56:40.779886: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: img_vgg_pyr/my_trt_op_42_native_segment
2018-10-02 17:56:40.779891: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 85.927ms.
2018-10-02 17:56:40.779895: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 43.878ms.
2018-10-02 17:56:40.779903: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 13.236ms.
2018-10-02 17:56:40.779908: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 71.235ms.
2018-10-02 17:56:40.779912: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 12.904ms.
2018-10-02 17:56:40.779917: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_5_native_segment
2018-10-02 17:56:40.779922: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 70.093ms.
2018-10-02 17:56:40.779927: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 9 nodes (0), 8 edges (0), time = 43.777ms.
2018-10-02 17:56:40.779932: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 15.261ms.
2018-10-02 17:56:40.779936: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 9 nodes (0), 8 edges (0), time = 64.352ms.
2018-10-02 17:56:40.779941: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 9 nodes (0), 8 edges (0), time = 11.675ms.
2018-10-02 17:56:40.779946: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_9_native_segment
2018-10-02 17:56:40.779950: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 10 nodes (0), 9 edges (0), time = 138.978ms.
2018-10-02 17:56:40.779955: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 10 nodes (0), 9 edges (0), time = 61.699ms.
2018-10-02 17:56:40.779960: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 10 nodes (0), 9 edges (0), time = 15.373ms.
2018-10-02 17:56:40.779965: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 10 nodes (0), 9 edges (0), time = 153.454ms.
2018-10-02 17:56:40.779970: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 10 nodes (0), 9 edges (0), time = 24.219ms.
2018-10-02 17:56:40.779974: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv3/my_trt_op_51_native_segment
2018-10-02 17:56:40.779979: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 124.851ms.
2018-10-02 17:56:40.779984: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 76.039ms.
2018-10-02 17:56:40.779989: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 23.789ms.
2018-10-02 17:56:40.779993: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 91.301ms.
2018-10-02 17:56:40.779998: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 18.15ms.
2018-10-02 17:56:40.780003: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16_native_segment
2018-10-02 17:56:40.780008: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 103.999ms.
2018-10-02 17:56:40.780013: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 58.96ms.
2018-10-02 17:56:40.780018: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.132ms.
2018-10-02 17:56:40.780026: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 96.461ms.
2018-10-02 17:56:40.780031: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 18.506ms.
2018-10-02 17:56:40.780035: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: my_trt_op_13_native_segment
2018-10-02 17:56:40.780040: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 159.507ms.
2018-10-02 17:56:40.780045: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 5 nodes (0), 4 edges (0), time = 78.108ms.
2018-10-02 17:56:40.780050: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 27.84ms.
2018-10-02 17:56:40.780054: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 5 nodes (0), 4 edges (0), time = 142.559ms.
2018-10-02 17:56:40.780059: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 5 nodes (0), 4 edges (0), time = 20.611ms.
2018-10-02 17:56:40.780064: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/my_trt_op_49_native_segment
2018-10-02 17:56:40.780068: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 7 nodes (0), 6 edges (0), time = 92.86ms.
2018-10-02 17:56:40.780073: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 11 nodes (4), 10 edges (4), time = 58.017ms.
2018-10-02 17:56:40.780078: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 21.799ms.
2018-10-02 17:56:40.780082: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 11 nodes (0), 10 edges (0), time = 115.933ms.
2018-10-02 17:56:40.780087: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 11 nodes (0), 10 edges (0), time = 23.586ms.
2018-10-02 17:56:40.780092: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:404] Optimization results for grappler item: bev_vgg_pyr/conv3/my_trt_op_14_native_segment
2018-10-02 17:56:40.780097: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 100.614ms.
2018-10-02 17:56:40.780102: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   layout: Graph size after: 6 nodes (0), 5 edges (0), time = 71.394ms.
2018-10-02 17:56:40.780106: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 22.289ms.
2018-10-02 17:56:40.780111: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   constant folding: Graph size after: 6 nodes (0), 5 edges (0), time = 107.775ms.
2018-10-02 17:56:40.780116: I tensorflow/core/grappler/optimizers/meta_optimizer.cc:406]   TensorRTOptimizer: Graph size after: 6 nodes (0), 5 edges (0), time = 21.687ms.
executing
2018-10-02 17:56:43.449862: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1490] Adding visible gpu devices: 0
2018-10-02 17:56:43.450066: I tensorflow/core/common_runtime/gpu/gpu_device.cc:971] Device interconnect StreamExecutor with strength 1 edge matrix:
2018-10-02 17:56:43.450077: I tensorflow/core/common_runtime/gpu/gpu_device.cc:977]      0
2018-10-02 17:56:43.450085: I tensorflow/core/common_runtime/gpu/gpu_device.cc:990] 0:   N
2018-10-02 17:56:43.450426: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1103] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 11334 MB memory) -> physical GPU (device: 0, name: TITAN Xp, pci bus id: 0000:05:00.0, compute capability: 6.1)
2018-10-02 17:56:47.919658: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:47.919799: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14
2018-10-02 17:56:47.919973: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:47.920014: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16
2018-10-02 17:56:47.996399: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:47.996398: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:47.996490: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17
2018-10-02 17:56:47.996497: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15
2018-10-02 17:56:48.276289: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.276379: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc6_drop/dropout/my_trt_op_72
2018-10-02 17:56:48.321104: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.321176: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc7_drop/dropout/my_trt_op_73
2018-10-02 17:56:48.364818: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.364933: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc8_drop/dropout/my_trt_op_74
5.28882312775
2018-10-02 17:56:48.856168: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.856186: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.856236: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14
2018-10-02 17:56:48.856259: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16
2018-10-02 17:56:48.856704: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.856732: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15
2018-10-02 17:56:48.856766: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.856798: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17
2018-10-02 17:56:48.879536: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.879587: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc6_drop/dropout/my_trt_op_72
2018-10-02 17:56:48.879916: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.879950: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc7_drop/dropout/my_trt_op_73
2018-10-02 17:56:48.880169: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.880187: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc8_drop/dropout/my_trt_op_74
0.145184993744
2018-10-02 17:56:48.977994: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.978025: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.978059: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14
2018-10-02 17:56:48.978075: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16
2018-10-02 17:56:48.978390: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.978406: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15
2018-10-02 17:56:48.978410: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.978427: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17
2018-10-02 17:56:48.993653: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.993714: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc6_drop/dropout/my_trt_op_72
2018-10-02 17:56:48.993915: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.993939: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc7_drop/dropout/my_trt_op_73
2018-10-02 17:56:48.994105: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:48.994121: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc8_drop/dropout/my_trt_op_74
0.11088013649
2018-10-02 17:56:49.091495: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.091508: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.091550: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14
2018-10-02 17:56:49.091563: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16
2018-10-02 17:56:49.091917: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.091935: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15
2018-10-02 17:56:49.091945: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.091968: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17
2018-10-02 17:56:49.105637: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.105693: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc6_drop/dropout/my_trt_op_72
2018-10-02 17:56:49.105894: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.105917: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc7_drop/dropout/my_trt_op_73
2018-10-02 17:56:49.106113: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.106136: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc8_drop/dropout/my_trt_op_74
0.112968921661
2018-10-02 17:56:49.217640: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.217641: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.217740: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc6_drop/dropout/my_trt_op_14
2018-10-02 17:56:49.217756: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc6_drop/dropout/my_trt_op_16
2018-10-02 17:56:49.218166: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.218185: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/cls_fc7_drop/dropout/my_trt_op_15
2018-10-02 17:56:49.218238: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.218265: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/anchor_predictor/reg_fc7_drop/dropout/my_trt_op_17
2018-10-02 17:56:49.233776: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.233867: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc6_drop/dropout/my_trt_op_72
2018-10-02 17:56:49.234110: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.234136: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc7_drop/dropout/my_trt_op_73
2018-10-02 17:56:49.234388: E tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:314] Input node not found, at TensorRTInputPH_0
2018-10-02 17:56:49.234412: W tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:295] Failed to execute engine, retrying with native segment for import/box_predictor/fc8_drop/dropout/my_trt_op_74
0.12806391716

@aaroey Can you take a quick look when you have a moment?

This seems similar to #21248, which was fixed by #22371. The fix is in master but not in 1.11. I'd like to check whether that fix solves this issue but I'm not sure how to get your model /home/ecli/avod/avod/data/outputs/pyramid_people_with_aug_flexible_batchsize_example/checkpoints/frozen_model.pb. Would you help to pip install --upgrade tf-nightly-gpu and use that to rerun your program for a quick check?
Thanks.

@aaroey Thank you for your help.
After I pip install --upgrade tf-nightly-gpu, the original problem was solved. However, I barely saw any speed gain for FP16.
I tried to convert the model to INT8, and got the following error:
2018-10-04 13:48:44.155956: I tensorflow/contrib/tensorrt/kernels/trt_engine_op.cc:578] Starting calibration thread on device 0, Calibration Resource @ 0x7f3920000b80
python: helpers.cpp:56: nvinfer1::DimsCHW nvinfer1::getCHW(const nvinfer1::Dims&): Assertion `d.nbDims >= 3' failed.
fish: Job 2, “python tf_to_trt.py” terminated by signal SIGABRT (Abort)

Here is part of my source code (modified from https://github.com/tensorflow/tensorflow/blob/master/tensorflow/contrib/tensorrt/test/test_tftrt.py)
        int8_calib_gdef = trt.create_inference_graph(
            input_graph_def=orig_graph,
            outputs=output_node_name,
            max_batch_size=1000,
            max_workspace_size_bytes=1 << 25,
            precision_mode=precision,
            minimum_segment_size=2,
            is_dynamic_op=False,
            maximum_cached_engines=1)
        _ = execute_calibration(int8_calib_gdef)
        return trt.calib_graph_to_infer_graph(int8_calib_gdef)

Similar issues have also been posted on NVIDIA Developer Forum post1 and post2, but it has not be solved yet.
I really appreciate your help. Thanks a ton!

@ChengshuLi by However, I barely saw any speed gain for FP16. are you comparing with TRT FP32?
The error nvinfer1::DimsCHW nvinfer1::getCHW(const nvinfer1::Dims&): Assertion 'd.nbDims >= 3' failed is caused by a known bug in the TRT 4.0 library, and TRT 5.0 should fix the problem.

@ChengshuLi regarding I tried tensorflow-native, FP32 and FP16. All three models seem to have the same inference speed. I think the main reason is that the conversion creates a lot of small TRT engines, most of which contains <=5 nodes and the largest one contains only 30 nodes. TRT prefers large engines so it can optimize it better, so it may be worthwhile to investigate why it is not the case for your graph.
For TRT5, I believed as of today it's still an RC, and TF do not release with RC libraries. We're working on testing TRT5 and once it's final version is released we'll get it into TF ASAP.
Thanks.

Nagging Assignee @aaroey: It has been 14 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @aaroey: It has been 30 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.

Nagging Assignee @aaroey: It has been 60 days with no activity and this issue has an assignee. Please update the label and/or status accordingly.