Latency (Sequential)

Latency Per Batch

ResNet Latency BS=1 ResNet Latency BS=2 ResNet Latency BS=3 ResNet Latency BS=4 ResNet Latency BS=5 ResNet Latency BS=6 ResNet Latency BS=7 ResNet Latency BS=8 ResNet Latency BS=9 ResNet Latency BS=10 ResNet Latency BS=11 ResNet Latency BS=12 ResNet Latency BS=13 ResNet Latency BS=14 ResNet Latency BS=15 ResNet Latency BS=16 ResNet Latency BS=17 ResNet Latency BS=18 ResNet Latency BS=19 ResNet Latency BS=20 ResNet Latency BS=21 ResNet Latency BS=22 ResNet Latency BS=23 ResNet Latency BS=24 ResNet Latency BS=25 ResNet Latency BS=26 ResNet Latency BS=27 ResNet Latency BS=28 ResNet Latency BS=29 ResNet Latency BS=30 ResNet Latency BS=31 ResNet Latency BS=32 ResNet Latency BS=64 ResNet Latency BS=128 ResNet Latency BS=256 ResNet Latency BS=512 ResNet Latency BS=1024

Latency Per Optimization

ResNet Latency Opt=Script

Throughput (Sequential)

Throughput Per Batch

ResNet Throughput BS=1 ResNet Throughput BS=2 ResNet Throughput BS=3 ResNet Throughput BS=4 ResNet Throughput BS=5 ResNet Throughput BS=6 ResNet Throughput BS=7 ResNet Throughput BS=8 ResNet Throughput BS=9 ResNet Throughput BS=10 ResNet Throughput BS=11 ResNet Throughput BS=12 ResNet Throughput BS=13 ResNet Throughput BS=14 ResNet Throughput BS=15 ResNet Throughput BS=16 ResNet Throughput BS=17 ResNet Throughput BS=18 ResNet Throughput BS=19 ResNet Throughput BS=20 ResNet Throughput BS=21 ResNet Throughput BS=22 ResNet Throughput BS=23 ResNet Throughput BS=24 ResNet Throughput BS=25 ResNet Throughput BS=26 ResNet Throughput BS=27 ResNet Throughput BS=28 ResNet Throughput BS=29 ResNet Throughput BS=30 ResNet Throughput BS=31 ResNet Throughput BS=32 ResNet Throughput BS=64 ResNet Throughput BS=128 ResNet Throughput BS=256 ResNet Throughput BS=512 ResNet Throughput BS=1024

Throughput Per Optimization

ResNet Throughput Opt=Script

Speedup

ResNet Throoughput Opt=Script

Throughput Per Batch

ResNet Throughput per BS