Latency

Latency Per Batch

ResNet Latency BS=1 ResNet Latency BS=8 ResNet Latency BS=16 ResNet Latency BS=32

Latency Per Optimization

ResNet Latency Opt=None ResNet Latency Opt=Script

Throughput

Throughput Per Batch

ResNet Throughput BS=1 ResNet Throughput BS=8 ResNet Throughput BS=16 ResNet Throughput BS=32

Throughput Per Optimization

ResNet Latency Opt=None ResNet Latency Opt=Script

Speedup

ResNet Latency Opt=None ResNet Latency Opt=Script