Latency

Latency Per Batch

Inception Latency BS=1 Inception Latency BS=8 Inception Latency BS=16 Inception Latency BS=32

Latency Per Optimization

Inception Latency Opt=None Inception Latency Opt=Script

Throughput

Throughput Per Batch

Inception Throughput BS=1 Inception Throughput BS=8 Inception Throughput BS=16 Inception Throughput BS=32

Throughput Per Optimization

Inception Latency Opt=None Inception Latency Opt=Script

Speedup

Inception Latency Opt=None Inception Latency Opt=Script