NUMA Effects

Latency (Sequential)

Latency Per Batch

Inception Latency BS=1 Inception Latency BS=2 Inception Latency BS=4 Inception Latency BS=8 Inception Latency BS=16 Inception Latency BS=32 Inception Latency BS=64 Inception Latency BS=128 Inception Latency BS=256 Inception Latency BS=512 Inception Latency BS=1024

Latency Per Optimization

Inception Latency Opt=Script

Throughput (Sequential)

Throughput Per Batch

Inception Throughput BS=1 Inception Throughput BS=2 Inception Throughput BS=4 Inception Throughput BS=8 Inception Throughput BS=16 Inception Throughput BS=32 Inception Throughput BS=64 Inception Throughput BS=128 Inception Throughput BS=256 Inception Throughput BS=512 Inception Throughput BS=1024

Throughput Per Optimization

Inception Latency Opt=Script

Speedup

Inception Latency Opt=Script

Throughput Per Batch

Inception Throughput per BS

NUMA-Effects

% Latency Degradation HeatMap

Inception Latency Degradation

% Throughput Degradation HeatMap

Inception Latency Degradation

Latency Per Batch

Inception Latency BS=1 Inception Latency BS=2 Inception Latency BS=4 Inception Latency BS=8 Inception Latency BS=16 Inception Latency BS=32 Inception Latency BS=64 Inception Latency BS=128 Inception Latency BS=256 Inception Latency BS=512 Inception Latency BS=1024

% Latency Loss Per Batch

Inception Latency BS=1 Inception Latency BS=2 Inception Latency BS=4 Inception Latency BS=8 Inception Latency BS=16 Inception Latency BS=32 Inception Latency BS=64 Inception Latency BS=128 Inception Latency BS=256 Inception Latency BS=512 Inception Latency BS=1024

Throughput Per Batch

Inception Throughput BS=1 Inception Throughput BS=2 Inception Throughput BS=4 Inception Throughput BS=8 Inception Throughput BS=16 Inception Throughput BS=32 Inception Throughput BS=64 Inception Throughput BS=128 Inception Throughput BS=256 Inception Throughput BS=512 Inception Throughput BS=1024

% Throughput Loss Per Batch

Inception Throughput BS=1 Inception Throughput BS=2 Inception Throughput BS=4 Inception Throughput BS=8 Inception Throughput BS=16 Inception Throughput BS=32 Inception Throughput BS=64 Inception Throughput BS=128 Inception Throughput BS=256 Inception Throughput BS=512 Inception Throughput BS=1024