Latency

Latency Per Batch

Bert Latency BS=1 Bert Latency BS=2 Bert Latency BS=4 Bert Latency BS=8 Bert Latency BS=16 Bert Latency BS=32 Bert Latency BS=64 Bert Latency BS=128

Throughput

Throughput Per Batch

Bert Throughput BS=1 Bert Throughput BS=2 Bert Throughput BS=4 Bert Throughput BS=8 Bert Throughput BS=16 Bert Throughput BS=32 Bert Throughput BS=64 Bert Throughput BS=128

Throughput Per Allocator

(Allocator = default)

Bert Throughput per BS

(Allocator = tcmalloc)

Bert Throughput per BS