CPU Offload Time

Problem

Estimate optimizer offload time. Transfer per layer is layer_bytes / (bandwidth_gbps * 1e6) milliseconds. Sequential time repeats transfer + compute every layer; overlapped time repeats max(transfer, compute). Return [sequential_ms, overlapped_ms].

The signature is cpu_offload_time(num_layers, layer_bytes, bandwidth_gbps, compute_ms_per_layer, overlap=True).

Hint

Overlapping the PCIe transfer with compute hides most of the offload cost.

Test cases

case 1

in: [12,100000000,32,1,true]

expected: [49.5,37.5]

case 2

in: [4,100000000,100,5,true]

expected: [24,20]

case 3

in: [2,50000000,50,0,true]

expected: [2,2]

case 4

in: [1,100000000,10,20,false]

expected: [30,30]

Starter codePython

def cpu_offload_time(num_layers, layer_bytes, bandwidth_gbps, compute_ms_per_layer, overlap=True):
    # Your code here
    pass

4 test cases · run your code against them in the editor