Continuous Batching Utilization

Problem

Simulate a continuous batching scheduler and measure slot utilization. One request arrives per step starting at step 0; each step admits waiting requests up to max_slots, then every active request consumes one step of its service_steps. Return total_request_steps / (max_slots * total_steps).

The signature is continuous_batching_utilization(num_requests, service_steps, max_slots).

Hint

Utilization drops when requests finish faster than new ones arrive to fill the slots.

Test cases

case 1

in: [4,2,2]

expected: 1

case 2

in: [3,1,2]

expected: 0.75

case 3

in: [1,5,4]

expected: 0.25

case 4

in: [6,2,3]

expected: 1

case 5

in: [5,3,4]

expected: 0.625

Starter codePython

def continuous_batching_utilization(num_requests, service_steps, max_slots):
    # Your code here
    pass

5 test cases · run your code against them in the editor