MediumCalculusca-279

Swish Derivative Vector

Problem

The swish activation is f(z) = z * sigmoid(z), whose derivative is sigmoid(z) + z * sigmoid(z) * (1 - sigmoid(z)) = sigmoid(z) * (1 + z * (1 - sigmoid(z))).

Return the derivative at each given value.

Hint

Apply the product rule to z times sigmoid(z).

Test cases

case 1

in: [[0,1,-1]]

expected: [0.5,0.9276705118714867,0.07232948812851325]

case 2

in: [[2,-2]]

expected: [1.0907842487848955,-0.09078424878489547]

case 3

in: [[0.5,3]]

expected: [0.7399611873026518,1.0881041060151695]

Starter codePython

def swish_derivative(values):
    # Your code here
    pass

3 test cases · run your code against them in the editor