Episodic Novelty Count

Problem

Count how often a state was visited in the current episode and derive a novelty bonus.

Return [count, 1 / (1 + count)], where count is the number of occurrences of state in visits.

Hint

The count resets every episode, so novelty returns after a reset.

case 1

in: [["s0","s1","s0"],"s0"]

expected: [2,0.3333333333333333]

case 2

in: [[],"s0"]

expected: [0,1]

case 3

in: [["a"],"b"]

expected: [0,1]

case 4

in: [["x","x","x","x"],"x"]

expected: [4,0.2]

Starter codePython

def episodic_novelty_count(visits, state):
    # Your code here
    pass

4 test cases · run your code against them in the editor