I would imagine a sensible model has goodness persisting in expectation but asymptotically approaching 0. That seems both reasonably intuitive and to lead to some helpful guidance once you have such a model.
The question of what the relative decay rate for different classes of action is then becomes paramount—if you can identify actions with low expected decay rates, you have a phenomenally important class of actions. Extinction events are perhaps the example in which we can have highest confidence in a low decay rate, but highest confidence in a low decay rate doesn’t necessarily = highest expected decay rate (this is maybe another way of thinking about trajectory change).
I would imagine a sensible model has goodness persisting in expectation but asymptotically approaching 0. That seems both reasonably intuitive and to lead to some helpful guidance once you have such a model.
The question of what the relative decay rate for different classes of action is then becomes paramount—if you can identify actions with low expected decay rates, you have a phenomenally important class of actions. Extinction events are perhaps the example in which we can have highest confidence in a low decay rate, but highest confidence in a low decay rate doesn’t necessarily = highest expected decay rate (this is maybe another way of thinking about trajectory change).