Suggested variation, which I’d expect to lead to better results: use raw “completion probabilities” for different answers.E.g. with prompt “Will Russia invade Ukrainian territory in 2022?” extract completion likelihoods of the next few tokes “Yes” and “No”. Normalize
man you just blew my mind, will give it a try next time I feel an urge to play around with GPT!
Suggested variation, which I’d expect to lead to better results: use raw “completion probabilities” for different answers.
E.g. with prompt “Will Russia invade Ukrainian territory in 2022?” extract completion likelihoods of the next few tokes “Yes” and “No”. Normalize
man you just blew my mind, will give it a try next time I feel an urge to play around with GPT!