Using emotion recognition (say by image recognition) to find out consumer’s preferences
Measuring Pavlov’s dog saliva
Debate in ancient greek
Factored cognition
forecasting
karma on the forum / reddit
democratic voting
Stock prices as an evaluation of a companies value
Bibliometrics. Impact factor.
Using written recommendations to evaluate candidates.
Measuring truth-telling using a polygraph
Justice system evaluation of how bad crimes are based on previous cases
Justice system use of a Jury
Lottery—random evaluation
Measuring dopamine signals as a proxy to a fly’s brain valence (which is an evaluation of its situation)
throw stuff into a neural net
python eval
Discrete Valuation Rings
Signaling value using jewels.
Evaluation based on social class
fight to the death
torturing people until they confess
market price
A mathematical exam
A high-school history exam
An ADHD test
Stress testing a phone by putting it in extreme situations
checking if a car is safe by using a crash dummy and checking impact force
Software testing
Open source as a signal of “someone had looked into me and I’m still fine”
Colonoscopy
number of downloads for an app
running polls
running stuff by experts
asking god what she thinks of it
The choice of a pope
Public consensus, 50 years down the line
RCT
broad population study
Nobel prize committee
Testing purity of chemical ingredients
Testing problems in chip manufacturing
Reproduce a study/project and see if the results replicate
Set quantitative criteria in advance, and check the results after the fact
ask people what they’d think that the results would be in advance, and ask people to evaluate the results afterward. Focus the evaluation on the parameters which the people before the test did not consider
Adequacy analysis (like in Inadequate Equilibria)
a flagging system for moderators
New York Times Best Seller list
subjective evaluation
subjective evaluation when on drugs
subjective evaluation by psychopaths (which are also perfect utilitarians!)
subjective evaluation by a color choosing octopus
Managerial decisions (a 15-minute powerpoint presentation and then an arbitrary decision)
Share-holder reports
bottleneck/limiting-factor analysis
Crucial considerations
Theory of Change model
Taking a set amount of time to critically analyze the subject, focusing on trying to find as many downsides.
Using weights and a two-sided scale to measure goods.
Setting a benchmark that one only evaluates against.
A referee evaluating a Boxing match
Using score for football
Buying a car—getting the information from the seller and assessing their truthfullness
Looking at a fancy report and judging based on length, images, and businessy words
peer review in science
citations count
journal status
grant making—assessing requests, say by scoring according to a fixed scoring template
evaluating a scoring template by comparing similarity of different people’s scoring of the same text
Code review
Fact-Checking
Editor going through a text
360 peer feedback—sociometry
gut intuition after long relationship/experience
Amazon Reviews
ELO
Chess engine position assessment
Theoretical assessment of a chess position—experts explaining what is good or bad about the position
Running a tournament starting with this position, evaluating based on success percentage
multiple choice exam
political lobbying for or against something
the grandma test
It was fun! Hope that something here might be helpful :)
Babble!
Psychological evaluation
Job interview
Debate competition judge
Using emotion recognition (say by image recognition) to find out consumer’s preferences
Measuring Pavlov’s dog saliva
Debate in ancient greek
Factored cognition
forecasting
karma on the forum / reddit
democratic voting
Stock prices as an evaluation of a companies value
Bibliometrics. Impact factor.
Using written recommendations to evaluate candidates.
Measuring truth-telling using a polygraph
Justice system evaluation of how bad crimes are based on previous cases
Justice system use of a Jury
Lottery—random evaluation
Measuring dopamine signals as a proxy to a fly’s brain valence (which is an evaluation of its situation)
throw stuff into a neural net
python eval
Discrete Valuation Rings
Signaling value using jewels.
Evaluation based on social class
fight to the death
torturing people until they confess
market price
A mathematical exam
A high-school history exam
An ADHD test
Stress testing a phone by putting it in extreme situations
checking if a car is safe by using a crash dummy and checking impact force
Software testing
Open source as a signal of “someone had looked into me and I’m still fine”
Colonoscopy
number of downloads for an app
running polls
running stuff by experts
asking god what she thinks of it
The choice of a pope
Public consensus, 50 years down the line
RCT
broad population study
Nobel prize committee
Testing purity of chemical ingredients
Testing problems in chip manufacturing
Reproduce a study/project and see if the results replicate
Set quantitative criteria in advance, and check the results after the fact
ask people what they’d think that the results would be in advance, and ask people to evaluate the results afterward. Focus the evaluation on the parameters which the people before the test did not consider
Adequacy analysis (like in Inadequate Equilibria)
a flagging system for moderators
New York Times Best Seller list
subjective evaluation
subjective evaluation when on drugs
subjective evaluation by psychopaths (which are also perfect utilitarians!)
subjective evaluation by a color choosing octopus
Managerial decisions (a 15-minute powerpoint presentation and then an arbitrary decision)
Share-holder reports
bottleneck/limiting-factor analysis
Crucial considerations
Theory of Change model
Taking a set amount of time to critically analyze the subject, focusing on trying to find as many downsides.
Using weights and a two-sided scale to measure goods.
Setting a benchmark that one only evaluates against.
A referee evaluating a Boxing match
Using score for football
Buying a car—getting the information from the seller and assessing their truthfullness
Looking at a fancy report and judging based on length, images, and businessy words
peer review in science
citations count
journal status
grant making—assessing requests, say by scoring according to a fixed scoring template
evaluating a scoring template by comparing similarity of different people’s scoring of the same text
Code review
Fact-Checking
Editor going through a text
360 peer feedback—sociometry
gut intuition after long relationship/experience
Amazon Reviews
ELO
Chess engine position assessment
Theoretical assessment of a chess position—experts explaining what is good or bad about the position
Running a tournament starting with this position, evaluating based on success percentage
multiple choice exam
political lobbying for or against something
the grandma test
It was fun! Hope that something here might be helpful :)