How to Choose Which Experiment to Run First
How to Select an Experiment
A self-funded independent scientist shares a practical method for ranking experiment ideas. List all experiments, score them on factors like cost, feasibility, interestingness, uncertainty, moral expected value, and contrarian potential, then average the scores. LLMs can now handle much of the ranking work, especially cost estimation. The approach is a preliminary prototype, but it beats guessing when many ideas seem equally promising.
Experiments that have the potential to disprove a well-known dogma or paradigm always feel strong.