From www.undeceivingourselves.org
(800 words 2 graphics)
By a panel of wine-loving skeptics doing their bit for Western Australia In 2006 we tested the claim that magnets transform cheap plonk into a
fuller, better tasting wine. Yes, the claim could revolutionise the WA
wine industry, but we failed to confirm it, see our report Each tester could choose one or more pairs of numbered plastic cups. One cup contained about 20 ml of ordinary wine, the other contained the same amount of the same wine poured past magnets. Their order had been determined in advance using computer-generated random numbers. Could our testers, working alone or in pairs, tell which was which? Most testers managed 2-3 pairs of cups over 15-20 minutes, and the result was a total of 24 judgements. Not a huge number but about twice the average per wine of our previous tests, and much easier to analyse than the previous challenging combination of 4 wines x 4 magnet conditions.
As a control, the testers had to make the same judgements but without wine. They had to imagine taking two cups and deciding which one had the superior flavour. The result was 144 judgements, from which 120 sets of 24 judgements were sampled at random and compared with the 24 correct identities. Here 120 was chosen arbitrarily as a compromise between too few sets, say 10, and too many sets, say 1000, when compared with the 144 judgements being sampled. The result was a total of 120 comparisons, which in effect (much to the distress of true wine lovers but with conspicuous approval from our treasurer) provided 120 replications without using any wine. It also accommodated any response sets, where people (being human) like to answer A rather than B, or B rather than A. In this case the testers preferred B for 71% of the 24 actual judgements and 54% of the 144 imaginary judgements, both statistically significant at p<0.05, even though the occurrence of A and B in the correct identifiers was exactly the same.
In each test the probability of picking the magnetised wine purely by chance is 50%. In 24 tests the binomial significance level of getting 14 hits or more purely by chance is p = 0.27, which is a long way from being even marginally significant. Compared with the 16+4+5+4+1 = 30 imaginary replications that had the same score or more, the significance level is 30/120 = 0.25, or much the same. So although the results are in the right direction, they provide no significant support for the hypothesis that pouring cheap plonk past magnets improves its flavour. Our previous depressing failure has so far been confirmed. Clearly, more research is needed with many more tests, many more testers, and (obviously) many more wines. The WA wine industry has never needed our help more than now. Wineries in other states are welcome to bid for our services. It will be tiring and demanding work but someone has to do it. Stay tuned! From www.undeceivingourselves.org
(800 words 2 graphics) |