
How reliable are wine judges? When I saw the headline, I assumed the worst. Newspapers like The Daily Mail like nothing more than printing stories about professionals who canât blind taste the difference between a classed growth claret and a cheap Chilean Merlot. Why spend ÂŁ100, they snigger, when the stuff that sells for ÂŁ5.99 tastes just as good to âso-called expertsâ?
But this piece was different. For a start, it appeared in the excellent German trade magazine, Meiningerâs Wine Business International, rather than a net curtain-twitching tabloid. And it also came to a very different conclusion, one that underscored the value of experience and expertise and questioned the idea that blind tastings are random, scattergun exercises.
The article was about Christian Wolf, the tasting director of Mundus Vini, one of Europeâs largest wine competitions. You could say that he has an interest in promoting the usefulness of blind tastings â they pay his salary, after all – and, while weâre about it, I should declare an interest as a co-chair of the International Wine Challenge. But Wolfâs findings were still interesting.
His novel idea was to divide his judges into eight groups and make them taste together â separate tables of men, women, Germans, older and younger judges, sommeliers, wine writers and members of the wine trade (importers, retailers and producers, I assume). He doubled up on flights and individual wines to see if the groups came to different conclusions about the same entries. They didnât. Most of the time, the scores were âvery closeâ, apparently. âOverall,â he said, âit was interesting to see that the higher the professionalism of the people you are inviting, the less important is their age, sex, origin or professionâ.
The one thing that groups disagreed about was Brettanomyces, but not in the way you might imagine. I assumed that older judges, raised on the idea that Aussie Shiraz could legitimately pong of sweaty saddles and that âgreat Burgundy smells of shitâ would be more indulgent towards the fault. But the opposite was true. They were more critical than the younger tasters. Perhaps the natural wine movement has made the latter more accepting of a bit of funk.
Wolf ascribed the close correlation on most wines to the âmodified version of the OIV systemâ that Mundus Vini employs. This, he claimed, was âthe key to consistent resultsâ. I strongly beg to differ here. Modified or not, the OIV system is a joke, a pointless exercise in form filling that detracts from the meaningful analysis of wine. Like several other prominent international judges, I refuse to participate in any competition that uses it. Sorry, Mundus Vini.
Iâd argue that the results were a tribute to the quality of the judges rather than the OIV system. We all know that thereâs a large degree of subjectivity about wine â one personâs sumptuous, full-bodied 16.5% red is anotherâs overblown rocket fuel â but I find that experienced judges generally agree on a wineâs merits or shortcomings, even if itâs something that they wouldnât choose to drink themselves. Incidentally, thatâs why discussion â something that the original OIV system actively discourages â is so important among panel members.
No one is born a great taster. Some people have a natural aptitude for it â Oz Clarke is the best example I know â but you donât learn to taste well without putting in what Malcolm Gladwell in his book Outliers called the requisite 10,000 hours of practice. To do so, you need a thick skin, determination, stamina and the ability to listen and learn from people who know more than you do. One of the greatest things about the wine business is its generosity of spirit.
Many people donât regard wine tasting as a serious profession. A friend of mine calls it âthe most unjob-like job in the worldâ and she has a point. No one would deny that swirling, sniffing, gargling and spitting is a lot more fun than working in an Amazon warehouse or an abattoir. But itâs still a job that requires dedication, patience, knowledge and the acquisition of a few knocks along the way. Just ask the seven new Masters of Wine who were admitted to the Institute last week, all of whom would have put in plenty of hours at the tasting bench.
The next time you read an article in The Daily Mail laughing at wine judges and deriding our expertise, throw it in the bin. All tasters make mistakes, but more often than not the good ones reward the right wines.