My First Foray Into Judging

My homebrew club, Square Kegs, hosted our second annual Winterbrew competition back in the end of January. Jeremy and I had the awesome opportunity to work with the member of our club organizing the competition on a lot of the behind the scenes logistics and to actually judge a couple of flights as we're both taking a BJCP study course currently.

My experience with competitions up to this point had been simple: go online, fill out a form, send / drop off some beer, get a scoresheet back, read said scoresheet and go "hmm, ok. I guess that guy [loved my beer and has the best palate ever! || hated my beer because he doesn't know shit!] (Optionally pat myself on the back for a good score or good feedback.)

This year was really different. There is a ton of work that goes on behind the scenes and ahead of time to prepare. Beer needs to be cellared and cataloged for easy retrieval by the stewards. The flights need to be well organized by category for the judges. Little things like the type of plastic cup, mechanical pencils instead of wood and lighting all matter. From the outside it seems like it'd be a rocking good time : hundreds of beers to try and the judges just "have" to power their way through them in a few hours. Cue mental image of a bunch of beer geeks having a party. Not so. It's a serious, well-organized, highly focused endeavor.

Now The biggest insights I gained were into the actual process of judging. I had a preconceived notion which was largely blown away by reality. Firstly, it's highly subjective and hence really difficult. As a judge, you have about 15 minutes to taste each beer. You taste about 8-10 beers per flight. The beers vary in style, either just a bit for a large, popular category like IPA or immensely for wide-open categories like specialty or vegetable, herb and spice.

I think it's different for really experienced judges who have really calibrated their palates, but as a novice I was evaluating a beer against a written description of what it should be. No matter how elegantly written the BJCP styles are, it's still tough to translate written words into a sensory experience.

This might also change with experience, but I was pretty surprised by the varying sensitivity to different flavors, aromas and off-flavors. I am pretty sensitive to acetaldehyde, but apparently I can't detect diacetyl if it's smacking me in nose.

Finally, I was very surprised at how collaborative the judging process actually is. Often times if there's a wide spread in scores, the judges will discuss the beer and come to an agreement. The goal is to get scores within a somewhat narrow range, but one judge usually adjusts theirs up or down to get there. So the initial feedback about a beer might not really match up to the score it ended up with.

I came away with a whole new respect for the process and a few considerations for entering competitions:

• If I enter a Belgian, it will not have overwhelming hot alcohol or phenolic (band-aid, hot-dog, nasty) notes. Belgian Styles ≠ I'll just let this ferment however hot it wants too and call it a Belgian!
• If I enter a spice beer, I'll use a tincture or some other controlled means of adding the space after the beer is done fermenting. Or I'll split the batch and blend it back. Far too many of the beers I tasted had massive, overwhelming spice character.
• I'll be really careful about categorization and specifying the base category on anything specialty. It's really hard to judge a beer if you have absolutely no idea what it is...

First Medal!

Jeremy and have entered beers in two competitions so far this year. (We also helped to run one that our club, Square Kegs, put on. That's another post.)

That's a medal all right. More nerdy photos on instagram

We entered a handful of beers in both and won our first official medal! It's definitely a proud moment, particularly given the size of the Drunk Monk Challenge competition this year (806 entries) and the size of the Porter Category (29). We brewed the Robust Porter recipe out of Brewing Classic Styles and took third place with a score of 34.

Interestingly, we also entered the same beer in our Winterbrew competition and scored a 32.5 a month ago. The judges notes were all generally aligned, but I was particularly impressed by the feedback from a master judge who picked out the one major process flaw in the beer. We brewed on December 1st here in Chicago and ended up mashing at 151F instead of our target of 154F. (It gets cold here. We use coolers and a single infusion. For now.)

Empirically, we're getting better as brewers. The beers we entered in competition last year averaged high twenties with one outlier in the high thirties. This year, we're averaging mid-thirties.

Here's a recap of our entries and scores:

Winterbrew 2013:

Munich Helles: 34
Robust Porter: 32.5
Rye Pale Ale: 32
Russian Imperial Stout: 32.3

Drunk Monk: 

Robust Porter: 34
Russian Imperial Stout: 24
* I'm fairly certain that we mis-categorized the stout by not entering it as a wood-aged beer. It was in a 5 gallon whiskey barrel for a month and interestingly enough, won a club competition which coincided with Goose Island's Quest for the Imperial Goose.