01The Myth of the Objectively Hard Question
Ask a setter what makes a question difficult and the honest answer is: it depends entirely on who is in the room. A question about the offside rule in football lands differently in a working-men's club in Sheffield than in a wine bar in Shoreditch. A question about Renaissance painting reverses that asymmetry almost perfectly. Neither room is more intelligent than the other; they carry different stores of knowledge, shaped by age, profession, where they grew up, and what they have watched on television for the past forty years.
This is the foundational problem of question-setting, and it is one that no amount of careful crafting fully solves. Setters talk about difficulty as though it were a property of the question — hard, medium, easy — and they have to, because they cannot write a separate set for every room they will ever play it in. But that taxonomy is always provisional. It is an educated guess about what a notional average audience knows, and the notional average audience does not exist.
What exists instead is the specific room: its age profile, its occupation, its cultural formation. A pub in a university town will have at least one table of postgraduates who argue about epistemology for fun. A working-men's club will have tables of men in their sixties who can tell you the B-side of every charting single from 1967 without blinking. A craft-beer bar will skew young enough that anything before about 1990 reads as history rather than memory. Each room has asymmetric knowledge: deep in some areas, startlingly thin in others, and the setter who does not account for that will produce a night that feels either condescending or punishing.
02Reading the Room Before the First Question
Experienced setters — and more crucially, experienced hosts — read a room in the first ten minutes. They look at the age spread around the tables. They listen to the ambient conversation. They notice whether teams are large or small, rowdy or focused, whether anyone is taking notes on a phone. This information feeds directly into real-time calibration: the host adjusts the pace at which they reveal answers, lingers on a question the room is visibly wrestling with, skips briskly past the ones that were too easy.
A good host also reads the answer sheets when they come in. If nine of ten teams get the same question wrong and write the same wrong answer, that question was badly set — or it was pitched at the wrong room. If nine of ten teams get a question right, it was not a question at all, just a formality. The ideal is a question where about half the room gets it right: enough that someone at every table feels the pleasure of knowing, not so many that nobody earns the point. That fifty-percent mark, though, is not fixed in the question; it shifts with the room.
This is why setters who write for many different venues tend to build sets with deliberate variation in topic rather than uniform variation in difficulty. A round that swings from sport to science to film to geography does something subtler than a round that simply escalates. It redistributes which tables are strong and which are struggling, and it ensures that over the course of an evening no team is locked out entirely. The subject is doing some of the work that difficulty alone cannot do.
03Why Local Knowledge Defeats the Setter
The most reliable way to miscalibrate a room is to underestimate local knowledge. A question about a local football club, a well-known local landmark, or a regional event will be answered instantly and effortlessly by everyone in the room — and will tell you nothing except that you did not think carefully about where you were. Local knowledge is not general knowledge, and conflating them is a setter's error, not a virtue of the audience.
The inverse trap is equally common: writing a set calibrated for a well-educated metropolitan audience, then playing it in a room with a different formation. This is not about intelligence but about reference points. A question that depends on familiarity with a particular television drama, a type of cuisine, or a cultural institution that is common in one demographic and absent in another produces frustration rather than sport. The teams who do not know are not failing to think; they were simply never in the room where that knowledge circulates.
The sharpest setters account for this by holding certain categories of question to a higher standard of universality. A question needs to be answerable, in principle, by someone who has had no particular advantages of education or geography. That is a constraint, and it rules out a great deal of material that setters find genuinely interesting. This is part of why good material often gets thrown away — not because the fact is wrong or the phrasing is poor, but because the question only works for some rooms.
04Calibrating Over Time
Regular setters for a fixed venue develop something close to a statistical model of their audience, even if they would never describe it that way. They remember what the room knew last month and the month before. They notice which topics produce animated discussion at the answer-reveal and which produce silence. Over time they learn that their particular room is strong on classic rock, weak on cricket, surprisingly good on science but hopeless on literature written before 1950.
This accumulated knowledge is genuine expertise, and it cannot be transferred wholesale to a new venue. A setter who has spent three years calibrating perfectly for one pub will need several outings at a new one before their difficulty judgements are reliable again. The questions have not changed. The room has.
That is, in the end, the only workable definition of a well-pitched question: not that it is objectively at the right level, but that it produced the right response from the specific audience it faced. A question that half the room gets right, leaves the other half feeling they were close, and makes everyone want to know the answer — that question worked. Whether it would work anywhere else is a separate question, and the answer is almost certainly: not everywhere. Difficulty is not a fixed property of the question. It is a relationship between the question and the room it plays in, and every room is different.
Absolute Trivia is an independent publication about how quiz questions are written. It is not a quiz service, question bank, or league.