06.01Specialist and Advanced AnalysisAvailable

Conjoint and MaxDiff Analysis

Estimate trade-off models properly, read utilities and importance correctly, and stop a simulated share becoming a market forecast.

Free. Works on Claude, ChatGPT, Gemini or any assistant that accepts a skill file.

What this skill does

The method, encoded.

Trade-off studies are the most powerful preference tool in commercial research and the most over-read. Utilities get compared across attributes when they sit on separate scales. Importance is quoted as a property of the attribute when it is a property of the levels the designer happened to test. A share of preference reaches a board with a currency sign attached. And designs that could never have carried the question, because prohibitions gutted them or respondents stopped reading at task nine, get analysed anyway because the data exists.

This skill supplies the design audit that comes before estimation, the correct reading of every output, and the language that keeps a simulation inside its evidence. It covers level balance, the number-of-levels artefact, prohibitions and efficiency, and respondent-fatigue diagnostics. It covers estimation choices from aggregate logit to latent class to hierarchical Bayes and what each buys. It covers the independence of irrelevant alternatives, why plain logit simulation misleads on line extensions, and what to use instead. It covers MaxDiff scoring and the hard limit that scores are relative to the list supplied, so everything on it can be important or nothing can.

It produces a design audit, a utility and importance table with ranges attached, a validated simulator and bounded reporting lines.

Best used for

  • Estimating part-worths and deriving attribute importance from choice data
  • Building and correctly bounding a preference simulator
  • Assessing which features earn their cost in a specification
  • Portfolio and line-extension simulation with cannibalisation read properly
  • Ranking long lists of messages or features with MaxDiff
  • Auditing a trade-off study run by someone else before its conclusions are acted on
  • Explaining why a conjoint cannot answer the question being asked of it

Typical inputs

What you give it.

Full design specification (attributes, levels in shown wording, tasks, alternatives, prohibitions, None wording), Respondent-level design and choice data showing what each person saw and chose, Base description and sample definition, Exact attribute and level wording shown to respondents, Holdout tasks not used in estimation (optional), Competitive frame and current market shares (optional), Cost data by level (optional), Segment membership or profiling variables (optional)

Typical outputs

What you get back.

Design sheet and design audit with a verdict per precondition, Respondent quality diagnostics and a logged exclusion decision, Part-worth utility table with the scale convention stated, Derived importance table with the tested level range on every row, Holdout validity statement with hit rate against chance and naive benchmarks, Share-of-preference simulation with competitive set, rule and base-case validation, Sensitivity curves bounded to the tested range, MaxDiff scores with the relativity statement and list spread, Bounded reporting lines separating in-experiment results from market claims

Method coverage

What the skill works through.

  1. What a trade-off model actually measures
  2. Auditing the design before you trust any estimate
  3. Level balance, prohibitions and design efficiency
  4. Task count, cognitive load and respondent fatigue
  5. Respondent quality diagnostics and exclusion decisions
  6. Aggregate, latent class and hierarchical Bayes estimation
  7. Reading part-worth utilities without the three common errors
  8. Why importance depends on the levels you chose
  9. Holdout tasks and what a hit rate is worth
  10. Building a simulator base case that survives a reality check
  11. The IIA problem and the red bus, blue bus case
  12. Sensitivity curves instead of single share numbers
  13. MaxDiff scores are relative, not absolute
  14. What a share of preference is not

Download

Free skill. One file.

Enter your email once. Every skill you download after that takes a single click.

How to install

Add the skill file and the five kernel protocols to a Claude Project, a ChatGPT Project, a Gemini Gem, or paste them at the top of any assistant conversation. Then give it your real research material, not a description of it.

Download skill

Questions

Common questions.

Is share of preference the same as market share?

No, and the difference is the most consequential misreading in the technique. A share of preference is the proportion of modelled choices going to each alternative in a set you defined, from an exercise where people chose between hypothetical profiles with full attention on the attributes shown. Real market share depends on awareness, distribution, sales effort, promotion, habit, switching costs and competitor response, none of which the model has seen. A simulated share can be a legitimate input to a forecast alongside those factors. It is not a forecast.

Why does attribute importance change when I change the levels?

Because derived importance is calculated from the range between an attribute's best and worst levels, divided by the sum of ranges across attributes. Test price from 100 to 120 and price looks unimportant. Test it from 100 to 300 and it dominates. Nothing about the market changed. This is why importance should never be reported without the range it was derived from in the same line, and why two correctly analysed studies of the same category can disagree completely.

Can I compare utilities between attributes?

No. Part-worths are typically zero-centred within each attribute on an arbitrary interval scale, so a value of 40 on colour and 40 on price have no common meaning. Only differences within an attribute are interpretable. Comparing across respondents also requires rescaling, because the scale factor absorbs how consistently a person chose rather than how strongly they preferred.

What is the red bus, blue bus problem?

It is the practical consequence of the independence of irrelevant alternatives property in logit simulation. The rule assumes the ratio of shares between two alternatives is unaffected by what else is in the set. Add a near-duplicate of an existing product and the rule splits share proportionally across everything, so the two near-identical items together gain share that in reality they would take almost entirely from each other. This makes plain logit actively misleading for line extensions and portfolio questions, which are exactly the questions clients ask most. Use a rule that handles similarity, such as randomised first choice.

What do MaxDiff scores actually tell me?

The relative order and distance of the items on the list you supplied, and nothing more. Everything on the list can be critically important or entirely trivial, and the scores look the same either way, because the exercise never asked whether any item mattered in absolute terms. If you need an absolute reading, it has to come from an anchored design fielded alongside. A low-scoring item is less preferred than the others present, not unimportant.

How many attributes and tasks can a conjoint carry?

There is no fixed number, but complexity is roughly attributes times levels times alternatives times tasks, and beyond a moderate load respondents simplify: they narrow attention to one or two attributes and ignore the rest. That biases derived importance toward whatever is easiest to process, usually price and brand. Diagnose it by estimating importance on early tasks and late tasks separately and comparing. A study with four attributes that matter beats one with nine, of which five were added for completeness.

How do I know whether a conjoint model is any good?

Fit to the data it was estimated on is not evidence of prediction. Field holdout tasks, keep them out of estimation, and report the hit rate against two benchmarks: the chance rate given the number of alternatives, and a naive rule such as always choosing the cheapest. Also report the aggregate share prediction error on the holdouts, which matters more than the hit rate when the output is a share. Where no holdouts exist, say predictive validity was not assessed.

Can a conjoint tell me what price to charge?

It can tell you how choice moves across the price range you tested, relative to the alternatives you showed, which is genuinely useful. It cannot tell you demand at a price in absolute terms, because it never observed a purchase and never presented the whole market. Read the sensitivity curve for where the response is flat and where it is steep, never extrapolate beyond the tested range, and treat any willingness-to-pay figure as stated preference with all the limits that carries.

Should I remove respondents who always chose the cheapest option?

Usually not, and the decision needs evidence. Non-trading on price is often genuine behaviour rather than inattention, and removing those respondents can move derived price importance substantially, which means the exclusion is not a cleaning decision but an analytical one. Check their response times and individual fit statistics first. Speeders whose choices are indistinguishable from random are a different case. Whatever you decide, log the criterion, the count and the effect on the headline numbers.

Can AI analyse a conjoint reliably?

It can run the estimation and the simulation consistently, which is a real advantage over hand-built spreadsheets. The specific risks are producing a utility table when no level wording was ever supplied, simulating configurations containing levels outside the tested range, running a line extension under a plain logit rule without flagging what that does, quoting importance without its range, and moving the not-a-forecast caveat to the appendix where nobody reads it. Require the design sheet before any estimate, a range check on every simulated profile, and the caveat on the same page as the number.

Research where people already are.
Analyse it where you already work.

Yazi helps researchers conduct surveys, AI interviews and longitudinal research directly through WhatsApp.

New Report on SA Gambling Impact
Check It Out