Findings from the work.
Every post here states a number we produced ourselves and names the file it came from, so you can check the working rather than take our word for it. Posts without a number of their own do not get written.
- Research - AI search measurement
The tooling that measures AI search cannot see a local business
A metric sold as AI search volume returned 0 for every local commercial term we put to it, including one where our own stored transcripts show two of four engines naming the business by name. The zero is a fact about the instrument, not about the market.
Macdara Ó MurchúAEOMeasurement validityKeyword data - Research - LLM evaluation
A same-vendor judge cannot grade its own family's work
Two judges from different model families agreed on 91% of items, and scored a hybrid question bank within 0.04 of the production one on a 3-point scale. The gap that decided it was citation quality, not correctness.
Macdara Ó MurchúLLM-as-judgeEvaluationModel selection
Have something to build?
Tell us what you are working on. We reply within a day, in plain language, with a clear next step.
Perth, Western Australia