Inventos dashboard: share of voice across AI models
← Stories

Brand intelligence

What AI models say about a brand, measured

Client
Product, built by Endal
Industry
Marketing and brands
Service
Generative engine optimization
Runs on
Python service, React front end, frontier models
Status
Live product

The problem

When a customer asks ChatGPT or Claude about a brand, the answer shapes the decision, and nobody was measuring it. Brand visibility was measured in search results and ad impressions only.

What we built

Inventos: prompt sets derived from a brand's real Google Ads keyword data, run against frontier models, with every claim, sentiment and recommendation extracted, scored for impact, traced to its source, and aggregated into a share-of-voice measurement.

Before LLMs you could not read what a model says about your brand at scale, every answer is generated per prompt and varies by phrasing, so coverage required hand-written question lists and manual reading; deriving prompts from real Google Ads keywords and using a model to extract structured claims made hundreds of prompts per run measurable.

How it works, step by step

Google Ads keyword export
source
Google Ads API / keyword report CSV
Real paid-search demand terms per brand
Brand & competitor registry
source · assumed
Operator-entered brand config
Brand, aliases, competitor set
Claude Sonnet
Expand keyword clusters into realistic buyer-intent prompts
Guardrail: Prompts constrained to templated families; generated set stored and versioned so runs are reproducible
Claude Sonnet
Extract claims, factual assertions, sentiment and recommendations from each completion
Guardrail: Strict JSON schema via Pydantic; claim discarded if no verbatim span in source completion
Claude Sonnet
Score each claim for impact and attribute it to its originating response span
Guardrail: Deterministic string match confirms the cited span exists; unmatched claims flagged for analyst review

What a run produces

Claim ledger excerpt with share-of-voice rollup (illustrative). Values illustrative; the shape is real.

Prompt intentModelExtracted claimSentimentImpact
"best CRM for small teams"ClaudeBrand recommended as easiest to set upPositiveHigh
"best CRM for small teams"ChatGPTCompetitor A listed first; brand not mentionedAbsentHigh
"<brand> pricing"ChatGPTStates pricing starts at a tier the brand no longer offersNegative / inaccurateHigh
"<brand> vs Competitor B"ClaudeDescribes brand as stronger on integrationsPositiveMedium

What it did not do

  • Measures what models say in response to generated prompts; it does not prove why a model says it or guarantee coverage of real user phrasing
  • LLM outputs are non-deterministic and change as vendors update models, so share-of-voice is a point-in-time measurement, not a stable metric
  • Claim extraction and impact scoring are model-generated and need analyst review; factual accuracy of a claim about the brand is judged by humans, not verified against an external source of truth

How it was measured

  • Human spot-check of extracted claims against source completions, measuring precision (claims that exist in the text) and source-trace correctness
  • Repeat-run variance: same prompt set re-executed across models to measure how stable share-of-voice is under LLM non-determinism
  • Analyst override rate in the review console on impact scores and sentiment labels, tracked per prompt family

Built and shipped by the same team you would talk to

Have a workflow like this one?

Thirty minutes. We map where it is stuck and what a first build looks like.

Book a free AI audit
The desktop agent driving Tableau, from the recorded session

Next story · Desktop agents

Reliable computer use through compound actions

Open