On this page
Learning objectives
- Turn an audience belief into a falsifiable creative hypothesis
- Generate bounded variants with known constants and source assets
- Separate creative approval from campaign activation and budget authority
- Record concept-level learning with uncertainty and a next-test decision
Before you start
- • A defined audience, campaign objective, and conversion event
- • Approved brand rules, claims, source assets, and platform access
Working definition
Creative and performance
AI-assisted creative operations produce controlled variations around explicit audience, message, format, proof, and offer hypotheses. A useful system knows which variables changed, where each claim and asset came from, who approved the output, and what decision the test will support. Asset volume without experimental structure creates review load rather than insight.
Models make it cheap to create near-duplicates. If each asset changes copy, image, offer, and audience together, the result cannot explain which idea deserves another test.
Platform approval is not the same as brand, legal, or factual approval. The workflow must apply the organization's own standards before activation.
Creative provenance matters when generated or edited media enters production. Rights, disclosure, source material, and modification history need a record even when technical credentials are unavailable.
The learning unit is the concept and its hypothesis. Click-through rate alone cannot establish profit, incrementality, or long-term brand effect.
Field situation
Hearthside Pantry subscription test
Named synthetic scenario. Hearthside Pantry is fictional and no media, revenue, or conversion result is claimed.
- Owner
- You are the performance creative lead preparing a small paid-social test for a pantry-staple subscription.
- Decision
- Choose which message concept deserves a follow-up test based on predefined evidence, without giving the generation workflow control of spend.
- Starting state
- The team routinely asks a model for twenty ad ideas, selects favorites, and launches several at once. Asset sources are stored in personal folders, offer wording varies, and the review sheet records only approved or rejected.
- Expected outcome
- A six-cell test matrix, approved assets, provenance log, decision rule, results sheet, and next-test recommendation.
Constraints
- • The test has two message hypotheses and six final variants
- • Price, delivery promise, audience, conversion event, and budget allocation stay constant
- • No synthetic testimonial, health claim, or undocumented product image is allowed
- • A person must approve creative and another authorized person must activate media
Worked example
Testing convenience against planning confidence
Evidence status: Named synthetic scenarioHearthside compares two hypotheses: households respond to fewer emergency grocery trips, or they respond to knowing staple costs in advance. Each hypothesis receives three executions using the same placement, product set, offer, audience, and conversion event. Copy may use only claims in the approved product sheet.
The team locks a matrix before generation, supplies licensed product photos, and requires every output to return hypothesis ID, changed variable, claim IDs, asset IDs, disclosure note, and prohibited-element check. Reviewers approve factual accuracy, brand fit, rights, accessibility, and platform policy. Activation occurs in a separate role. The decision sheet records delivery, cost, conversion quality, and uncertainty, then proposes one next test.
The worked artifact makes the test interpretable and keeps generation separate from spending authority. It intentionally includes no winner or numerical result. In practice, insufficient delivery or tracking error may lead to a no-decision result.
Limits
The scenario is synthetic. A small platform test may be affected by auction dynamics, optimization, audience overlap, novelty, attribution windows, or chance. C2PA provenance can carry useful assertions when supported but does not prove that a claim is true or that an asset is lawful.
Method
Build it, with checkpoints
Field situation
Choose which message concept deserves a follow-up test based on predefined evidence, without giving the generation workflow control of spend.
- 01Write hypotheses before assets
- 02Assemble the generation packet
- 03Generate and select bounded variants
Acceptance checks
A reproducible creative test in which every variant has a purpose and an evidence trail. The report should help a future team choose what to test next without granting a generative system budget authority.
- 01
Write hypotheses before assets
For each concept, state the audience belief, evidence or insight behind it, expected behavior, and what result would weaken the idea. Identify variables that must remain fixed.
CHECKPOINT · Each hypothesis could be rejected, and the matrix shows exactly one intended conceptual difference between the two groups.
- 02
Assemble the generation packet
Provide approved claims, prohibited language, source assets, visual constraints, accessibility rules, platform format, and output schema. Require IDs in every generated record.
CHECKPOINT · A reviewer can trace every factual statement and visual input without searching a personal prompt history.
- 03
Generate and select bounded variants
Produce candidates within the matrix, remove duplicates, and select three executions per hypothesis. Record meaningful rejections and the rule they violated.
CHECKPOINT · Six final assets remain; each has one hypothesis ID, a declared changed element, and no unsupported claim or asset.
- 04
Review, package, and activate safely
Run brand, fact, rights, disclosure, accessibility, destination, and platform checks. Export an approval packet. Only the authorized media operator may activate against the approved budget and conversion event.
CHECKPOINT · The generation system has no credential capable of publishing or modifying spend, and all final checks are signed or timestamped.
- 05
Read results and store learning
Check delivery balance and tracking before comparing performance. Record primary measure, conversion quality, guardrails, uncertainty, confounders, and a no-decision outcome when needed.
CHECKPOINT · The report states advance, revise, stop, or no decision and proposes one controlled next test with a reason.
Hands-on lab
Run a governed six-variant creative test
Use Hearthside or one low-risk campaign. If live spend is unavailable, complete the full preflight and use a documented dry run rather than inventing results.
Prepare
- • Approve the audience, offer, product facts, conversion event, and maximum spend outside the generation workflow
- • Collect source assets with owner, license, consent, and modification status
- • Choose the person who reviews creative and the separate person authorized to activate it
Deliverable
Two message hypotheses, six reviewed executions, a complete provenance and approval log, a precommitted decision rule, and a results or dry-run report.
Starter kit: Creative experiment matrix
Copyable CSV header and decision rulevariant_id,hypothesis_id,audience,placement,format,constant_offer,changed_element,claim_ids,asset_ids,generation_method,disclosure_required,brand_review,fact_review,rights_review,policy_review,activation_owner,spend_cap,launch_status,delivery,qualified_conversion,cost,notes
PRECOMMITTED DECISION
Minimum usable delivery: [insert]
Primary decision measure: [insert]
Guardrails: complaints / policy issues / low-quality conversions / brand incidents
No-decision conditions: tracking failure, uneven delivery, policy intervention, insufficient sample
Next test rule: advance one concept only when primary evidence clears the threshold and no guardrail fails.Expected result
A reproducible creative test in which every variant has a purpose and an evidence trail. The report should help a future team choose what to test next without granting a generative system budget authority.
Carry forward
Store concept IDs, rejected outputs, reviewer reasons, and test decisions for the measurement module. Keep any approved audience insight in the customer evidence ledger.
Acceptance checks
- 01Exactly two hypotheses and six final variants are represented in the matrix
- 02Audience, offer, conversion event, placement assumptions, and budget treatment are documented as constants
- 03Every claim and source asset resolves to an approved ID with rights or consent status
- 04Brand, factual, rights, policy, accessibility, and destination reviews are observable
- 05Activation credentials are separated from generation and creative review
- 06The report supports a no-decision outcome and records confounders
What breaks
Failure clinic
F1A winning asset offers no useful direction for the next campaign.
- Inspect
- Compare the two cells for simultaneous changes in message, visual, offer, audience, and format.
- Likely cause
- The team generated variety rather than controlled hypotheses.
- Repair
- Rewrite the matrix, lock constants, and rerun a narrower comparison.
- Prevent next time
- Require hypothesis and changed-variable fields before creative generation.
F2An ad contains a plausible product or customer claim that cannot be substantiated.
- Inspect
- Follow claim IDs to the approved fact sheet, testimonial consent, and current destination page.
- Likely cause
- The model filled a persuasive gap using patterns from general marketing language.
- Repair
- Pause the asset, remove the statement, correct affected variants, and review any live exposure.
- Prevent next time
- Generate only from an allowlist of approved claims and block missing claim IDs.
F3The team cannot establish where an image came from or whether it may be used.
- Inspect
- Check asset ID, creator or generator, license, consent, source file, edit history, and export metadata.
- Likely cause
- Images were copied from a prompt session into production without an asset record.
- Repair
- Remove the asset until rights are confirmed and rebuild it from approved inputs.
- Prevent next time
- Require provenance and rights fields before an asset enters creative review.
F4The model or automation launches an unapproved variant or changes spend.
- Inspect
- Review credentials, API scopes, workflow branches, approval events, and platform change history.
- Likely cause
- Generation, approval, activation, and budget authority shared one execution identity.
- Repair
- Disable the workflow, revoke credentials, reconcile platform changes, and restore role separation.
- Prevent next time
- Use least-privilege accounts and a hard approval gate before every external side effect.
Beyond the demo
Production boundary
- 01The hypothesis, changed variable, constants, and rejection condition are prewritten
- 02Claims come from a current approved fact set and resolve through stable IDs
- 03Assets record source, rights, consent, generation or editing method, and disclosure needs
- 04Brand, legal, factual, accessibility, platform, and destination checks are complete
- 05Generation and selection roles cannot activate media or alter spend
- 06Tracking, attribution window, conversion quality, and delivery balance are verified
- 07Spend caps, pause rules, incident owner, and rollback steps are tested
- 08Concept learning and uncertainty are stored independently of individual asset metrics
Evidence status
Sources and claim limits
Sources support the named claims; they do not guarantee the same result in another system.
- [1]Google Ads policiesad policy · misrepresentation · destination requirements
Google · Official documentation · 2026-08-20
- [2]Advertising Standardsad claims · restricted content · creative review
Meta Transparency Center · Official documentation · 2026-08-20
- [3]C2PA Technical Specificationcontent provenance · asset assertions · credential limits
Coalition for Content Provenance and Authenticity · Official documentation · 2026-08-20
- [4]Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profilerisk ownership · measurement · human oversight
NIST · Official documentation · 2026-08-20
- [5]Structured Outputs guideschema contracts · output validation · refusal handling
OpenAI · Official documentation · 2026-08-20
Related Tenten resources