
An SEO agency can send a flawless monthly report and still leave the business exactly where it started. Rankings may rise for queries that never produce a serious buyer. Organic sessions can climb because a broad article went viral with students, job seekers, or people outside your market. Even revenue can look persuasive when branded searches, seasonality, or another campaign does the real work.
The question here is about whether the agency can create a credible chain between the work it controls and the business results you need. That chain is what you should inspect before hiring and keep testing throughout the relationship.
Most of them can do SEO, but can they do it while making uncertainty, time, and risk visible?
A Useful Rule - Instead of buying a list of activities, it is suggested to go for a well-reasoned plan to remove a specific discovery constraint, along with a measurement system that will reflect that both sides are working.
1. Define the Business Impact Before Discussing SEO
A productive SEO agency conversation begins with economics and customer behavior. “Grow organic traffic” is more than just a business objective, it can primarily be stated as an intermediate outcome. The real constraint might be too little qualified pipeline, expensive paid acquisition, weak local demand, low category awareness, or poor conversion on high-intent product pages.
Ask the agency to restate the assignment in commercial terms. A credible version sounds like, “Increase qualified discovery among operations leaders evaluating this category, then improve the share of those visits that reach a demo or pricing decision.” That statement is testable. “Publish eight blogs a month” is merely an output commitment.
Write One-Page Impact Definitions
- Target customer and geography
- High-intent problems, questions, and comparison moments
- Desired business action: purchase, qualified lead, booked call, store visit, trial, or assisted sale
- Average value, gross margin, sales-cycle length, and capacity constraints
- What would count as meaningful improvement, and by when
- Conditions the agency does not control, such as product-market fit, sales follow-up, inventory, pricing, or site approvals
If the agency does not ask about these variables, it cannot sensibly prioritize keywords, landing pages, markets, or content.
Google makes the same underlying point in its hiring guidance: an SEO should be interested in what makes the business unique, who its competitors are, how search can help, and how customers find it.
2. Establish a Baseline That Makes Lift Visible
You cannot prove impact against a fuzzy starting point. Capture at least six to twelve months of data when available, so seasonality and one-off campaigns do not masquerade as agency performance. Annotate migrations, promotions, outages, major content launches, tracking changes, and algorithm updates.
Minimum Baseline
- Search Visibility:
- Impressions
- Clicks
- Click-through rate
- Average position
- Branded versus non-branded demand
- Priority query groups
- Traffic Quality:
- Engaged visits
- High-intent
- Landing-page visits
- Revisitors
- Meaningful downstream actions
- Commercial Outcomes:
- Qualified leads
- Purchases
- Revenue
- Pipeline
- Assisted conversions
- Acquisition cost
- Contribution margin
- Technical Health:
- Index coverage
- Crawl barriers
- Page templates
- Core Web Vitals
- Structured data
- Conversion tracking integrity
- Broader Discovery:
- Brand mentions
- Citations
- Appearances in relevant AI answers or social conversations when these surfaces matter to the buying journey
Search Console itself warns that position is complex and can be misleading; its current guidance recommends emphasizing trends in impressions and clicks over position alone. That is why the baseline needs several connected measures rather than one headline KPI.

Figure 1. The evidence chain should connect agency inputs to discovery, qualified action, and commercial outcomes while exposing risk.
3. Test the Diagnosis Before You Buy the Prescription
A proposal that arrives before a real diagnosis is usually a template. The SEO agency may have a repeatable process, but it should still explain why that process fits your site, market, authority, and constraints. Ask for a scoped audit with read-only access first. Google explicitly recommends read-only Search Console access at the audit stage and says the audit should provide realistic estimates of improvement and work required.
What a Useful Diagnosis Contains
- Evidence:
- The data
- Crawl sample
- Query pattern
- Customer insight
- Competitive observation behind each finding
- Consequence:
- How the issue affects discovery
- User decisions
- Conversion
- Operational risk
- Priority: Why this issue should be solved before another one
- Action:
- What will change
- Who owns it
- What dependency could delay it
- Measurement: W
- Which leading signal should move first
- Which business outcome may follow
- Confidence:
- What the agency knows
- What it infers
- What it still needs to test
In a well-executed diagnosis, you can find that SEO is not the first investment. If the site is unable to convert, the offer is unclear, and local capacity is full, and also if the sales team cannot follow up, an honest agency would say it openly. That judgment is itself positive evidence.
4. Inspect the Strategy as a Sequence of Bets
SEO is not a bag of unrelated tasks. The SEO agency should show a sequence: fix blockers, strengthen the pages closest to demand, build missing authority and coverage, improve conversion, and then expand. Each workstream should have a hypothesis.
EXAMPLE HYPOTHESIS
If we consolidate overlapping comparison pages and strengthen the surviving page with original decision criteria, internal links, and clear entity information, then relevant non-branded impressions and qualified visits should rise before the pipeline does. We will judge the bet after enough recrawl and sales-cycle time has passed.
Five Strategy Tests
1. Relevance: Does the plan focus on the questions and decisions your valuable customers actually make?
2. Specificity: Does it name pages, templates, audiences, and technical constraints rather than repeat generic best practices?
3. Prioritization: Does effort follow expected value, confidence, and implementation cost?
4. Integration: Do content, technical SEO, digital PR, UX, analytics, and sales feedback reinforce one another?
5. Adaptability: Does the agency state what evidence would cause it to change course?
5. Use a Measurement Ladder, Not a Vanity Dashboard
Positive impact usually appears in stages. Technical fixes can be verified quickly; discovery and clicks may require recrawling and demand; the pipeline waits for conversion and a sales cycle. Google notes that some search changes can show in days, while others can take several months, so a fixed promise of instant results is not credible.
| Layer | Question | Examples | Interpretation |
| Execution | Was the work completed well? | Fixes shipped; pages improved; briefs approved | Necessary, but not proof of impact |
| Eligibility | Can engines access and understand it? | Indexed URLs; crawl errors; valid markup; page experience | Removes friction and risk |
| Discovery | Are the right people seeing it? | Relevant impressions, non-branded query coverage, and AI citations | Leading evidence of reach |
| Engagement | Does the result earn action? | Clicks, CTR, engaged visits, high-intent page depth | Tests message and intent fit |
| Conversion | Do visitors take meaningful steps? | Qualified leads; purchases; trials; calls | Stronger business evidence |
| Economics | Does value exceed cost and risk? | Revenue; pipeline; margin; CAC; payback | Decision layer for scaling |
For AI search, measurement is developing quickly.
Bing Webmaster Tools introduced citation counts, cited pages, and grounding queries for supported AI experiences in 2026, while cautioning that citation counts do not indicate placement, authority, or the role of a page in an answer. Treat such signals as an additional discovery layer, not a substitute for commercial outcomes.
6. Stress-Test Attribution and ROI Claims
SEO rarely operates alone. A buyer may discover a problem in social content, search a category, read a comparison page, return through a branded query, and convert after email or paid retargeting. Google Analytics defines attribution as assigning credit across the factors on the path to a meaningful action and provides several models because the answer is not inherently simple.
Ask the Agency to Show Its Math
- Which conversions count, and how are they validated as qualified?
- How are branded and non-branded journeys separated?
- How will assisted conversions and long sales cycles be handled?
- What revenue or pipeline values are imported, and who owns their accuracy?
- Which attribution model is used, and how would another model change the conclusion?
- What costs are included: retainer, content, development, tools, internal review time, and digital PR?
- What counterfactual or comparison will you use: prior trend, matched page group, holdout market, or forecast range?
SIMPLE COMMERCIAL TEST
Incremental contribution = incremental conversions x close rate x average contribution per sale. Compare that value with the full program cost and the time to receive it. Use ranges when inputs are uncertain; false precision is not accountability.
7. Examine Reporting Behavior Before the Contract
Request a sample report and run a five-minute test: can an executive understand what changed, why it changed, what it means, and what decision is needed? A dashboard full of green arrows is not insight.
A Strong Monthly Narrative
- Business outcome: What moved in qualified demand, conversion, pipeline, or revenue?
- Diagnostic: Which pages, queries, audiences, and changes explain the movement?
- Work completed: What was shipped, and where can the business verify it?
- Learning: Which hypothesis gained or lost support?
- Risk and dependency: what is blocked, uncertain, or outside the agency’s control?
- Next decision: What will be prioritized, paused, or tested next?
Insist on access to your accounts and an auditable change log. Reporting should distinguish observation from interpretation. It should also disclose data gaps: consent changes, CRM mismatches, cross-device behavior, and modeled conversions can all affect what the numbers mean.
8. Check Execution Quality, Governance, and Risk
An SEO agency can have a sound strategy and still fail through poor execution. Clarify who does the work, who reviews it, and how technical or editorial changes reach production. Ask how the agency handles access, backups, approvals, incident response, and offboarding.
Red Flags That Can Turn SEO Negative
- Guaranteed first-place rankings or a fixed revenue promise without assumptions
- Large-scale link buying, private networks, hidden links, or unexplained “authority placements”
- Keyword-stuffed pages or hundreds of thin location pages
- Content produced at scale without subject-matter review or a reason for each page to exist
- No ownership of analytics setup, conversion definitions, or data quality
- Refusal to show changes, sources, subcontractors, or account access
- A strategy that depends on branded traffic while being presented as new customer acquisition
- Reports that celebrate impressions while qualified actions deteriorate
- No plan for migrations, redirects, removals, or recovery if a tactic causes harm
Google classifies links created primarily to manipulate rankings as link spam and explicitly includes attempts to manipulate generative AI responses within its spam policy scope. Treat opaque link promises as a governance risk, not merely a tactical disagreement.
9. Validate Proof Without Being Dazzled by Case Studies
Case studies are useful when the context is comparable, and the causal story is inspectable. Ask what the starting point was, what actually changed, how long it took, which external factors mattered, and whether the reported outcome was typical. Speak to references about communication, judgment, and reversibility.
Be careful with testimonials that imply guaranteed or typical results. The U.S. Federal Trade Commission says endorsements must reflect honest experience and cannot make deceptive or unsubstantiated claims; atypical results require clear context about what consumers can generally expect.
Questions for a Reference Client
- What did the agency recommend against?
- Did it explain tradeoffs and uncertainty clearly?
- Were changes documented and accounts left under your control?
- How did it respond when results lagged or a hypothesis failed?
- What internal work did your team need to provide?
- Which result persisted after the initial engagement?
10. Run a 90-day Proof Period
Ninety days is often enough to judge the quality of diagnosis, implementation, communication, and early signals. It is not always enough to prove revenue impact. Design the period around evidence the agency can reasonably create.
| Window | What should happen | What to inspect |
| Days 1-30 | Baseline, audit, measurement repair, prioritized roadmap | Depth of diagnosis; access controls; realistic dependencies |
| Days 31-60 | Highest-value fixes and page improvements ship | Implementation quality; change log; early crawl/indexing signals |
| Days 61-90 | First hypothesis review and next-quarter decision | Relevant visibility and engagement trends, blockers, and learning quality |
At day 90, choose one of three paths: scale the work because the evidence chain is strengthening; correct the strategy because execution is sound but assumptions are weak; or exit because the SEO agency cannot create transparency, quality, or learning. Do not extend solely because “SEO takes time.” Time is not a substitute for evidence.
The Final Scorecard
Score each dimension from 1 (weak) to 5 (strong). Weight commercial alignment and integrity more heavily than presentation polish.
| Dimension | Weight | Evidence of quality |
| Business alignment | 15% | Connects the plan to valuable customers, margin, capacity, and sales reality |
| Diagnosis and prioritization | 15% | Uses evidence and sequences work by value, confidence, and effort |
| Dimension | Weight | Evidence of quality |
| Measurement design | 15% | Tracks the full ladder and acknowledges attribution limits |
| Execution quality | 15% | Ships technically sound, useful, and reviewed work |
| Transparency and access | 10% | Provides account ownership, change logs, sources, and clear reasoning |
| Risk and integrity | 15% | Avoids manipulation, guarantees, and unsupported claims |
| Learning velocity | 10% | Tests hypotheses and changes course when evidence changes |
| Broader discoverability | 5% | Considers relevant AI and social discovery without chasing vanity mentions |
| DECISION RULE A high total score is not enough if integrity, access, or measurement receives a 1 or 2. Treat those as stop signs. A partnership cannot create a durable positive impact if the business cannot verify what happened or safely retain the work. | ||
What Positive Impact Looks Like in Practice
The clearest sign is a compounding operating system, and company understands customer questions better-
- Its site become easier to crawl and use
- High-intent pages earn more relevant discovery
- Sales and content teams share feedback
- Brand information stays consistent
- Decisions become less dependent on agency mystique
That impact extends beyond traditional search. Buyers increasingly move between search results, AI-generated answers, communities, and social content before forming a shortlist. The durable asset is not a single ranking but a clear, authoritative, and measurable brand presence across the conversations where customers form intent.
And AirPulse helps brands understand where they are being discovered across AI search and social conversations, where competitors appear instead, and where brand information may be missing or misrepresented. This gives marketing and content teams a clearer view of what to strengthen next. The goal isn’t simply to appear more often, but to understand where your brand is present, how it is represented, and which visibility gaps matter most.
Frequently Asked Questions
How long should an SEO agency take to show results?
You should see evidence of competent diagnosis, measurement, and execution within the first month.
- Crawl
- Indexing
- Visibility
- Commercial Outcomes
All these can take longer and vary by site, competition, demand, and sales cycle. Require dated hypotheses and leading indicators instead of a universal promise.
Should I judge an agency by keyword rankings?
Use rankings diagnostically, not as the final score. Average position can hide query mix, geography, device, result type, and intent. Relevant impressions, clicks, qualified actions, and economics provide a fuller picture.
What is a reasonable SEO ROI target?
There is no credible universal target. Model a range using your contribution margin, close rate, sales cycle, program cost, and the share of conversions plausibly incremental. Compare the result with alternative uses of the same budget.
Can an agency guarantee first-page rankings?
No responsible agency can control a search engine’s results. Google states there are no secrets that automatically rank a site first and advises businesses to find someone else if an audit guarantees first place.
What access should an SEO agency receive?
Begin audits with read-only access. Expand permissions only when the scope requires it, using named accounts, least privilege, documented approvals, and a clear offboarding process. Keep ownership of domains, analytics, Search Console, CMS, and other core accounts.
How should AI search visibility change the evaluation?
Ask whether the agency understands how clear entities, original evidence, useful content, technical accessibility, and consistent brand information support discoverability across search and AI answers. Measure citations or mentions where tools allow, but keep qualified customer actions and business value as the decision layer.
Build discoverability you can verify
An SEO partner should make your growth system more legible, not more mysterious. Define the business constraint, insist on an evidence chain, verify every important change, and judge progress across discovery, qualified action, and economics.
