Category: SEO

  • Google Search Console: The Complete 2026 Guide

    Google Search Console: The Complete 2026 Guide

    Google Search Console is one of the most useful free SEO tools available, yet many businesses set it up and rarely check it. It provides direct insights from Google about what content is indexed, indexing errors, search queries, and technical issues on your site.

    While paid SEO tools estimate data, Search Console reports real figures. When an estimate conflicts with Search Console data, trust Search Console because it comes straight from Google.

    Here’s how to set it up properly, which reports actually matter, and what to check each month.

    TL;DR

    Google Search Console tracks how Google crawls, indexes, and ranks your site, including queries, clicks, coverage, technical errors, Core Web Vitals, manual actions, and structured data. Setting up a Domain property captures all subdomains and protocols. Focus primarily on three reports: Performance (queries and rankings), Pages (indexed content and errors), and URL Inspection (page-level details). Data begins accumulating from your verification date, so set it up early.

    → Book a free audit

    What is Google Search Console?

    Google Search Console is a free service showing how your site performs in Google Search. It tracks impressions, clicks, search queries, indexed URLs, and technical issues. It delivers direct first-party data rather than third-party estimates.

    Keep in mind that it is not an analytics tool. It measures performance in Google Search rather than visitor behavior after landing on your site. Use Search Console for search insights alongside GA4 for on-site behavior.

    How do I set up Search Console?

    Set up a Domain property instead of a URL-prefix property, verify it through DNS, and submit your XML sitemap. Because data starts accumulating on the day you verify and doesn’t backfill history, set it up as soon as possible.

    The steps:

    1. Add a property. Choose Domain (e.g., optiseon.com) rather than URL prefix. A Domain property covers http/https, www/non-www, and all subdomains in one place. URL-prefix properties silently miss traffic on variants you forgot to add.
    2. Verify by DNS by adding the TXT record provided by Google into your domain’s DNS settings. Domain properties require this method.
    3. Submit your XML sitemap under Indexing → Sitemaps.
    4. Set up users if more than one person needs access.
    5. Link GA4 under Settings, which surfaces some Search Console data inside Analytics.

    Verification backfills up to a few days of data at most. Everything else starts now, which is the single best argument for setting it up today rather than when a problem appears.

    Which Search Console reports actually matter?

    Three key reports carry most of the workload: Performance, Pages (index coverage), and URL Inspection. Other reports serve mainly as periodic spot checks.

    ReportWhat it answersHow often to check
    PerformanceWhat queries and pages drive clicksWeekly
    PagesWhat’s indexed, what isn’t, and whyMonthly
    URL InspectionWhy is this specific page not workingAs needed
    SitemapsIs Google reading your sitemapAfter changes
    Core Web VitalsReal-user performanceMonthly
    Manual ActionsHas Google penalized youMonthly
    Security IssuesHacked or malicious contentMonthly
    LinksWho links to you, internally and externallyQuarterly
    Crawl Stats (Settings)How much and how fast Google crawlsQuarterly

    How do I use the Performance report?

    The Performance report tracks queries, pages, countries, devices, and search appearance, along with metrics like clicks, impressions, CTR, and average position. It’s best for finding pages that get impressions or rank near page one but lack clicks.

    The filters worth learning:

    • Position 5–20, sorted by impressions. These are pages close to a breakthrough. Small improvements move them onto page one, which is far cheaper than building a new ranking.
    • High impressions, low CTR. If a page ranks well but gets few clicks, rewrite the title and meta description. You can test formatting using our meta generator.
    • Queries you didn’t target. Google often ranks pages for terms you never considered. If a page gets impressions for something relevant you don’t cover properly, that’s a content opportunity.
    • Compare date ranges. Period-over-period comparisons help spot traffic declines early, as explained in our article Why Did My Organic Traffic Drop?.
    • Branded vs non-branded. Filter query contains / doesn’t contain your brand name. Non-branded growth is the real measure of SEO progress.

    One caveat worth knowing: Search Console’s query data is sampled and filtered, and long-tail queries with very low volume are often omitted entirely. The totals are reliable; the query list is incomplete.

    How do I use the Pages report?

    The Pages report categorizes URLs as indexed or not indexed and gives explicit reasons for exclusions. This information offers actionable diagnostic data directly from Google.

    Detailed exclusion explanations can be found in our guide Why Isn’t My Page Indexed?. In short, “Crawled – currently not indexed” usually indicates a content quality issue, while “Discovered – currently not indexed” points to crawl prioritization, and references to canonicals, noindex, or robots.txt stem from site configuration.

    During monthly reviews, check that indexed page counts remain steady, monitor any sudden spikes in exclusions, and look into unindexed pages that should be ranking. Note that some exclusions, such as deliberate noindex tags on archive pages, are normal.

    What about Core Web Vitals and the other reports?

    Core Web Vitals in Search Console uses real-user field data, which Google factors into ranking results. Review these metrics monthly to catch performance drops following site updates.

    The rest, briefly:

    • Manual Actions (check monthly). Ideally, this report is clear. If Google has applied a penalty, the specific issue will be detailed here.
    • Security Issues (check monthly). Security issues like malware or hacked content quickly harm rankings.
    • Links — a sample of internal and external links Google has found. Useful for spotting orphan patterns and seeing which pages attract links.
    • Crawl Stats in Settings. Tracks crawl volume, response times, and status codes. Helpful for finding server errors and managing crawl budgets on larger websites.
    • Sitemaps — confirm Google is reading it and check for parse errors after structural changes.

    To inspect technical details further, check our free SEO tools, including the on-page checker for page elements and the redirect checker for status codes.

    What are Search Console’s limits?

    Keep these practical limitations in mind:

    • Google only. Nothing about Bing (use Bing Webmaster Tools) and nothing about AI assistants.
    • No AI crawler data. Search Console does not track GPTBot or ClaudeBot activity. You can inspect those using server logs or our AI Crawler Log Analyzer.
    • Sampled and filtered query data. Low-volume queries are often omitted.
    • 16 months of history, so export if you need longer baselines.
    • Reporting lag of a day or more.
    • Approximate index counts rather than exact.

    The AI gap is the one that matters most going into 2027. Search Console remains the best view of Google, but it’s an increasingly partial view of search overall.

    A monthly Search Console routine

    Fifteen minutes, monthly:

    1. Performance period-over-period: Are clicks and impressions growing?
    2. Non-branded queries: Is non-branded search traffic increasing?
    3. Position 5–20 by impressions: Are there quick wins to optimize?
    4. Pages report: Is the indexed count steady? Are there any unexpected exclusion trends?
    5. Manual Actions and Security: Are both sections clean?
    6. Core Web Vitals: Have any performance issues appeared recently?

    That routine catches most problems before they become traffic drops.

    Frequently Asked Questions

    Is Google Search Console free? 

    Yes, it is entirely free to use with no hidden tiers or usage limits. It requires a Google account and site ownership verification. It provides direct performance data straight from Google.

    What’s the difference between Search Console and Google Analytics? 

    Search Console measures your presence in Google Search — impressions, clicks, rankings, indexation, and crawl health. Analytics measures what people do on your site after arriving, from any source. They report different things and their numbers will not match; you need both.

    Should I use a Domain property or URL prefix? 

    Domain, in almost all cases. It covers http and https, www and non-www, and all subdomains in a single property, so you don’t miss traffic on a variant you forgot to add. It requires DNS verification, which takes a bit more effort but is worth it.

    Why does Search Console show different numbers than Google Analytics? 

    Because they measure different things at different points. Search Console counts impressions and clicks at the search results page; Analytics counts sessions after a page loads. Clicks that bounce before the tag fires, ad blockers, consent settings and bot filtering all create gaps. Both can be right simultaneously.

    How far back does Search Console data go?

    Search Console retains 16 months of data. If you need longer historical trends for comparison, plan to export your data regularly. Data begins collecting from the time of verification.

    Does Search Console show AI search traffic? 

    No. It reports Google Search only, and doesn’t break out AI Overview appearances as a distinct channel or report AI crawler activity. For AI crawling you need server logs; for AI referral traffic you need GA4 source filtering. Our guide to measuring AI search traffic covers the full approach.

    Set up your property and review it regularly. If you want help analyzing your Search Console setup, book a free audit with OptiSEOn, an SEO, AEO, GEO, and LLM optimization agency based in Dallas.

  • Why Isn’t My Page Indexed? A Diagnostic Guide (and a Free Bulk Checker)

    Why Isn’t My Page Indexed? A Diagnostic Guide (and a Free Bulk Checker)

    Everything in SEO assumes something basic that almost nobody checks: whether Google has actually indexed the page. If it hasn’t, your title tags, schema, backlinks, and content quality don’t matter. The page cannot rank because, as far as Google is concerned, it simply doesn’t exist.

    Indexation problems are quiet. There’s no error message and no notification. A page sits in your sitemap, looks perfectly normal in a browser, and simply never appears in search. On larger sites it’s routine to find hundreds of pages in this state, and most site owners have never looked.

    Our free Bulk Index Checker lets you paste up to 100 URLs and see which are indexed in one pass. This post covers how to read the result and work through the causes in order.

    TL;DR

    A page can’t rank if it isn’t indexed, and indexation failures are usually caused by one of six things: blocked crawling, a noindex directive, a canonical pointing elsewhere, thin or duplicate content, poor internal linking, or simply not having been crawled yet. Check status in bulk with the free Bulk Index Checker or page-by-page in Google Search Console, then address the causes in order, starting with the easiest and most reversible ones first.

    → Check up to 100 URLs at once

    What’s the difference between crawling and indexing?

    Crawling is Google fetching your page; indexing is Google deciding to store it and make it eligible to rank. A page can be crawled and still not indexed, which is the most common and most frequently misread situation. The distinction matters because the fixes are completely different.

    • Not crawled — Google hasn’t fetched the page yet. This is usually an access, discovery, or crawl-budget problem.
    • Crawled, not indexed — Google fetched the page but chose not to store it. This is typically a judgment about quality, duplication, or overall value.
    • Indexed — The page is stored and eligible to rank.

    That middle state is the one that confuses people. “Crawled – currently not indexed” in Search Console is not a bug and not a technical error. It’s Google saying the page didn’t seem worth keeping. No amount of resubmitting fixes it; the page itself has to become worth indexing.

    How do I check whether a page is indexed?

    Three ways: run the URLs through a bulk index checker, use the URL Inspection tool in Google Search Console for a single page, or search site:yourdomain.com/page-url for a rough signal. Search Console is authoritative; bulk tools are faster when you’re checking many pages.

    The practical workflow:

    1. Bulk-check the set — Paste up to 100 URLs into the Bulk Index Checker to find which ones are missing.
    2. Inspect the failures individually in Search Console’s URL Inspection tool to see Google’s specific reason.
    3. Group the failures by reason and fix the underlying patterns rather than working one page at a time.

    A note on the site: operator: it’s a quick sanity check, not a reliable measurement. Results are approximate and the operator behaves inconsistently. Treat an absence as a prompt to check properly, not as proof.

    Cause 1: Google can’t crawl the page

    Check robots.txt and server responses first: if crawling is blocked, nothing downstream matters. This is the fastest thing to rule out and the most problematic when it happens to be the cause.

    What to look for:

    • robots.txt disallow rules blocking the path, often a leftover from staging
    • Non-200 status codes — A page returning 404, 410, or 500 won’t be indexed. Check status codes in bulk with our Redirect & HTTP Status Checker.
    • Login or paywall gating the content
    • Server errors or timeouts during crawl windows (review Search Console’s Crawl Stats report)
    • Content requiring JavaScript to render. Google can render JS, but it is slower and less reliable than plain HTML. AI crawlers also largely skip JS execution, as discussed in our AI crawler post.

    Cause 2: A noindex directive

    Check for a noindex meta tag or X-Robots-Tag header. An explicit noindex is the most common reason a crawlable page stays out of the index. It is also easy to miss because the page looks completely fine in a browser.

    Where noindex hides:

    • The WordPress “Discourage search engines” setting (Settings → Reading), routinely left on after launch
    • SEO plugin defaults applied to a post type, category or tag archive
    • Staging configuration shipped to production
    • X-Robots-Tag HTTP headers set at the server or CDN, invisible in page source

    That last one catches people out. If the HTML has no noindex but the page still won’t index, check the response headers.

    Cause 3: A canonical pointing somewhere else

    If a page canonicals to a different URL, Google treats that other URL as the authoritative version and omits this page from the index. This is working as intended, so the real problem is usually an incorrect canonical tag.

    Common cases: a template bug canonicalising every page to the homepage, pagination canonicalising to page one, parameter URLs canonicalising to a version that no longer exists, or a canonical left pointing at a staging domain after migration.

    Search Console reports this as “Duplicate, Google chose different canonical than user” or “Alternate page with proper canonical tag.” The second is usually fine. The first means Google disagreed with you, which is worth investigating.

    Cause 4: Thin, duplicate or low-value content

    The “Crawled – currently not indexed” status usually means Google decided the page wasn’t worth storing. This often happens because content is thin, near-duplicate, or doesn’t add value beyond existing indexed pages. In short, it is a content issue formatted as a technical status.

    The pattern we see most often in audits:

    • Templated pages at scale — Location or service pages that only swap out a city or service name. These are viewed as doorway pages, and search algorithms enforce quality standards strictly on them.
    • Thin tag and category archives with no unique content
    • Near-duplicate product variants
    • Auto-generated or lightly edited bulk content (covered further in Should You Use AI to Write Your Content?)

    The fix isn’t resubmitting the page. It requires consolidation, clear differentiation, or removal, following the framework outlined in Content Refresh & Pruning.

    Cause 5: The page is orphaned or buried

    Pages without internal links pointing to them are hard to discover and receive no internal authority. This makes Google slower to find them and less inclined to index them. Sitemaps help, but sitemap inclusion alone is not a strong indexing signal.

    Fix by linking to the page from relevant existing content, keeping it within about three clicks of the homepage, and making sure it sits inside a logical section rather than floating. The full approach is in Internal Linking & Site Architecture.

    Cause 6: It just hasn’t been crawled yet

    New pages on sites with lower domain authority can take days or weeks to get indexed, which is standard behavior rather than a technical failure. Before troubleshooting, check when the page was published.

    To speed things up, submit the URL via Search Console’s URL Inspection tool, confirm it appears in your XML sitemap, link to it from frequently crawled pages, and share it on active channels to drive initial traffic. Note that these steps improve discovery, but they do not guarantee indexing if Google decides the content lacks value.

    To speed it up: submit the URL in Search Console’s URL Inspection, make sure it’s in your XML sitemap, link to it from pages that get crawled often, and share it somewhere that generates genuine traffic. None of these guarantee indexing — they improve discovery, not the quality judgement.

    A diagnostic table

    Search Console statusWhat it meansFirst action
    Discovered – currently not indexedKnown but not crawledCheck crawl budget, internal links, server speed
    Crawled – currently not indexedCrawled, judged not worth indexingImprove or consolidate the content
    Excluded by noindex tagExplicit directiveRemove the noindex
    Blocked by robots.txtCrawling blockedFix robots.txt
    Duplicate, Google chose different canonicalGoogle disagreed with your canonicalCheck for near-duplicates
    Page with redirectURL redirects elsewhereExpected — index the destination
    Soft 404Looks empty or error-likeAdd real content or return a proper 404

    What not to do

    • Don’t mass-resubmit URLs. Resubmission doesn’t change a quality judgement, and there are daily limits.
    • Don’t buy indexing services. They mostly submit URLs you can submit yourself, and they don’t fix why Google skipped the page in the first place.
    • Don’t assume every page should be indexed. Thin archives, internal search results and parameter URLs are often better left out. A smaller, higher-quality index is usually better.
    • Don’t panic about a few unindexed pages. Some non-indexation is normal and healthy.

    Frequently Asked Questions

    Why is my page crawled but not indexed? 

    Google fetched the page and decided it was not worth storing, usually because it is thin, near-duplicate, or adds little value beyond what is already indexed. Since this is a quality assessment rather than a technical bug, simply resubmitting the URL will not help. The content needs to be expanded with unique insights or consolidated into another page.

    How long does Google take to index a new page? 

    Anywhere from hours to several weeks, depending on your site’s authority, crawl frequency and internal linking. Established sites with frequent publishing often see indexing within a day; new or low-authority sites routinely wait weeks. Submitting in Search Console and linking internally both help discovery.

    How do I check if my pages are indexed in bulk? 

    Paste up to 100 URLs into a bulk index checker like OptiSEOn’s free tool to see which are missing, then inspect the failures individually in Google Search Console for Google’s own stated reason.

    Does submitting a URL in Search Console guarantee indexing? 

    No. Submitting a URL requests a crawl, but it does not force Google to index it. If Google crawls the page and finds low value, it will still leave it unindexed. Requesting indexing aids discovery, not quality evaluation.

    Should all of my pages be indexed? 

    No. Thin tag archives, internal search results, parameter URLs and paginated series often shouldn’t be. A focused index of genuinely valuable pages tends to perform better than a bloated one, so deliberate exclusions are a sign of good hygiene rather than a problem.

    Can a page be indexed and still get no traffic? 

    Yes, and it’s common. Indexing makes a page eligible to rank; it doesn’t mean it ranks well or that anyone searches for what it covers. If indexed pages get no impressions, the issue is keyword targeting or competitiveness rather than indexation.


    Find out which of your pages are actually indexed. Check up to 100 URLs for free. If a large portion is missing, there is usually a systematic issue behind it. Book a free audit and we will help you fix it.

  • Are AI Bots Actually Crawling Your Site? Your Server Logs Know

    Are AI Bots Actually Crawling Your Site? Your Server Logs Know

    There’s a gap in how almost everyone approaches AI search visibility, and it’s a strange one: we spend enormous effort trying to get cited by ChatGPT, Perplexity and Gemini without ever checking whether their crawlers have visited the site.

    robots.txt tells you what you asked bots to do, but it says nothing about what they actually did. A site can allow every AI crawler and receive almost no AI crawling. A site can block GPTBot and find Bytespider crawling straight through anyway. The only way to know is to check your server logs. Because logs are awkward to work with, hardly anyone checks them.

    Our free AI Crawler Log Analyzer exists for that: upload a server log and see GPTBot, ClaudeBot, PerplexityBot, Google-Extended and the rest, with hits over time. As far as we can tell nobody else offers this free, which is odd, because it’s the only way to replace guesswork with evidence.

    TL;DR

    Server logs are the only reliable record of which AI crawlers actually visited your site, how often, and which pages they fetched. robots.txt only records your instructions, and analytics doesn’t capture bots at all. Upload a log to the free AI Crawler Log Analyzer to see real activity by user agent over time. Two findings consistently matter: AI crawlers fetch JavaScript but generally don’t execute it, and a meaningful share of requests claiming to be AI bots are spoofed.

    → Upload a log and see your AI crawler activity

    Why can’t I just check robots.txt or analytics?

    Because robots.txt is a request, not a record, and analytics tools deliberately filter out bots — neither one can tell you whether GPTBot visited your site yesterday. Logs are the only source that captures every request, including the ones no JavaScript tag ever fires on.

    Here is what each of the three sources can actually tell you:

    SourceTells youCan’t tell you
    robots.txtWhat you asked bots to doWhether they did it
    Analytics (GA4)Human sessions, some AI referralsBot crawling — bots don’t run JS tags
    Server / CDN logsEvery request, by user agent, with timestampsWhether a crawl led to a citation

    Our free robots.txt AI Crawler Checker handles the first column. It parses your rules the way engines actually resolve them, including the named-group precedence most checkers get wrong. The log analyzer handles the third column. They work as a natural pair: one shows intent, while the other shows reality.

    Which AI crawlers should I look for?

    The crawlers that matter in 2026 split into training crawlers, search indexers and real-time fetchers. The distinction determines whether a visit can ever send you traffic. Blocking the wrong category costs you citations, while allowing the wrong one feeds training models with no return.

    User agentOperatorPurpose
    GPTBotOpenAITraining
    OAI-SearchBotOpenAISearch indexing
    ChatGPT-UserOpenAIReal-time fetch for a user
    ClaudeBotAnthropicTraining
    Claude-SearchBotAnthropicSearch indexing (newer)
    Claude-UserAnthropicReal-time fetch
    PerplexityBotPerplexitySearch indexing
    Perplexity-UserPerplexityReal-time fetch
    Google-ExtendedGoogleGemini training/grounding
    meta-externalagentMetaTraining
    BytespiderByteDanceTraining
    CCBotCommon CrawlOpen training dataset

    A real-time fetch from ChatGPT-User or Perplexity-User is the most interesting line in your log: it means a human asked a question and the assistant went to your page to answer it. That’s a citation in progress.

    What is the crawl-to-refer ratio, and should I care?

    The crawl-to-refer ratio compares how many pages an AI operator crawls against how many visits it sends back. Across 2026, published figures have been extraordinarily volatile, which is precisely why your own data matters more than any industry average.

    Reported ratios for Anthropic’s crawlers across 2026 have ranged from roughly 988:1 to well over 30,000:1 depending on the source, the month and the measurement window. OpenAI’s have similarly swung between the low hundreds and well over a thousand. Google’s traditional search sits around 5:1 by comparison.

    (Those ranges come from Cloudflare Radar-derived reporting and several independent log studies published through 2026. It is worth re-checking these against current sources before quoting specific figures because they move fast.)

    We’re not going to lead with a dramatic single number, because any one of them would be out of date within weeks and would misrepresent how much the picture varies. The genuinely useful conclusions are structural and stable:

    • Training crawlers return almost nothing. They exist to harvest, not to refer.
    • Search and user-action bots do return traffic. They’re a different proposition entirely.
    • The spread between operators is enormous, so a blanket “allow AI bots” or “block AI bots” policy is a blunt instrument.
    • Your own ratio is calculable and is the only number that describes your site.

    To compute yours: count AI bot requests by user agent in your logs over 30 days, then divide by the referral sessions your analytics attributes to each matching platform over the same window. The methodology for the referral side is in how to measure AI search traffic.

    What should I actually look for in the log?

    Look for five main metrics: which AI bots visit, how often they visit, which pages they fetch, which pages they ignore, and whether the pattern is changing over time. The gaps in activity are usually more informative than the hits.

    • Coverage. Are your most important commercial pages being fetched, or only your blog? If AI crawlers never reach your service pages, they can’t cite them.
    • Frequency. Independent log studies in 2026 reported GPTBot revisiting high-traffic pages every couple of days, with ClaudeBot and Google-Extended considerably slower. Your own cadence tells you how quickly content changes get picked up.
    • Status codes served to bots. A crawler receiving 404s or 500s is being told your content doesn’t exist.
    • Absence. No AI crawler hits at all usually means a robots.txt block, a CDN bot rule, or a site too new to be discovered.
    • Trend. One month is a snapshot. The direction of travel is the signal.

    Do AI crawlers execute JavaScript?

    Generally no. Multiple independent analyses in 2026 found that GPTBot, ClaudeBot and PerplexityBot fetch JavaScript files as text but do not execute them, so content that only appears after JS runs is effectively invisible to them. This is one of the most actionable findings available.

    The practical consequence: if your pricing, your service descriptions or your key content render client-side, Googlebot may eventually see it, but AI crawlers largely won’t. A React or Vue site without server-side rendering can be fully indexed by Google and almost entirely opaque to ChatGPT.

    How to check: fetch your own page with JavaScript disabled, or view the raw HTML source rather than the rendered DOM. If the content you want cited isn’t in the raw HTML, AI crawlers aren’t seeing it. The fix is server-side rendering, static generation, or at minimum making critical content available in the initial HTML response.

    How do I know the bot was real?

    Verify by IP, not by user-agent string. Anyone can send a request claiming to be GPTBot, and studies in 2026 estimated that roughly 5–8% of requests claiming to be known AI crawlers are spoofed. User agents are self-declared and trivially faked.

    Verification approaches: the major operators publish IP ranges for their crawlers, and reverse DNS lookup on the requesting IP should resolve to the operator’s domain and forward-resolve back to the same IP. For most businesses, this matters less for analysis than for blocking decisions, but if you’re about to make a policy change based on heavy crawling from one operator, confirm it’s really them.

    What do I do with what I find?

    Three common outcomes and their fixes:

    No AI crawler activity at all. Check robots.txt with our free checker, check for CDN or WAF bot rules, and confirm the site is discoverable. Being uncrawlable makes everything else in AI visibility moot.

    Crawling but no citations. The crawlers can reach you but aren’t finding your content worth quoting. That points to a content structure and authority issue. See how to get cited by ChatGPT, Perplexity & Gemini and check whether AI systems can even identify your brand with the Entity Signal Checker.

    Heavy training crawls, no referrals. This is the value-exchange question. You may decide to block training crawlers while allowing search and user-action bots, which keeps you citable without feeding models for free. Our llms.txt honest guide covers the control surfaces and which of them actually work.

    Where this fits in OptiSEOn’s GEO work

    Log-based crawl verification is part of how we approach LLM and AI search optimization. It’s the first diagnostic we run, because every other AI visibility tactic assumes crawl access that often isn’t there. Proving it with real data rather than estimates is the difference between a strategy and a hope.

    Frequently Asked Questions

    How do I know if GPTBot is crawling my site? 

    Check your server or CDN logs for requests with the GPTBot user agent. This is the only reliable method, since analytics tools filter out bots and robots.txt only records your instructions. Upload a log to the free AI Crawler Log Analyzer to see activity by bot over time.

    Why doesn’t Google Analytics show AI crawler traffic? 

    Because analytics tools rely on JavaScript tags that fire in a browser, and crawlers generally don’t execute JavaScript. GA4 is designed to measure humans and actively filters known bots. Server logs capture every request regardless.

    What is a good crawl-to-refer ratio? 

    There’s no universal benchmark because it depends entirely on which operators crawl you and whether they run consumer-facing products that can send referrals. Published 2026 figures varied enormously by source and month. Calculate your own ratio per operator and track the direction over time rather than comparing to an industry average.

    Do AI crawlers render JavaScript? 

    Generally no. Independent analyses through 2026 found GPTBot, ClaudeBot and PerplexityBot fetch JavaScript files as text without executing them. Content that requires JavaScript to appear is effectively invisible to them, which makes server-side rendering important for AI visibility.

    Should I block AI crawlers? 

    It depends on the category. Training crawlers like GPTBot and ClaudeBot return little or no referral traffic; search and user-action bots like OAI-SearchBot, PerplexityBot and ChatGPT-User can send real visits. Many businesses allow the latter and make a deliberate choice about the former. Check your current rules with our robots.txt checker.

    Can AI bot traffic be faked? 

    Yes. User-agent strings are self-declared and trivially spoofed; 2026 studies estimated roughly 5–8% of requests claiming to be known AI crawlers were not genuine. Verify by IP range or reverse DNS before making policy decisions based on apparent crawl volume.


    Stop guessing whether AI systems can see your site. Upload a server log and find out for free with no signup required. If the answer is “they’re not crawling you,” that’s the first thing to fix, and we can help.

  • Free On-Page SEO Checker: Audit Any Page in Seconds

    Free On-Page SEO Checker: Audit Any Page in Seconds

    Most on-page SEO problems are boring. A missing meta description. Two H1s where there should be one. A canonical pointing at the wrong URL. Images with no alt text. None of it is interesting, all of it is fixable in minutes, and collectively it’s the difference between a page that competes and one that quietly underperforms.

    The trouble is that checking it by hand means opening dev tools, reading source, and knowing what you’re looking for. Most people don’t, so it never gets checked.

    Our free On-Page SEO Checker does that pass for you: enter a URL and it returns title, meta description, heading structure, canonical, HTTP status, image alt text, word count and schema presence. This post explains what it checks, what each result means, and which problems are actually worth your time.

    TL;DR

    An on-page SEO checker inspects a single page’s fundamentals (like title tag, meta description, headings, canonical, status code, alt text, word count, and structured data) and flags what’s missing or misconfigured. The free OptiSEOn On-Page SEO Checker runs all of those on any URL with no signup. On-page issues rarely tank a site on their own, but they’re the easiest wins available and compound across an entire site.

    → Run the free On-Page SEO Checker

    What is on-page SEO?

    On-page SEO covers everything on the page itself that influences how search engines understand and rank it, including the title, headings, content, internal links, images, structured data, and HTML technical signals. It’s distinct from off-page SEO (links and authority from elsewhere) and site-wide technical SEO.

    The useful framing: off-page SEO is other people’s opinion of you, technical SEO is whether machines can access you, and on-page SEO is whether a given page clearly says what it’s about. All three matter, but on-page is the only one you can fix entirely by yourself this afternoon.

    What does the checker actually look at?

    It fetches the page and reports eight key areas: title tag, meta description, heading structure, canonical tag, HTTP status code, image alt text, word count, and whether schema markup is present. Each result is either a clear status or a metric you can act on directly.

    CheckWhat it tells you
    Title tagPresent, length, and whether it reads like a real title
    Meta descriptionPresent and within a sensible length
    HeadingsH1 count and the H2/H3 hierarchy underneath
    CanonicalWhether one exists and where it points
    HTTP statusWhether the URL returns 200 or something else
    Alt textHow many images have it and how many don’t
    Word countRough content depth signal
    SchemaWhether structured data is present on the page

    Why do titles and meta descriptions matter most?

    Because they’re the main elements a searcher sees before deciding to click; a page can rank well and still lose traffic to a more compelling result below it. Titles also directly influence rankings. Meta descriptions don’t affect rankings directly, but they heavily impact your click-through rate.

    Common failures the checker catches:

    • No title at all, or a CMS default like “Home” or “Untitled”
    • Duplicate titles across pages, which muddies which page should rank for what
    • Missing meta descriptions, leaving Google to pull an arbitrary snippet
    • Titles too long and truncating mid-phrase

    On length: Google truncates titles by pixel width, not character count, so relying solely on a 60-character limit can leave text cut off if you use wider letters. Our Title & Meta Description Generator measures the actual rendered width and shows a live SERP preview so you can refine your snippet accurately.

    Why does heading structure matter?

    Headings lay out a page’s structure for both readers and search engines. A clear hierarchy with one primary H1 and descriptive H2s makes your content easy to parse. This is especially important today, as AI search systems rely on clear headings to extract direct answers.

    What the checker flags:

    • No H1, or several H1s competing
    • Skipped levels, such as jumping straight from an H1 to an H3
    • Headings used for styling rather than structure, which is common in page builders
    • Vague headings that describe nothing (“Our Approach”)

    The practical upgrade: phrase H2s as the questions people actually ask, then answer each in the first 40–60 words beneath it. That’s the structure that wins featured snippets and AI citations, and it’s covered properly in our featured snippets and AI Overviews guide.

    What is a canonical tag and why does it matter?

    A canonical tag tells search engines which URL represents the main version of a page, preventing duplicate or similar URLs from competing with each other. An incorrect canonical tag is one of the few on-page errors that can cause a page to be deindexed.

    The failure modes worth knowing:

    • Canonical pointing to the wrong page, often caused by a template bug where every page points to the homepage and effectively hides the rest of the site from search
    • Canonical pointing at a staging domain after a migration
    • Missing canonical on sites that generate parameter URLs
    • Canonical conflicting with a redirect or a noindex

    If the checker shows a canonical pointing somewhere unexpected, treat it as urgent rather than routine. It’s in the same class of problem as the ones in Why Did My Organic Traffic Drop?.

    Does word count affect rankings?

    No. Word count isn’t a direct ranking factor, and there is no target number to hit. It simply indicates whether a page covers its topic thoroughly compared to competing pages. A concise 400-word page that answers a query directly can easily outperform an artificially padded 2,500-word article.

    Use the number comparatively rather than absolutely. If every page-one result for your target query runs to 2,000 words of genuine depth and yours is 300, the gap is probably real. If you’re at 300 words because the question needs 300 words, leave it alone.

    Does schema markup show up in this check?

    The checker indicates whether structured data is present on the page, offering a quick way to spot pages that lack it entirely. Generating and validating the markup code itself can then be handled separately.

    Schema is the bridge between traditional SEO and AI visibility: it tells both Google and AI systems what a page is in machine-readable terms. If the checker reports none, our free Schema Markup Generator builds valid JSON-LD from the page’s real content, and 10 Schema Markup Types Every Business Needs covers which types belong where.

    What this checker doesn’t do

    Worth being straight about the boundaries, because on-page tools are routinely oversold:

    • It checks one page at a time, not your whole site. Site-wide crawling is a different job.
    • It doesn’t measure performance. Core Web Vitals need PageSpeed Insights and field data — see our Core Web Vitals guide.
    • It doesn’t assess content quality. No tool can tell you whether your page is actually useful.
    • It doesn’t check links or authority. That’s the Backlink Profile Checker.
    • A clean report doesn’t mean you’ll rank. On-page fundamentals are table stakes, not an advantage.

    Ultimately, resolving on-page issues removes technical barriers; it doesn’t automatically guarantee top rankings. Sustainable search visibility depends on delivering helpful content, demonstrated expertise, and strong site authority over time.

    Where to start if everything’s broken

    Priority order when a check comes back with a long list:

    1. Status code and canonical problems (these can prevent pages from appearing in search results entirely)
    2. Missing or duplicate titles (these directly impact rankings and click-through rates)
    3. Missing H1 or broken hierarchy (these hurt readability and content extraction)
    4. Missing meta descriptions on pages already receiving search impressions (a fast win for click-through rate)
    5. Missing schema on key templates
    6. Alt text (important for accessibility first, and image search second)
    7. Thin content (requires the most effort to expand and refine)

    Run the checker on your five highest-value commercial pages first. Those are where fixes pay back immediately.

    Frequently Asked Questions

    How do I check the SEO of a web page? 

    Run the URL through an on-page SEO checker, which inspects the title, meta description, headings, canonical tag, HTTP status, image alt text, word count and schema. OptiSEOn’s free checker covers all of these with no signup, and Google Search Console shows how the page actually performs in search.

    What should an on-page SEO audit include? 

    At minimum: title and meta description, heading hierarchy, canonical tag, HTTP status, internal links, image alt text, content depth, and structured data. A fuller audit adds page speed, mobile rendering, and whether the page matches the search intent it targets.

    How long should a title tag be? 

    Google truncates titles by pixel width rather than character count (roughly 580 pixels, or about 50 to 60 standard characters). Measuring rendered width provides a clearer preview; our meta generator calculates this automatically.

    Does every page need schema markup? 

    Most pages benefit. At minimum, use Organization schema site-wide, Article on content pages, LocalBusiness on contact pages, and Product on product pages. Schema doesn’t rank pages directly but it helps search engines and AI systems identify what a page is and makes rich results possible.

    How many H1 tags should a page have? 

    One. The H1 states what the page is about; multiple H1s dilute that signal and usually indicate headings being used for styling rather than structure. Use H2 and H3 for the hierarchy beneath it.

    Will fixing on-page SEO improve my rankings? 

    It eliminates optimization barriers rather than guaranteeing higher positions. Correcting a broken canonical or adding a title tag can yield quick improvements, whereas adding alt text to an established page may have a subtle impact. On-page optimization creates a solid foundation, while overall content quality and authority drive ranking growth.


    Check any page in seconds. Run the free On-Page SEO Checker, starting with your highest-value commercial pages. If you have a large list of issues and want expert help resolving them, OptiSEOn is a Dallas-based SEO, AEO, GEO, and LLM optimization agency: book a free audit.

  • Your 2027 SEO & AI Search Plan: How to Budget and Prioritize

    Your 2027 SEO & AI Search Plan: How to Budget and Prioritize

    It’s planning season, which means a lot of marketing budgets are being built on last year’s assumptions plus a percentage. For search specifically, that’s a bad method this year, because 2026 changed the shape of the channel more than any year since mobile-first indexing.

    Two spam updates made content volume an active liability. Google extended its spam policies to cover AI Overviews and AI Mode, so scaled-content problems now cost you visibility in AI answers as well as rankings. And the share of buyers starting their research inside an AI assistant kept climbing.

    Planning 2027 as “2026 plus 10%” misses all of that. Here’s a more useful way to build the plan.

    TL;DR

    Build a 2027 search plan by auditing revenue outcomes from 2026, fixing technical foundations, and allocating budget across four main areas: technical setup, content depth, entity authority, and AI search presence. Most businesses do not need separate strategies for SEO and AI search, as core optimization supports both. Plan for a 6 to 12 month return horizon and focus on quality over content volume.

    → Book a free 2027 planning session

    What should I audit before planning 2027?

    Audit business outcomes rather than activity levels. Review which pages generated leads and sales, which content received no visits, your organic acquisition costs, and your presence in AI results. Effective planning looks at actual performance rather than task lists.

    The audit, in order:

    1. Revenue and leads by landing page. Not traffic. Which pages produced business?
    2. Cost per acquisition from organic, compared to your other channels. The method is in how to measure SEO ROI.
    3. Content performance distribution. In most libraries, a small minority of pages produce the overwhelming majority of value. Identify both ends.
    4. Technical health. Core Web Vitals, crawl errors, indexation, internal linking.
    5. Competitive position. Who gained on you this year, and where?
    6. AI visibility baseline. Do assistants name you? Test with the AI Citation Tester before you plan around it.
    7. Content liabilities. Any thin or scaled content that’s now a risk rather than an asset.

    Point 7 is new to this year’s planning cycle. After the 2026 updates, a library of thin pages isn’t neutral — it’s a drag on the whole domain.

    How should I split my search budget in 2027?

    Divide investment across four primary buckets: technical foundation, content depth, authority signals, and AI search visibility. Adjust weightings based on current performance bottlenecks. Allocation depends on addressing specific site weaknesses.

    A diagnostic approach rather than a formula:

    If this is trueFund this first
    Site is slow, has crawl or indexation problemsTechnical foundation
    You rank but don’t convertContent quality and conversion
    You have good content but few linksAuthority and digital PR
    Competitors named by AI, you aren’tEntity signals and AI visibility
    You have lots of thin pagesConsolidation and pruning before anything new
    Nothing is brokenContent depth and original research

    The single most common allocation mistake is funding new content when the constraint is authority or technical health. More pages on a site that can’t rank doesn’t produce more rankings.

    Should I budget separately for AI search?

    In most cases, no. Optimization for AI search overlaps significantly with standard SEO best practices. A separate budget is only needed for AI tracking, entity building, and third-party platform management.

    What overlaps (fund once, benefits both):

    • Content structured with question headings and direct answers
    • Schema markup and technical health
    • Genuine expertise and original data
    • Site architecture and internal linking

    What’s genuinely additional:

    • AI visibility monitoring — tooling or time to run prompt sets regularly
    • Entity signal development: Wikidata entries, consistent brand profiles, sameAs links, and citation building.
    • Third-party platform presence: review platforms, industry directories, and relevant communities cited by AI assistants. See Reddit for AI citations.

    Treat AI visibility as an extension of existing search strategy alongside targeted tracking and entity building, rather than running a completely separate program.

    What changed in 2026 that should change my plan?

    Three key factors: high content volume without depth became a risk, spam policies expanded to cover AI summaries, and AI discovery usage grew significantly. Each impacts budgeting choices.

    • Scaled content risks: Recent spam updates targeted low-quality scaled content, impacting search traffic for over-automated sites. Budgeting impact: allocate funds toward higher quality pieces and consolidating existing content.
    • Spam policy expansion: Search spam guidelines apply to AI Overviews, meaning poor quality content hurts both standard rankings and AI answer inclusion. Budgeting impact: content quality affects multiple search channels.
    • AI discovery tracking: Monitoring AI brand mentions requires ongoing tracking. Budgeting impact: set aside a minor line item for AI tracking tools.

    What should I actually fund first?

    Address site foundations, consolidate low-performing pages, and build content depth in that sequence. Investing in content creation on an unoptimized site reduces total returns.

    A defensible 2027 sequence:

    Q1 — Foundation and cleanup

    • Technical audit and fixes (Core Web Vitals, crawl, indexation)
    • Internal linking and architecture updates, detailed in our guide.
    • Content audit: consolidate overlapping pages, prune weak content, and update existing assets. See Content Refresh & Pruning.
    • Entity signal assessment using our entity checker tool.

    Q2 — Depth

    • Rebuild your highest-value commercial pages properly
    • Structure top content for extraction and AI citation
    • Begin original research if you have data worth publishing

    Q3 — Authority

    • Digital PR and earned links
    • Third-party platform presence in your category
    • Publish and promote the research

    Q4 — Compound and measure

    • Refresh cycle on everything published
    • Full measurement review
    • Plan 2028 from real data

    How much should I budget?

    Plan for at least 12 months of consistent execution. Stopping midway negates early work, and sustained effort outperforms short-lived high spending.

    The uncomfortable truth in planning conversations: the most common reason SEO budgets fail to produce returns isn’t that they were too small, it’s that they were cut at month four or five, right before compounding starts. Leading indicators appear at 60–90 days; genuine ROI typically lands between months 6 and 12.

    Focus budget planning on what can be sustained for a full twelve-month period to allow compounding returns to take effect.

    If deciding between in-house management and external support, how to choose an SEO agency outlines key evaluation criteria.

    If you’re evaluating whether to run this in-house or hire out, how to choose an SEO agency covers what to ask — including the parts that make agencies look worse.

    When is SEO the wrong investment for 2027?

    When rapid results are needed within 90 days, when search volume is nonexistent for your market, or when budget cannot support a full year of execution.

    In those cases: run paid for immediate demand and build organic alongside at whatever pace is sustainable, or validate demand before investing in capturing it. Starting a search program you’ll abandon in April is worse than not starting.

    Frequently Asked Questions

    How much should a business budget for SEO in 2027? 

    Budget enough to maintain twelve consecutive months of activity, as stopping early prevents compounding returns. Required budget varies by market competition, technical requirements, and content scope.

    Should I budget separately for AI search optimization? 

    Generally no. The technical optimization, content structure, and schema markup that drive standard search rankings also power AI citations. Reserve separate budget line items for AI brand tracking and entity setup.

    What changed in SEO in 2026 that affects 2027 planning? 

    High-volume scaled content faced stricter penalty enforcement, search spam policies expanded to cover AI summaries, and AI discovery tools required dedicated monitoring.

    What changed in SEO in 2026 that affects 2027 planning? 

    Content volume became an active liability after two spam updates targeting scaled content abuse; Google extended spam policy to cover AI Overviews and AI Mode, so quality problems now cost rankings and AI citations simultaneously; and AI-assisted discovery grew enough to require dedicated measurement.

    Should I publish more content in 2027 or improve what I have? 

    Updating and consolidating existing content usually provides stronger returns than adding new pages, as established pages already hold search history and authority. Audit your current page library before creating new content.

    How long before a 2027 SEO plan shows results? 

    Leading indicators typically appear within 60–90 days, with measurable ROI between months 6 and 12. Technical fixes can move faster; authority building is slower. Plan on a twelve-month horizon and treat anything earlier as a bonus rather than the basis of the business case.

    Is SEO still worth investing in with AI search growing? 

    Yes, and increasingly they’re the same investment. AI systems draw heavily on content that search engines already surface and trust, so the work that earns rankings largely earns citations too. The channel is changing shape rather than disappearing.


    Building your 2027 search budget? Book a free planning session. We’ll audit what actually produced revenue in 2026, tell you honestly where your binding constraint is, and help you sequence the spend — including whether you should be spending it with us at all.

  • Real Estate SEO in 2026: Where Agents and Brokerages Can Actually Win

    Real Estate SEO in 2026: Where Agents and Brokerages Can Actually Win

    Real estate has a unique SEO challenge. National portals dominate the broadest keywords and hold those positions firmly. Searching for “homes for sale in Dallas” brings up Zillow, Realtor.com, Redfin, and Trulia, which have high domain authority, complete property databases, and large engineering teams.

    An agent’s website cannot outrank Zillow for “homes for sale in Dallas.” Accepting that is the beginning of a real strategy rather than the end of one, because the portals have genuine weaknesses: they’re generic, they have no local expertise, they can’t answer specific questions about a neighborhood, and they don’t rank well for the long-tail, hyperlocal, question-shaped queries that actually precede a listing agreement.

    Here’s where the winnable ground is.

    TL;DR

    Real estate SEO in 2026 involves conceding broad inventory keywords to national portals and focusing on hyperlocal expertise instead. Focus on neighborhood guides, targeted answers, the Google Map Pack, and agent entity signals. Local market knowledge and Google Business Profiles offer a distinct advantage over large listing portals.

    → Book a free real estate SEO audit

    Why can’t I outrank Zillow?

    Portals maintain comprehensive inventory, massive domain authority, and established backlink profiles for broad search terms. Competing directly for generic terms like “homes for sale in [city]” is rarely successful for individual agents or independent brokerages.

    What the portals genuinely cannot do:

    • Write authentically about what it’s like to live in a specific neighborhood
    • Answer local questions that require actual market knowledge
    • Rank in the local map pack as your business in your local area
    • Build personal reputation and reviews tied to a named agent
    • Cover hyperlocal and seller-side queries at the granularity a local specialist can

    Every one of those is a viable strategy. The portals compete on inventory; you compete on expertise and proximity.

    What should real estate SEO actually target?

    Focus on hyperlocal searches, seller intent, and specific local questions where specialized expertise wins over portal inventory. These queries often convert better because users are closer to making decisions.

    The query types worth building around:

    Query typeExampleWhy it’s winnable
    neighborhood research“what’s it like living in Bishop Arts”Portals can’t write this credibly
    Hyperlocal inventory“condos near White Rock Lake with HOA under $400”Too specific for portal templates
    Seller-side“how much is my Plano home worth”Portals compete, but local agents rank
    Process questions“how long does closing take in Texas”Informational, locally specific
    Comparison“Frisco vs Prosper for families”Requires genuine local judgment
    Agent search“best listing agent in Richardson”Map pack + reputation, not inventory

    How important is Google Business Profile for agents?

    Google Business Profiles are critical assets. The map pack lets local agents compete directly, since national portals don’t appear in local map results. An optimized profile is central to capturing searches for local agents.

    The specifics for real estate:

    • Individual agent profiles alongside the brokerage profile, where permitted — agents are searched by name constantly
    • Correct primary category: “Real Estate Agent,” “Real Estate Agency,” and “Real Estate Appraiser” send distinct signals to Google.
    • Service area set to the areas you genuinely work, not the entire metro
    • Reviews from past clients, requested systematically after every closing. Real estate is a high-trust, high-value transaction; reviews carry disproportionate weight.
    • Photos of real listings, real closings, real neighborhoods
    • Weekly posts — new listings, market updates, open houses
    • Weekly updates featuring new listings, market insights, or open house events.

    Our Google Business Profile guide outlines the process, while broader local search strategies are detailed in Local SEO for Dallas Businesses. Brokerages with multiple offices can refer to Multi-Location & Franchise SEO for managing scale without duplicate content.

    What should neighborhood pages contain?

    Provide detailed local insights including market data, neighborhood traits, school quality, commute options, housing types, and local amenities. Generic templates with swapped location names perform poorly and risk search penalties under recent spam updates.

    A neighborhood page worth publishing includes:

    • Current market context: price trends, available inventory, and average days on market updated regularly.
    • Housing stock details: common architectural styles, home ages, and lot sizes.
    • Practical information: school ratings, commute times, walkability, HOA details, and environmental considerations.
    • Honest local perspective: practical advice you would give a homebuyer, including potential drawbacks.
    • Your listings and past sales in that area
    • Local photography, not stock

    The evaluation standard for neighborhood pages is straightforward: if changing the location name doesn’t change the content, it needs improvement. In the Dallas area, Plano, Frisco, Richardson, Oak Cliff, and Highland Park each have distinct characteristics that create rich opportunities for unique content.

    How should I handle IDX listing pages?

    Manage IDX listing feeds carefully. Because IDX listings replicate content across numerous agent websites, they rarely rank individually and can affect overall site quality at scale. Use IDX pages to improve site user experience rather than relying on them for organic acquisition.

    The practical approach: let IDX listings serve buyers browsing your site, but don’t expect them to rank, and don’t let thousands of near-duplicate listing pages dominate your indexed footprint. Consider whether individual listing pages should be indexed at all, given they duplicate every other IDX site and expire constantly.

    Focus effort on differentiating your exclusive listings with original photography, detailed descriptions, and neighborhood context. These unique assets are worth indexing properly using schema markup.

    Given how frequently listings expire, have a plan for dead listing URLs — redirect them to the relevant neighborhood or search page rather than leaving thousands of 404s or, worse, thin “this listing is no longer available” pages.

    What about E-E-A-T for real estate?

    Real estate content falls under financial and significant life decision topics. Named agent authorship, licensing details, credentials, and verifiable market experience are essential. Generic brokerage content performs noticeably worse.

    What to signal:

    • Named agent profiles: complete bios with license numbers, years of experience, coverage areas, transaction history, and professional certifications.
    • Person schema on agent pages, linked to the brokerage’s Organization schema
    • First-hand experience: highlight local sales history, as individual transaction experience cannot be matched by portals.
    • Accurate, dated market data with sources
    • Clear contact and licensing information

    Our E-E-A-T guide provides the full framework. Individual expertise gives local agents a clear advantage over large automated aggregators.

    Does AI search change real estate?

    Yes. Homebuyers often use AI tools to research neighborhoods and the buying process before visiting listing sites. AI answers pull heavily from local guides, directories, and reviews. This creates new opportunities for local sites.

    AI assistants answer questions about family-friendly neighborhoods or budget considerations by citing detailed local articles rather than raw listing databases. Agents who publish helpful local guides are well-positioned to earn these citations.

    Format content with clear question headings and direct answers. Keep entity signals consistent across your website, Google Business Profile, and industry directories. You can test your AI visibility using our AI Citation Tester. Review our guide on how to get cited by ChatGPT, Perplexity & Gemini for complete instructions.

    Realistic expectations

    • Weeks 1 to 8: Focus on Google Business Profile updates and review generation for quick initial progress.
    • Months 2 to 4: Neighborhood guides and Q&A content start gaining search traction.
    • Months 4 to 9: Authority builds as content depth expands.
    • Long-term target: Avoid targeting generic portal-dominated terms. Hyperlocal queries attract buyers who are much closer to making decisions.

    Frequently Asked Questions

    Can a real estate agent outrank Zillow? 

    Not for generic terms like “homes for sale in [city]” due to portal authority and database scale. Agents can win on hyperlocal searches, specific buyer questions, seller keywords, and Google Map Pack results where local presence matters most.

    What are the best keywords for real estate SEO? 

    Hyperlocal and question-based terms: neighborhood research queries, specific property-type-plus-area searches, seller-side terms like home valuation, local process questions, and agent searches. These convert better than broad inventory terms because the searcher is closer to a decision.

    Should IDX listing pages be indexed? 

    Often not. IDX feeds produce listing pages duplicated across every agent site using the same feed, so they rarely rank and can dilute site quality at scale. Serve them for user experience, index your own listings with original content and photography, and redirect expired listing URLs to relevant neighborhood pages.

    How do I write neighborhood pages that rank? 

    With genuine local substance: current market data, real housing-stock detail, schools and commute information, your own perspective including drawbacks, your past sales in the area, and local photography. Templated pages with only the neighborhood name changed are treated as doorway pages and demoted.

    Is Google Business Profile important for realtors? 

    Very. The map pack is the one surface where local agents compete on equal footing, since portals don’t occupy it. Individual agent profiles alongside the brokerage, accurate categories, systematic post-closing review requests, and regular posts are the highest-ROI local work available to an agent.

    How long does real estate SEO take to work? 

    Google Business Profile and review improvements often show within 4–8 weeks. neighborhood and question-based content typically begins ranking at 2–4 months, with meaningful compounding by months 4–9. Broad portal-dominated terms should not be part of the timeline at all.


    Running SEO for a brokerage or as an individual agent in DFW? Book a free real estate SEO audit. Based in Dallas, OptiSEOn understands the local market dynamics across North Texas and can help identify attainable local search terms.

  • Free Title & Meta Description Generator: Built From Your Page, Measured in Pixels

    Free Title & Meta Description Generator: Built From Your Page, Measured in Pixels

    Title tags and meta descriptions are the highest-leverage fifty words on any web page. They’re what someone actually reads in the search results before deciding whether to click your link or the result below it, and improving them can lift click-through rate on pages whose rankings never move at all.

    They’re also the element most commonly left to whatever a CMS auto-generates, or written to a character count that doesn’t reflect how Google actually truncates.

    Our free Title & Meta Description Generator addresses both problems: it builds candidates from your page’s real content and measures them in pixels rather than characters, because pixel width is what determines truncation.

    TL;DR

    Title tags and meta descriptions determine whether people click your result, and Google truncates them by pixel width rather than character count, which is why character-based guidance is unreliable. The free OptiSEOn generator reads your page’s H1, headings, schema, location, and opening paragraph to assemble candidates, measures against a 580px title and 920px description budget using Arial advance-width metrics, and includes a live SERP preview with an editor that re-measures as you type. Nothing is invented.

    → Generate titles and meta descriptions

    Why does pixel width matter more than character count?

    Google truncates titles and descriptions based on how wide they render, not how many characters they contain, and characters have wildly different widths. A title of sixty W’s is vastly wider than sixty i’s, so any “keep it under 60 characters” rule is an approximation that fails on real titles.

    This is why two titles of identical character length can behave differently in the SERP: one displays in full, the other gets cut mid-word with an ellipsis. Capital letters, wide characters like W and M, and narrow ones like i, l, and t all shift the real width substantially.

    The generator measures against a 580px title budget and 920px description budget using Arial advance-width metrics, matching the way Google actually renders and truncates. You see whether your title fits, not whether it satisfies a rule of thumb.

    What does the generator do?

    It reads the page at the URL you enter and assembles title and description candidates from that page’s own H1, headings, schema, location data, and opening paragraph, then measures each in pixels and shows them in a live SERP preview. Nothing is invented, and you can edit in place with the measurement updating as you type.

    What that means practically:

    • Built from your real content. Candidates come from what’s genuinely on the page, not from a model guessing what your business does.
    • Pixel-measured. Both title and description measured against Google’s rendering budget.
    • Live SERP preview. See how the result will actually look.
    • Editable with live re-measurement. Adjust wording and watch the pixel width update.
    • Free, no signup.

    The “nothing invented” constraint is deliberate, and it’s the same principle behind our schema markup generator and entity signal checker. A tool that fabricates a plausible-sounding description for a page it didn’t really read produces meta descriptions that misrepresent the page — which raises click-through briefly and bounce rate permanently.

    What makes a good title tag?

    A good title tag includes the primary keyword near the front, describes the page accurately, fits within the pixel budget, and gives someone a reason to click rather than just naming the topic. It’s a ranking element and an advertisement simultaneously.

    The rules that hold up:

    • Primary keyword early. Front-loading matters for both relevance and scannability.
    • Fit the pixel budget so it doesn’t truncate mid-phrase.
    • Be specific. “Local SEO Guide” loses to “Local SEO for Dallas Businesses: 2026 Map Pack Playbook.”
    • Unique per page. Duplicate titles across pages are a cannibalization signal (see our internal linking guide).
    • Brand at the end, if at all, on content pages. Front-loading your brand wastes the most valuable pixels unless the brand is the draw.
    • Match search intent. If the SERP is full of guides, “Guide” belongs in your title.

    What makes a good meta description?

    A good meta description summarises what the page delivers, includes the keyword naturally, fits the pixel budget, and gives a concrete reason to click. While it doesn’t directly affect rankings, it strongly affects click-through rate. Treat it as ad copy that happens to sit in search results.

    Worth knowing: Google rewrites meta descriptions frequently (often more than half the time) when it judges that a different snippet better matches the query. That’s not a reason to skip writing them. A well-written description is used more often than a poor one, and when Google does rewrite, it pulls from your page content, so well-structured content improves the substitute too.

    What works:

    • Deliver on the title’s promise with specifics
    • Include the keyword naturally (it gets bolded when it matches the query)
    • Give a concrete reason to click by highlighting what readers will learn or be able to do.
    • Active voice, no filler. “Learn about our services” wastes the whole budget.
    • Unique per page

    Why do my meta descriptions matter if Google rewrites them?

    Click-through rate is a real competitive lever, and a description Google keeps is better than one it replaces. Plus, the pages Google rewrites most are usually the ones whose descriptions were weakest to begin with. Writing them well raises the floor either way.

    There’s also a compounding angle. Improving CTR on pages that already rank is one of the fastest wins in SEO, because you’re not waiting for ranking movement at all. A page sitting at position 4 with a weak description is leaving clicks on the table today, and the fix takes ten minutes.

    To find those pages: in Search Console, sort by impressions and look for pages with high impressions and low CTR relative to their average position. Those are your rewrite candidates.

    Does this affect AI search too?

    Indirectly. AI systems read your page content rather than your meta description, but clear titles and well-structured pages help them identify what a page is about, and the same discipline that produces a good title produces a clear H1 and heading structure. The description itself isn’t the lever; the clarity behind it is.

    The thing that genuinely drives AI citation is the structure covered in how to get cited by ChatGPT, Perplexity & Gemini: question-format headings with direct answers underneath. Titles and descriptions are for humans in the SERP. Both matter, for different reasons.

    Frequently Asked Questions

    How long should a title tag be? 

    Google truncates by pixel width rather than character count, with a title budget of roughly 580px. That works out to somewhere around 50–60 characters for typical text, but wide characters consume the budget faster. Measuring in pixels, as our generator does, is more reliable than counting characters.

    How long should a meta description be? 

    Around 920px of rendered width, which is roughly 150–160 characters of typical text but varies with the actual characters used. Measure rather than count, and front-load the important information so that truncation doesn’t remove your reason to click.

    Do meta descriptions affect rankings?

    Not directly, as Google has stated meta descriptions aren’t a ranking factor. They affect click-through rate, which affects how much traffic a given ranking produces. Improving descriptions on pages that already rank well is one of the fastest available traffic wins.

    Why does Google rewrite my meta description? 

    Google substitutes its own snippet when it judges that text from your page better matches the specific query. This happens frequently. Writing good descriptions still helps, because strong ones are kept more often, and Google’s substitutes are drawn from your page content, so clear content improves both outcomes.

    Should every page have a unique title and meta description? 

    Yes. Duplicate titles and descriptions across pages make it harder for search engines to distinguish them and can contribute to cannibalization. Every indexable page should have its own, written for that page’s specific intent.

    Is the OptiSEOn title and meta generator free? 

    Yes, with no sign-up. Enter a URL, and it assembles candidates from that page’s own H1, headings, schema, location, and opening paragraph, measures them in pixels against Google’s truncation budgets, and shows a live SERP preview you can edit. It’s one of eleven free tools we build.


    Fix the fifty words that decide whether people click. Use the free Title & Meta Description Generator, starting with your highest-impression, lowest-CTR pages. Want the full list of which pages those are? Book a free audit.

  • Website Migration SEO: How Not to Lose Your Rankings

    Website Migration SEO: How Not to Lose Your Rankings

    Site migrations are where years of SEO work go to die. This rarely happens because migrations are inherently destructive, but because SEO planning usually starts after the design is signed off, the URLs are decided, and the launch date is fixed, which is roughly three months too late.

    We get called about migrations in two ways. Occasionally before, when there’s time to do it properly. More often after, when organic traffic dropped 60% the week of launch and nobody knows why.

    The second call is avoidable. Here’s what proper migration SEO looks like, in the order it has to happen.

    TL;DR

    The overwhelming majority of migration traffic losses come from three things: missing or wrong 301 redirects, a staging site’s noindex shipping to production, and URL changes made without SEO input. Plan migration SEO before design is finalised, build a complete redirect map from a full crawl of the old site, test everything on staging, and monitor daily for the first month. Expect a temporary dip even when everything goes right.

    → Book a free pre-migration audit

    What counts as a site migration?

    Any change that alters your URLs, hosting, platform, domain, or site structure, including redesigns that keep the same domain. People tend to think “migration” means changing domains, but a redesign that reorganises your URL structure carries most of the same risk.

    The types, roughly in ascending order of risk:

    • Visual redesign, same URLs: lowest risk, but Core Web Vitals and internal linking can still regress
    • Restructure: same domain, new URL structure
    • Replatform: WordPress to Shopify, Wix to Webflow, custom to headless
    • Protocol or subdomain change: HTTP to HTTPS, www to non-www, subdomain to subfolder
    • Domain change or rebrand: highest risk
    • Consolidation: merging multiple sites into one

    Each needs the same discipline; the bigger ones just need more of it.

    Why do sites lose traffic after migration?

    Because the old URLs stop resolving and nothing tells search engines where the content moved; every page that 404s loses its rankings and every link pointing at it stops passing authority. Missing redirects are the single largest cause, followed by staging-environment settings shipping to production.

    The recurring causes, in the order we find them:

    1. Missing or incomplete redirects. Somebody redirects the top 50 pages and forgets the other 2,000.
    2. Redirects pointing everywhere to the homepage. Google increasingly treats mass homepage redirects as soft 404s. Redirect each URL to its closest equivalent.
    3. A staging noindex shipped live. Catastrophic, common, and fixable in two minutes if you catch it.
    4. robots.txt from staging blocking the whole site.
    5. Content dropped or shortened during redesign, as you can’t rank on content that no longer exists.
    6. Internal links still pointing at old URLs, creating chains and wasted equity.
    7. Metadata lost — titles and descriptions regenerated by a new CMS’s defaults.
    8. Structured data not carried over, losing rich results.
    9. Analytics and Search Console not reconfigured, which leaves you unable to track what happened.

    What do I need to do before launch?

    Crawl the existing site completely, benchmark current performance, build a one-to-one redirect map, and test the whole thing on staging before anything goes live. Pre-launch is where migrations are won; there is no equivalent amount of post-launch work that compensates for skipping it.

    The pre-launch checklist:

    • Full crawl of the current site (Screaming Frog or similar). Export every URL, title, meta description, H1, status code, and internal link. This is your source of truth.
    • Export Search Console data, including top pages by clicks and impressions alongside top queries over at least 12 months.
    • Benchmark everything, such as rankings, organic traffic by page, conversions, and Core Web Vitals. You cannot assess post-launch damage without a baseline.
    • Build the redirect map. Every old URL mapped to its closest new equivalent, one to one. Pages with no equivalent go to the most relevant category page, not the homepage.
    • Keep the content. Redesigns routinely cut copy for aesthetic reasons. Cut ranking content and you cut rankings.
    • Test on staging with the redirect map applied, and make sure staging is password-protected or noindex’d.
    • Plan a low-traffic launch window, avoiding Friday afternoons, upcoming holidays, or peak seasons.

    How should I build a redirect map?

    Map every old URL to the single most relevant new URL, one to one, using 301 (permanent) redirects while avoiding chains, loops, and defaulting everything to the homepage. Build it from your full crawl, not from memory or the sitemap alone.

    Practical rules:

    • 301, not 302. Temporary redirects don’t pass authority the same way.
    • One hop. Old URL → new URL directly. Chains dilute and slow crawling.
    • Closest equivalent. If a page is genuinely gone, redirect to its parent category, not the homepage.
    • Include everything, such as old redirects from previous migrations, parameter URLs, paginated pages, and images if their paths change.
    • Test before launch and re-test after, in bulk.

    One subtlety worth knowing: if you’ve migrated before, your old redirects need re-mapping to the new destinations too. Otherwise you build chains three hops deep, and equity leaks at each step.

    What do I do on launch day?

    Verify the site is indexable, spot-check redirects live, submit the new sitemap, and confirm analytics is firing in that order within the first hour. Launch day is about catching catastrophic errors fast, not optimisation.

    The immediate checklist:

    • Check robots.txt — is it the production version?
    • Check for noindex sitewide. In WordPress, Settings → Reading.
    • Spot-check 20–30 redirects manually across different page types.
    • Submit the new XML sitemap in Search Console.
    • Verify analytics and tag manager are firing on the new templates.
    • Check Search Console for a spike in crawl errors.
    • Run a fresh crawl of the new site and compare the URL count against expectations.

    If you find a sitewide noindex, fix it immediately and request indexing on key pages. Caught within hours it’s usually recoverable; caught in three weeks it isn’t, cleanly.

    What should I monitor after launch?

    Monitor daily for the first two weeks, then weekly for three months — watching indexation, crawl errors, rankings on your benchmark terms, organic traffic by page, and conversions. A temporary dip is normal; a sustained one is a problem to diagnose.

    Watch specifically:

    • Indexation count in Search Console — is the new site being indexed at the expected rate?
    • Crawl errors and 404s, keeping in mind that every 404 from an old URL points to a missing redirect
    • Rankings on your benchmark terms against the pre-launch baseline
    • Organic traffic by landing page to identify which specific pages lost ground
    • Conversions, not just traffic
    • Core Web Vitals on the new build

    If traffic drops and doesn’t recover, work the diagnostic sequence in Why Did My Organic Traffic Drop?. Migrations produce a distinctive pattern of sudden, page-level losses that maps directly to missing redirects.

    How long does recovery take?

    Expect a temporary dip of a few weeks even on a well-executed migration, with full recovery typically within one to three months as search engines recrawl and reprocess the new structure. Larger sites take longer because recrawling everything takes longer.

    What’s normal: a dip in weeks one to three, gradual recovery through weeks four to eight, and stability by month three. What isn’t normal: a drop that deepens after week four, or one confined to specific page types (which usually means a redirect or template problem, not natural volatility).

    The honest advice about timing

    The most valuable thing we can tell you about migration SEO is that the deciding factor is when you involve SEO, not how good the SEO work is.

    A migration where URLs, structure, and content are decided with SEO input usually loses little or nothing. Conversely, a migration where SEO is invited after those decisions are locked becomes a damage-limitation exercise. While a redirect map can preserve some equity, a URL structure designed without search consideration or a redesign that cut half the copy cannot be fixed with redirects alone.

    If you’re planning a redesign, the SEO conversation belongs in the same meeting as the sitemap, before anyone opens a design tool.

    Frequently Asked Questions

    Will I lose rankings if I redesign my website? 

    Not necessarily. A visual redesign keeping the same URLs, content and technical foundation carries low risk. Losses happen when URLs change without redirects, content is cut, or technical settings regress. Plan SEO alongside design rather than after, and most risk disappears.

    How long does it take to recover from a site migration? 

    A temporary dip of a few weeks is normal even when everything is done correctly, with recovery typically complete within one to three months. Larger sites take longer because recrawling takes longer. A drop that deepens after the first month suggests a real problem rather than normal volatility.

    Should I use 301 or 302 redirects for a migration? 

    301, which signals a permanent move and passes ranking authority to the new URL. 302 indicates a temporary move and isn’t appropriate for migration. Use one-hop 301s from each old URL directly to its new equivalent, avoiding chains.

    Can I redirect all my old URLs to the homepage? 

    No. Google increasingly treats mass homepage redirects as soft 404s, meaning you lose the rankings anyway and gain nothing. Redirect each URL to its closest equivalent; where none exists, use the most relevant category page.

    What’s the most common site migration mistake? 

    Missing or incomplete redirects, typically mapping the top pages and overlooking the rest of the site. A close second is a staging environment’s noindex setting shipping to production, which deindexes the entire site and frequently goes unnoticed for days.

    When should I involve an SEO in a website redesign? 

    Before URLs, site structure, or content are finalised, ideally at the sitemap stage. SEO involvement after those decisions are locked becomes damage limitation. The single biggest predictor of whether a migration preserves traffic is how early search considerations entered the process.


    Planning a redesign, replatform or domain change? Book a free pre-migration audit. We’ll benchmark what you have, build the redirect map, and review the new structure before it’s built, which is considerably cheaper than diagnosing it afterwards.

  • SEO Competitor Analysis: How to Reverse-Engineer What’s Already Working

    SEO Competitor Analysis: How to Reverse-Engineer What’s Already Working

    There’s a shortcut in SEO that isn’t a shortcut at all, but rather pure leverage. Your competitors have already spent years testing which keywords convert in your market, which content formats Google rewards, and which links are gettable. That information is sitting in public, yet most businesses never look at it.

    Competitor analysis isn’t about copying. It’s about establishing what the actual bar is before you spend six months and a budget clearing it. It answers the question nobody can answer from inside their own analytics: what does winning in this market actually require?

    Here’s the process.

    TL;DR

    SEO competitor analysis means identifying who actually outranks you for the terms you care about, then systematically comparing their content, keywords, backlinks, technical health, and AI visibility against yours to find the gaps worth closing. Your search competitors are often not your business competitors. Start by identifying the right ones, then work through content gaps, link gaps, and structural differences.

    → Book a free competitive audit

    Who are my actual SEO competitors?

    Your SEO competitors are whoever ranks on page one for the queries you want — which frequently isn’t your business competition at all, but directories, review sites, marketplaces, publishers, and aggregators. Identify them empirically rather than from memory.

    To find them: take your ten to twenty most commercially important keywords, search each one (incognito, and location-set if you’re local), and record which domains appear repeatedly. The pattern that emerges is your real competitive set.

    What usually surprises people: for many commercial queries, several page-one slots go to directories and listicles rather than businesses like yours. That changes strategy substantially. If four of ten results are “best X in Y” roundups, getting listed in those roundups may be worth more than trying to outrank them. Ultimately, that makes it a digital PR task, not a content task.

    What should I compare?

    Compare five dimensions: keyword coverage, content depth and format, backlink profile, technical health, and AI search visibility. Each reveals a different kind of gap and suggests a different fix.

    DimensionWhat you’re looking forHow to check
    KeywordsTerms they rank for that you don’tAhrefs/Semrush gap analysis, or manual SERP review
    ContentDepth, format, structure, freshnessRead their top pages properly
    BacklinksReferring domain count and sourcesBacklink Profile Checker
    TechnicalSpeed, structure, schemaPageSpeed Insights, view source
    AI visibilityWhether AI assistants name themAI Citation Tester

    How do I do a content gap analysis?

    A content gap analysis identifies topics and queries your competitors rank for that you have no content addressing. These are your highest-confidence content opportunities because demand is already proven. Paid tools automate it, while manual review works well for smaller sets.

    With a paid tool (Ahrefs Content Gap, Semrush Keyword Gap): enter your domain plus two or three competitors and export keywords where they rank and you don’t. Filter for commercial intent and realistic difficulty.

    Manually: list their blog and service pages, map each to the query it targets, and mark which you have no equivalent for. Slower, free, and often more insightful because you actually read the content.

    Then prioritize using the framework in our keyword research guide, focusing on business value first, then achievability, and finally existing position.

    How do I analyze their content properly?

    Read their top-performing pages as a practitioner rather than skimming them. Look at structure, depth, format, freshness, author attribution, and what specifically they offer that you don’t. The goal is understanding why Google rewards it.

    What to examine on each page:

    • Format. Long guide, comparison table, tool, calculator, original data? Google’s choice of format for a query is a strong signal of what it wants.
    • Depth. Word count is a crude proxy, but substantive coverage of sub-topics matters.
    • Structure. Are they using question headings and direct answers? This structure is key to winning featured snippets and AI Overview citations.
    • Freshness. Last-updated dates, current data.
    • E-E-A-T signals. Named credentialed authors, original data, citations.
    • What’s genuinely unique, such as proprietary data, tools, or real case studies.

    That last point is the useful one. If every page-one result includes original data and yours doesn’t, you’ve found your gap, and it isn’t a word-count problem.

    How do I find link opportunities from competitors?

    Run a backlink gap analysis to find domains linking to several of your competitors but not to you. These are sites already demonstrably willing to link to businesses like yours. It’s the highest-conversion outreach list available.

    The pattern: pull referring domains for your top three competitors, find the overlap, exclude domains already linking to you, and sort by relevance and authority. Sites linking to two or three of your competitors but not you are the priority.

    What you’ll typically find: industry directories you’re missing, roundups and “best of” lists you could be included in, publications that cover your space, podcasts that interview people in your field, and local or trade organizations. Most are gettable by simply asking, once you know they exist.

    The tactics for converting these are in our link building guide. If your gap analysis shows a large deficit, our citation and authority building service covers the systematic side.

    Should I check whether AI assistants recommend them?

    Yes, AI visibility is now a distinct competitive dimension, and a competitor can be invisible in Google while dominating ChatGPT recommendations, or vice versa. Test it directly rather than assuming the two correlate.

    Run the category prompts your buyers would actually use, such as “best [category] in [city]” or “what should I use for [problem],” across ChatGPT, Perplexity, Claude, and Google AI, then record which brands get named. Our free AI Citation Tester builds the prompt set and tracks results over time.

    If competitors are named and you aren’t, the diagnosis is usually entity signals, content structure, or third-party corroboration. We cover this in detail in how to get cited by ChatGPT, Perplexity & Gemini.

    How do I turn analysis into a plan?

    Convert findings into a prioritized list scored on business value, achievability, and effort. Then work the highest-value, lowest-effort items first. Analysis that doesn’t become a ranked backlog is just a document nobody reads.

    A workable prioritization:

    1. Quick wins: terms where you rank 5–20 and a competitor’s page is beatable with a refresh
    2. Link opportunities: domains linking to multiple competitors but not you
    3. Content gaps with commercial intent: proven demand, no coverage from you
    4. Structural fixes: schema, internal linking, technical issues they’ve solved and you haven’t
    5. Long-term plays: original research, tools, and assets that take months to build

    Most businesses get more from the first two than from months of new content.

    An honest caveat

    Competitor analysis tells you what’s working now, which means it’s inherently a follower’s strategy. It’s excellent for closing gaps and terrible for creating advantage. The things that actually differentiate (like original research, proprietary data, a genuine point of view, or tools nobody else built) by definition won’t show up in a competitor’s profile, because they haven’t done them either.

    Use competitive analysis to reach parity efficiently. Use something else to get ahead.

    Frequently Asked Questions

    How do I find my SEO competitors? 

    Search your ten to twenty most important commercial keywords and record which domains appear repeatedly on page one. These are your actual search competitors, which often include directories, review sites, and publishers rather than only your business competitors.

    What is a content gap analysis? 

    Identifying topics and keywords your competitors rank for that you have no content addressing. Because demand is already proven by their rankings, these are high-confidence content opportunities. Tools like Ahrefs Content Gap and Semrush Keyword Gap automate it; manual review works for smaller competitive sets.

    How do I find out where competitors get their backlinks? 

    Run a backlink gap analysis: pull referring domains for two or three competitors, find domains linking to several of them but not to you, and sort by relevance and authority. Those sites have already shown willingness to link to businesses like yours, making them your highest-conversion outreach targets.

    Should I just copy what my competitors are doing? 

    No. Use competitor analysis to understand the baseline your market requires, then exceed it with something they don’t have — original data, first-hand experience, a genuine point of view, or a useful tool. Copying achieves parity at best, and parity rarely outranks an incumbent.

    How often should I do a competitor analysis? 

    A thorough analysis quarterly, with lighter monthly checks on your key commercial terms. Markets shift as competitors publish, earn links, and change strategy, but full analyses are time-consuming, and monthly repetition rarely surfaces enough change to justify it.

    Do I need paid tools for competitor analysis? 

    They make it faster, not possible. Manual SERP review, reading competitor content, and Google Search Console cover a lot for free. Paid tools like Ahrefs and Semrush mainly save time on keyword and backlink gap analysis, which is tedious by hand but not impossible.


    Want to know exactly who’s beating you and why? Book a free competitive audit. OptiSEOn is a Dallas-based SEO, AEO, GEO, and LLM optimization agency. We’ll map your real competitive set across Google and AI assistants, and show you the gaps worth closing first.

  • Free Backlink Profile Checker: See Your Links, and Whether They’re Improving

    Free Backlink Profile Checker: See Your Links, and Whether They’re Improving

    Most backlink tools answer one question: how many links do you have right now? That’s a snapshot, and a snapshot is a surprisingly weak thing to make decisions from.

    The question that actually matters is whether your profile is getting stronger. Are new referring domains arriving? Is quality improving or is the growth all low-value noise? Is too much of your authority concentrated in a handful of domains that could disappear? A single number can’t tell you any of that.

    So our free Backlink Profile Checker is built around progress rather than snapshots. It scores your profile out of 100, breaks down the quality mix and concentration risk, and shows you exactly what changed between checks.

    TL;DR

    A backlink profile checker analyses the links pointing to your site: how many referring domains you have, their quality mix, your spam score, and how concentrated your authority is. The free OptiSEOn Backlink Profile Checker scores all of this out of 100 and tracks progress between checks, so you can see whether your link building is actually working. No signup.

    → Run the free Backlink Profile Checker

    What is a backlink profile?

    Your backlink profile is the complete picture of links pointing to your site. This includes how many distinct domains link to you, their authority, topical relevance, and how links are distributed across your pages. Quality and distribution matter far more than raw link counts.

    The components that matter:

    • Referring domains: The number of distinct sites linking to you. This is far more meaningful than total link count, as 50 links from 50 sites build a stronger profile than 500 links from just 5 sites.
    • Quality mix: The spread of authority across your referring domains.
    • Spam score: The proportion of links coming from low-quality or spammy sources.
    • Concentration risk: How much of your overall authority relies on a small cluster of domains.
    • Growth trend: Whether your link profile is growing, holding steady, or losing ground.

    What does the OptiSEOn Backlink Profile Checker show?

    It returns your referring domains, link quality mix, spam score and concentration risk, scored out of 100, plus progress tracking that shows exactly what changed since your last check. Enter a domain and it runs; no signup required.

    Progress tracking is central to how this tool works. Effective link building takes time, as outlined in our link building guide. A single snapshot can’t show if a campaign is making steady progress or stalling out, but tracking changes over time clarifies your actual trajectory.

    Note on the data: like most free checkers, this tool uses third-party index data via an API rather than crawling the entire web directly. Because no backlink index is exhaustive and providers measure differently, treat absolute figures as estimates. The real value lies in tracking relative changes for the same domain over time using consistent data.

    Why do referring domains matter more than total backlinks?

    Search engines place much higher weight on unique websites linking to you than on total individual links. A hundred links from one site count as a single endorsement. Broad source diversity signals genuine authority.

    This is also why “we’ll build you 500 backlinks a month” offers are meaningless at best. Volume from a narrow set of low-quality sources doesn’t move the metric that matters, and in 2026 it carries real penalty risk. Google’s SpamBrain evaluates link patterns across your profile rather than links in isolation.

    What is concentration risk?

    Concentration risk measures how dependent your site is on a handful of referring domains. If a major share of authority comes from just three or four sites, losing any of them directly harms your profile. It evaluates profile vulnerability rather than raw quality.

    High concentration typically comes from a single viral piece picked up by one publisher network, a long-standing directory or partner relationship carrying most of your links, or an over-reliance on one guest-posting outlet. None of those are bad in themselves; depending on them is.

    The fix is straightforward and slow: diversify sources. Original research, digital PR, expert commentary, podcast appearances, and genuine community presence spread your profile across more domains.

    What is a good backlink profile score?

    There is no universal score to aim for. Look at your profile relative to competing sites ranking for your target terms, and focus on whether your score trends upward over time. Benchmarks vary widely by industry.

    Run the checker on your top three competitors alongside your own domain. That comparison tells you more than any score in isolation: if they have four times your referring domains, you know the gap you’re closing. If you’re comparable and still outranked, links aren’t your problem and you should look at content, technical health, or entity signals instead.

    Should I disavow links the checker flags as spammy?

    In most cases, no. Google advises against disavowing links unless you face a manual penalty or clear manipulation. Search engines generally ignore low-quality links automatically. Disavowing valid links risks removing genuine authority.

    Disavow when: you have a manual action for unnatural links, you previously bought links or used a PBN, or you’re facing a clear negative SEO attack. Otherwise, leave it alone and spend the effort earning better links instead.

    How does this fit with the rest of your SEO?

    Links are one input among several. A strong profile won’t rescue thin content, and a weak one won’t sink genuinely excellent content in a low-competition niche. Check your backlink profile alongside:

    • Domain Rating: A relative authority metric rather than an official ranking factor.
    • Entity signals: How clearly search engines and AI models identify your brand.
    • Core Web Vitals: Page performance and technical site health.
    • Content quality and structure: The foundational content that backlinks serve to amplify.

    For businesses that need authority built rather than measured, our citation and authority building service handles consistent listings and entity signals across 260+ platforms.

    Frequently Asked Questions

    How do I check my backlinks for free? 

    You can use a free backlink checker like OptiSEOn’s. Enter your domain to review referring domains, quality distribution, spam score, and concentration risk without creating an account. Google Search Console also provides a sample of indexed backlinks in its Links report.

    What’s the difference between backlinks and referring domains? 

    Backlinks are individual links, while referring domains are the distinct websites providing those links. Referring domains carry much more weight because multiple links from a single site act as one overall endorsement.

    How many backlinks do I need to rank? 

    There is no single target number. Compare your referring domain count against competitors ranking for your target terms to set a practical baseline.

    Why do different backlink tools show different numbers? 

    Each tool relies on its own web crawler and index. Crawl frequencies and filtering rules vary by provider, so treat raw counts as estimates and focus on performance trends over time.

    Should I remove or disavow bad backlinks? 

    Usually no. Google recommends disavowing links only if you have a manual penalty or clear evidence of unnatural link building. Most low-quality links are ignored automatically.

    How often should I check my backlink profile? 

    Checking monthly is sufficient for most sites since link profiles change gradually. Monitor more frequently during active outreach or PR campaigns when new link acquisition is expected.


    See where your backlink profile stands and track its progress over time. Run the free Backlink Profile Checker, then compare your domain against top competitors. If you need help closing the gap, book a free audit with our team.