Get found, get measured

BeginnerDuration ~40 min hands-onTools Google Search Console, Your site’s XML sitemap, GA4

Why this lesson

The most common way beginners waste months is heartbreakingly simple: they pour effort into a page that search engines can’t see, can’t store, or can’t measure — and then tune titles and keywords wondering why nothing moves. The page was stuck at crawl or index the whole time. So before you optimize anything, you run a five-step setup recipe that guarantees your pages are findable and trackable. This is deliberately the first thing you do in Level 1, at recipe depth — the theory of technical SEO comes back properly in Level 2. Get this right and every later lesson pays off; skip it and every later lesson is invisible.

The explainer

Think back to the pipeline: crawl → index → rank → cite. This lesson bolts down the first two stages and turns on measurement so you can watch the rest. Five steps.

Step 1 — Confirm the page is indexable. Two things quietly block pages. The first is robots.txt, a file at yourdomain.com/robots.txt that tells crawlers where they may and may not go; a stray Disallow can wall off a whole section. The second is a noindex instruction (a meta robots tag or HTTP header) that says “crawl me, but never put me in the index.” Both are legitimate tools used deliberately — and both, left over from a staging site or a template default, are among the top reasons a page vanishes. Your job: make sure the pages you want found are neither disallowed nor noindexed.

Step 2 — Check it’s actually indexed. In Search Console, use the URL Inspection tool: paste your page’s URL. It tells you plainly whether the URL is on Google, and if not, why. If it’s not indexed, you can click Request indexing to push it into the queue. This one tool ends more “why am I invisible?” panics than anything else in SEO. Make checking it a reflex.

Step 3 — Give Google a map: the XML sitemap. An XML sitemap is a machine-readable list of the URLs on your site you want crawled. Most site platforms generate one automatically (often at /sitemap.xml); if yours doesn’t, a plugin or your CMS setting will. Submit its URL once in Search Console under Sitemaps. A sitemap doesn’t force rankings — it just makes sure nothing gets missed, which matters most for new or large sites.

Step 4 — Make sure a human can navigate to it too. Crawlers find pages by following links. A page that no menu, no other page, and no sitemap points to is an orphan — technically live, practically undiscoverable. Confirm every important page is reachable by clicking from your homepage in a few hops. (We go deep on internal linking in 1.5.)

Step 5 — Turn on measurement. Confirm GA4 is firing on the page (its realtime report should tick up when you visit), and confirm the page shows up in Search Console’s Performance report once it’s had a few days to gather impressions. From now on, GSC is your scoreboard: impressions mean you’re being shown, clicks mean you’re being chosen, average position tells you where. No measurement, no learning.

Run these five in order on the page you plan to rank in this level’s capstone. When all five pass — indexable, indexed, in the sitemap, reachable, and measured — you have a page that can win. Everything from Lesson 1.2 onward is about making it win. This recipe is also your first diagnostic muscle: whenever a page underperforms for the rest of your career, you’ll start here, at crawl and index, before you touch content.

Do it

On your practice site, on the specific page you’ll use for the capstone:

1. Open yourdomain.com/robots.txt and skim it. Is anything you care about being Disallowed? Note it.
2. In Search Console, run URL Inspection on the page. Is it indexed? If not, read the reason and Request indexing.
3. Find your XML sitemap (try /sitemap.xml), and confirm it’s submitted under Sitemaps in GSC. Submit it if not.
4. Starting from your homepage, try to reach the page by clicking links. If you can’t, it’s an orphan — make a note to link to it in 1.5.
5. Visit the page yourself and confirm GA4 realtime registers you. Then open GSC Performance and bookmark it — this is your scoreboard for the level.
6. Fill in the setup checklist in the Level 1 workbook below.

Level 1 workbook — every Do-it as a checklist, plus the capstone brief, rubric & sign-offlevel-1-workbook.pdf150 KBOriginal course material — free to use

Terms introduced

Terms introduced in this lesson

• Indexable
• robots.txt
• noindex
• URL Inspection
• XML sitemap
• Orphan page
• Impressions

Each term links to the glossary, where it is defined by the way you just used it.

Check

Check yourself

1. You publish a great page but it gets zero Google traffic for weeks. What should you check FIRST?

   Whether your title tag has enough keywordsWhether the page is indexed (use the URL Inspection tool in Search Console)Whether your competitors are cheatingWhether you have enough backlinks

2. What does a robots.txt "Disallow" or a "noindex" tag do that can silently kill a page?

   Adds the page to Google instantlyImproves the page’s rankingMakes the page load fasterTells search engines not to crawl (robots.txt) or not to index (noindex) the page — so it never appears in results

3. Why submit an XML sitemap to Search Console?

   It forces a #1 rankingIt gives Google a clean list of the URLs you want crawled and indexed, speeding discoveryIt replaces the need for contentIt hides pages from competitors

Check answers

You can move on when you can… take any page and confirm, using Search Console, that it is indexable, indexed, in the sitemap, reachable by links, and tracked in GA4 — and know which step to check first when a page gets no traffic.

Mark this lesson complete

Go deeper

• Google Search Central — “Ask Google to recrawl your URLs”: the official note on URL Inspection and requesting indexing.
• Next: 1.2 · Keywords & search intent — now that your page can be found, decide what it should try to be found for.