How to Get All Page URLs From a Website

Updated 2026-08-08 · By the MakeToolz team

Quick answer: The fastest ways to get every URL on a website are to open its sitemap at /sitemap.xml, run a Google site search (site:example.com), or paste a page's links into a free URL extractor to pull them all at once. For a whole site, the sitemap is usually the most complete list.

You might need a full URL list to audit a site, plan a redirect map, check your own pages, or research a competitor. Here are five free ways to do it, from the one-second trick to the full crawl, with no software to install.

1. Check the sitemap (fastest and most complete)

Most sites publish a sitemap, a machine-readable list of every page they want found. Try these addresses in your browser:

The robots.txt file at example.com/robots.txt usually lists the sitemap location at the bottom too. A sitemap is the closest thing to an official, complete URL list, since the site owner built it on purpose. If it is an index file, it links to smaller sitemaps you can open one by one.

2. Use a Google site search

Type site:example.com into Google and it lists the pages Google has indexed for that domain. Add a folder to narrow it, like site:example.com/blog/. This shows what is actually in Google's index rather than every page that exists, which makes it great for spotting which pages rank and which are missing.

3. Extract every link on a page

To pull all the links from a single page, such as a blog archive, a category, or a sitemap that lists URLs as clickable links, copy the page and paste it into a free URL extractor. It scans the text and returns a clean, de-duplicated list of every URL, ready to copy. This is the quickest way to turn a messy page into a plain list without writing code.

4. View the HTML source

On any page, press Ctrl+U on Windows or Cmd+Option+U on Mac to see the raw HTML. Every link sits inside an href="..." attribute. You can press Ctrl+F and search for href to scan them, or select all the source, paste it into the URL extractor, and let it pull the links out for you.

5. Crawl the whole site with a free tool

For a genuinely complete list of a large site, a crawler visits every page and follows every link, the way Google does. Desktop crawlers like Screaming Frog, which is free up to 500 URLs, do exactly this. A crawl catches pages that are linked but missing from the sitemap, which is what you want for a full audit.

Which method should you use?

People Also Ask

How do I find all the pages on a website?

Open the site's sitemap at /sitemap.xml for the owner's own list, or search site:example.com in Google to see indexed pages. For the links on a single page, paste it into a free URL extractor to get them all at once.

What is a sitemap and where is it?

A sitemap is a file listing a site's pages so search engines can find them. It usually lives at /sitemap.xml or /sitemap_index.xml, and its location is often noted at the bottom of the site's robots.txt file.

How do I get a list of URLs from a web page?

Copy the page, or its HTML source via Ctrl+U, and paste it into a URL extractor. The tool finds every href link, removes duplicates, and gives you a clean list you can copy in one click, with no coding.

Does site:example.com show every page?

No, only the pages Google has indexed, which can be fewer than the site intends. It is great for seeing your search presence, but the sitemap or a full crawl gives a more complete picture.

How can I extract URLs without any software?

Use the sitemap and a Google site search in your browser, then paste any page of links into a browser-based URL extractor. All three run online with nothing to install, which covers most needs without a desktop crawler.

How do I get all URLs from my own website?

Start with your sitemap, which your CMS or SEO plugin generates automatically. Cross-check it against Google Search Console's Pages report and a quick crawl to catch any pages that are live but missing from the sitemap.

Have a page full of links to turn into a list? Paste it into the free URL Extractor to pull every URL instantly, de-duplicated and ready to copy. You can also grab just the email addresses from any text the same way.

Related guides