Bulk URL cleaner: remove UTM parameters and duplicates
Link lists from different tools rarely match: the same page appears with tracking tags, with and without a slash, over http and https. Clean the list once before you check or submit it.
Your data stays in your browser. Nothing is uploaded or stored.
Key facts
- A URL with tracking parameters such as utm_source is a different address from the same URL without them.
- http and https, www and non-www, and a trailing slash each make a different URL.
- The #fragment part of a URL is not sent to the server.
- Google crawls sitemap URLs exactly as listed, so a clean list should use your canonical form.
Download the checklist: diagnosing indexing problems
Step by step: status in Search Console, page availability, robots.txt, noindex, canonical URL, redirects, sitemap and backlinks, with what to do in each case.
Download PDF PDF · 2 pagesHow to use it
- Paste your links or choose a file (TXT, CSV or any text export).
- Choose the options: tracking parameters, fragments, https, trailing slash and, if needed, a single domain to keep.
- Click Clean list.
- Check the counters and the per-domain table.
- Copy the result or download it as TXT or CSV.
Where to get the data
Backlink tools
Exports from Ahrefs, Semrush, Majestic or similar tools. The cleaner finds every http(s) address in the file, whatever the columns.
Search Console
Exports from the Links report, the Page indexing report or the Performance report.
Your own notes
Lists from spreadsheets, chats or documents. Lines without a protocol, such as example.com/page, are read as https.
Why clean before checking or indexing
Duplicates and tracking variants make a list longer without adding pages. Checking or submitting the same page under three addresses costs time and budget and gives confusing results.
Choosing the trailing slash option
Pick the form your site uses in canonical URLs. “Add” skips URLs that end in a file name such as .pdf or .html. If you're not sure, keep slashes as they are.
What the cleaner doesn't change
Paths and parameter values keep their case, because paths can be case-sensitive. Parameters other than tracking ones stay unless you choose to remove all of them.
Next step
With a clean list ready, check which of these URLs are indexed in one go.
Questions and answers
Which parameters count as tracking?
utm_* parameters, gclid, gclsrc, dclid, gbraid, wbraid, fbclid, msclkid, yclid, mc_cid, mc_eid, _ga, _gl, igshid and ref_src.
Does it check whether the URLs work?
No. It only cleans the text of the list. Status codes and index status need a crawler or an index checker.
How large a list can it handle?
It runs in your browser, so the limit is your device's memory. Lists of tens of thousands of lines are fine on a normal computer.
Can I keep only one site?
Yes. Enter the domain in “Keep only this domain”; subdomains of it are kept too.
Sources
- Build and submit a sitemap — Google Search Central: https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap
- RFC 3986: Uniform Resource Identifier (URI) syntax: https://www.rfc-editor.org/rfc/rfc3986