Bulk URL to Domain Extractor, Link Parser & Text List Cleaner
Extracting Domains, Filtering & Formatting
What does URLtoDOMAIN do, and who is it for?
URLtoDOMAIN.com is a free bulk URL-to-domain extractor, link parser, and list cleaner. It parses domains, root domains, subdomains, and full paths from standard URI schemes (http://, https://, ftp://, ssl://, file://, and //), pulls links out of messy prose or raw HTML, strips ?query strings and #fragments, validates hostnames and IPv4/IPv6 addresses, counts domain frequency, converts internationalized domains to or from Punycode (xn--), filters lines with keyword search operators, upgrades http:// to https://, decodes percent-encoded URLs, strips HTML tags/entities, bullets/numbering, and extra whitespace, and formats output for Google Search Console disavow files, Apache/LiteSpeed .htaccess referer rules, or single-quoted code arrays.
It is built for webmasters, SEO professionals, writers, editors, developers, security analysts, and researchers who need to clean thousands of links or text lines quickly—with one-click workflow presets and a Send to Input ↑ button for multi-step pipelines.
How does root domain vs. subdomain extraction work (Public Suffix List)?
By default, URLtoDOMAIN extracts the full host while stripping www. and validating the TLD against the Public Suffix List (so https://a.b.google.co.uk/search?q=test becomes a.b.google.co.uk, while typos like .htm are dropped). When you check Root domain only (strip subdomains), the parser trims subdomains down to the registrable root domain (google.co.uk).
Matching uses both ICANN and private suffixes from Mozilla's official Public Suffix List (publicsuffix.org/list/public_suffix_list.dat), including multi-part and wildcard suffixes such as .co.uk, .com.au, *.compute.amazonaws.com, wordpress.com, and googleapis.com—so shared platform hosts like site.wordpress.com or fonts.googleapis.com keep their platform subdomain (preventing accidental disavows of an entire shared host). You can also preserve www. or filter/ignore IPv4 and IPv6 addresses.
How do I extract URLs or bare domains from messy text or raw HTML?
Use Extract valid domains / subdomains from messy text to pull bare and linked domains out of tables, logs, prose, or HTML (even without http:// or www., and even glued inside non-Latin text). Use Extract URLs from messy text or raw HTML to pull explicit links (http(s)://, ftp://, //, and www.) directly in your browser—stripping HTML tags and trailing punctuation, decoding &, and ignoring JS // comments.
By default, Extract URLs from messy text or raw HTML keeps the full PSL-validated URLs (including protocol, www., and path); pair with Strip ?query strings & #fragments, Remove ONLY the protocol, or the http:// / https:// filters to refine them, or pair with any Domain Option (Root domain only, Keep 'www.', Add 'domain:' prefix, Keep the protocol with extracted host) or .htaccess to convert extracted links into domains. Add Count occurrences & sort by frequency to tally occurrences (e.g. example.com (42)), or click Send to Input ↑ below Results for multi-step pipelines.
How does IDN / Punycode (xn--) conversion work?
Use the two Punycode checkboxes under Output & Export Options to convert internationalized domain names (IDNs) cleanly without altering URL paths, ports, or query strings:
- IDN → Punycode (xn--): Encodes Unicode hostnames into RFC 3492 / UTS #46 ASCII form (e.g., https://café.com/menu → https://xn--caf-dma.com/menu, łąka.pl → xn--ka-ola7v.pl)—required for Google Disavow files, .htaccess rules, and DNS/firewall lists.
- Punycode → Unicode: Decodes xn-- hostnames back into readable UTF-8 (e.g., xn--mnchen-3ya.de → münchen.de) for manual backlink reviews and audits.
How do string search operators (#=) work?
Click any operator chip above the input box—or type one directly on line 1—to filter lines before formatting:
#=contains:{STRING} — keeps lines containing the text anywhere#=notcontains:{STRING} — keeps lines that do not contain the text#=startswith:{STRING} — keeps lines starting with the text#=notstartswith:{STRING} — keeps lines not starting with the text#=endswith:{STRING} — keeps lines ending with the text#=notendswith:{STRING} — keeps lines not ending with the text
Things to consider:
- The operator must be on the first line (only one operator per run).
- All string searches are case-insensitive and skip URL format validation.
- Domain Options and URL Options (except Extract valid domains / subdomains from messy text—plus its compatible Root domain only, Keep 'www.', and Add 'domain:' prefix options when checked—Extract URLs from messy text or raw HTML, and Strip ?query strings & #fragments) are dimmed and ignored during string search, while Output & Export Options (deduplicate, frequency count, lowercase, http:// to https://, Punycode, sort, remove comments, .htaccess) and Other Options (URL decoding, HTML/bullet/space cleanup, delimiters, trailing slashes, quotes) still apply—for example, you can filter specific HTML lines with #=contains: and strip their tags in one pass.
How do I clean text lists, decode URLs, strip HTML/bullets, or build quoted arrays?
Use the Other Options panel to clean and reshape raw lines without domain extraction or IP/URL validation (and combine freely with deduplication, frequency counting, sorting, or #= search):
- Decode URL encoding: Safely decodes percent-encoded UTF-8 sequences (such as %20 or %C5%81%C3%B3d%C5%BA → Łódź) without turning + signs into spaces or injecting control characters.
- Strip HTML tags & decode entities: Removes <script>/<style> blocks, HTML comments, and tags while separating block/table cells cleanly and decoding HTML entities (&, ", )—ideal for extracting plain anchor text, headings, or CMS copy.
- Strip leading bullets & numbering: Removes list prefixes pasted from Word, Docs, PDFs, or Markdown (1., 2), 1.2., (a), IV., -, *, •, - [x]) without touching dates, decimals, or negative numbers.
- Collapse extra spaces & tabs: Normalizes multiple spaces, tabs, and Unicode spaces into a single space per gap.
- Space/tab, comma, or semicolon trimming: Strips everything after the first delimiter—ideal for pulling the first column out of server logs, CSV exports, or tab-separated tables.
- Trailing slashes & single quotes + comma: Normalize trailing / slashes or wrap each line as 'value', (without doubling existing quotes) for SQL IN (...) clauses, PHP arrays, or JavaScript lists.
Google Disavow Files & .htaccess Blocking
How do I create a Google Search Console disavow file?
Export your incoming links from Google Search Console (Links → Top linking sites or External links), paste or drop the file above, and click the Google Disavow preset (checks Root domain only, Add 'domain:' prefix, and Remove duplicates—preserving any existing domain: lines too). If your list contains internationalized domains, also check IDN → Punycode (xn--). Download the UTF-8 .txt export to get clean domain:example.com lines (with any # comments preserved, or strip them via Remove '#' comment lines) ready for Google's Disavow Links tool, which supports UTF-8 .txt files up to 100,000 lines and 2 MB on URL-prefix properties.
Important: Always review links manually before uploading a disavow file and include only spammy or unnatural links—disavowing healthy links can hurt rankings. Note that Microsoft retired the Bing Webmaster Tools Disavow Links feature in October 2023, so disavow files apply to Google Search Console.
How do I block referral spam or unwanted backlinks with the .htaccess generator?
Click the .htaccess Block preset (or check Generate .htaccess HTTP_REFERER rules to deny backlinks) to convert extracted domains, subdomains, or URLs into ready-to-paste Apache/LiteSpeed rules. Add IDN → Punycode (xn--) if blocking internationalized referers. The tool escapes regex metacharacters automatically, chains each entry with RewriteCond %{HTTP_REFERER} ... [NC,OR] (ending the final line with [NC]), and appends RewriteRule .* - [F] to return a 403 Forbidden response to matching referers. If your .htaccess does not already enable rewriting, uncomment RewriteEngine On in the generated header.
Limits, Privacy & About
Batch limits, auto-save, drag-and-drop, and .txt / .csv exports
There is no strict entry cap, though we recommend keeping each run under 200,000 lines (monitored by the live line counter above the input box) so processing stays fast and within server memory limits. You can drag and drop .txt, .csv, .log, or .html files directly onto the input box (files 2 MB and larger switch to fast Direct File Mode automatically) and press Ctrl+Enter (or Cmd+Enter) to submit.
Drafts up to 1 MB are auto-saved in browser sessionStorage so an accidental refresh will not lose your work, and automatically clear when you close the tab or click RESET. All output is UTF-8 encoded, ready to copy or download as .txt or .csv files (with large on-page previews capped at 50,000 results while exports always contain 100% of your data) before temporary exports are automatically and permanently deleted after several hours.
Why choose URLtoDOMAIN over other URL extractors?
Link lists often reveal client sites, internal paths, or sensitive campaigns. URLtoDOMAIN is built as a fast, zero-tracking utility so your data stays private:
| Comparison | URLtoDOMAIN | Others |
|---|---|---|
| Secure - HTTPS/TLS encryption; temporary export files automatically and permanently deleted | ✓ | ⚠ |
| Powerful - processes thousands of URLs in one run; supports multiple URI schemes, Public Suffix List root extraction, HTML/domain extraction, URL decoding, HTML/bullet/space cleanup, query stripping, frequency counts, Punycode, IPv4/IPv6, and string search | ✓ | ⚠ |
| Legally Protected - service based in the U.S. and bound by strong laws and regulations | ✓ | ⚠ |
| No Tracking - no third-party cookies, no external JavaScript, no embedded trackers | ✓ | ⚠ |
| No Conflict of Interest - we are not an SEO or data-mining company; we do not store, share, sell, or analyze your links | ✓ | ⚠ |
![]() | ✖ | |
Reporting a parsing issue, Terms of Use & Privacy Policy
If a valid URL is parsed unexpectedly, click Report a problem below the Results box so we can inspect that edge case and improve the parser.
- Privacy: The tool is anonymous and does not permanently collect or store submitted URLs (except samples explicitly sent via the Report a problem link).
- Abuse prevention: Basic operational metrics (such as request counts or IP addresses) may be used to maintain service stability, and abusive automated traffic may be blocked.
- Contact: Questions, suggestions, or inquiries can be sent to info ~ urltodomain.com.
