Extracts, parses, and edits URLs & domains, removes protocols, validates URIs, and builds disavow files.

Bulk URL to Domain Extractor, Parser, and Link Cleaner

INPUT DATA

Search Operators:
0 lines
Presets:
Domain Options# ignored with search
URL Options# ignored with search
# extract only matching lines
Output & Export Options
Other OptionsDomain / URL options ignored

FREQUENTLY ASKED QUESTIONS

Extracting Domains, Filtering & Formatting

What does URLtoDOMAIN do, and who is it for?

URLtoDOMAIN.com is a free bulk URL-to-domain extractor, link parser, and list cleaner. It parses domains, root domains, subdomains, and full paths from standard URI schemes (http://, https://, ftp://, ssl://, file://, and //), pulls links out of messy prose or raw HTML, validates hostnames and IPv4/IPv6 addresses, counts domain frequency, converts internationalized domains to or from Punycode (xn--), filters lines with keyword search operators, upgrades http:// to https://, and formats output for Google Search Console disavow files, Apache/LiteSpeed .htaccess referer rules, or single-quoted code arrays.

It is built for webmasters, SEO professionals, developers, site administrators, security analysts, and data researchers who need to clean thousands of links quickly—with one-click workflow presets and a Send to Input ↑ button for multi-step pipelines.

How does root domain vs. subdomain extraction work (Public Suffix List)?

By default, URLtoDOMAIN extracts the full host while stripping www. (for example, https://a.b.google.co.uk/search?q=test becomes a.b.google.co.uk). When you check Extract the root domain from subdomain, the parser trims subdomains down to the registrable root domain (google.co.uk) and drops entries without a recognized suffix.

Root-domain matching uses both ICANN and private suffixes from the official Public Suffix List (publicsuffix.org/list/public_suffix_list.dat), including multi-part and wildcard suffixes such as .co.uk, .com.au, and *.compute.amazonaws.com. You can also preserve www. or filter/ignore IPv4 and IPv6 addresses.

How do I extract URLs from messy text or raw HTML, and count domain frequency?

Check Extract URLs from messy text or raw HTML when pasting web page source, emails, server logs, or prose. Links (http(s)://, ftp://, protocol-relative //, and www.) are extracted directly in your browser before submission—stripping surrounding HTML tags and trailing punctuation, decoding & in query strings, and ignoring JavaScript // comments.

Combine extraction with Count occurrences & sort by frequency to tally how often each domain or URL appears, ranked highest first (for example, example.com (42)). Use Send to Input ↑ below the Results box to feed the output straight back into a second pass.

How does IDN / Punycode (xn--) conversion work?

Use the two Punycode checkboxes under Output & Export Options to convert internationalized domain names (IDNs) cleanly without altering URL paths, ports, or query strings:

- IDN → Punycode (xn--): Encodes Unicode hostnames into RFC 3492 / UTS #46 ASCII form (e.g., https://café.com/menu → https://xn--caf-dma.com/menu, łąka.pl → xn--ka-ola7v.pl)—required for Google Disavow files, .htaccess rules, and DNS/firewall lists.
- Punycode → Unicode: Decodes xn-- hostnames back into readable UTF-8 (e.g., xn--mnchen-3ya.de → münchen.de) for manual backlink reviews and audits.

How do string search operators (#=) work?

Click any operator chip above the input box—or type one directly on line 1—to filter lines before formatting:

#=contains:{STRING} — keeps lines containing the text anywhere
#=notcontains:{STRING} — keeps lines that do not contain the text
#=startswith:{STRING} — keeps lines starting with the text
#=notstartswith:{STRING} — keeps lines not starting with the text
#=endswith:{STRING} — keeps lines ending with the text
#=notendswith:{STRING} — keeps lines not ending with the text

Things to consider:

- The operator must be on the first line (only one operator per run).
- All string searches are case-insensitive and skip URL format validation.
- Domain Options and URL Options (except Extract URLs from messy text or raw HTML) are ignored during string search, while Output & Export Options (deduplicate, frequency count, lowercase, http:// to https://, Punycode, sort, .htaccess) and Other Options (delimiters, trailing slashes, quotes) still apply.

How do I clean delimited lists or build single-quoted arrays for SQL, PHP, or JavaScript?

Use the Other Options panel to manipulate raw lines without domain extraction or IP/URL validation:

- Space/tab, comma, or semicolon trimming: Strips everything after the first delimiter—ideal for pulling the first column out of server logs, CSV exports, or tab-separated tables.
- Trailing slashes: Normalize every line to either end with a single / or strip all trailing slashes.
- Single quotes + comma: Wraps each line as 'value', (without doubling existing quotes), ready to paste into SQL IN (...) clauses, PHP arrays, or JavaScript lists.

Google Disavow Files & .htaccess Blocking

How do I create a Google Search Console disavow file?

Export your incoming links from Google Search Console (Links → Top linking sites or External links), paste or drop the file above, and click the Google Disavow preset (checks Extract the root domain from subdomain, Add 'domain:', and Remove duplicates). If your list contains internationalized domains, also check IDN → Punycode (xn--). Download the UTF-8 .txt export to get clean domain:example.com lines (with any # comments preserved) ready for Google's Disavow Links tool, which supports UTF-8 .txt files up to 100,000 lines and 2 MB on URL-prefix properties.

Important: Always review links manually before uploading a disavow file and include only spammy or unnatural links—disavowing healthy links can hurt rankings. Note that Microsoft retired the Bing Webmaster Tools Disavow Links feature in October 2023, so disavow files apply to Google Search Console.

How do I block referral spam or unwanted backlinks with the .htaccess generator?

Click the .htaccess Block preset (or check Generate .htaccess HTTP_REFERER rules to deny backlinks) to convert extracted domains, subdomains, or URLs into ready-to-paste Apache/LiteSpeed rules. Add IDN → Punycode (xn--) if blocking internationalized referers. The tool escapes dots automatically, chains each entry with RewriteCond %{HTTP_REFERER} ... [NC,OR] (ending the final line with [NC]), and appends RewriteRule .* - [F] to return a 403 Forbidden response to matching referers. If your .htaccess does not already enable rewriting, uncomment RewriteEngine On in the generated header.

Limits, Privacy & About

Batch limits, auto-save, drag-and-drop, and .txt / .csv exports

There is no strict entry cap, though we recommend keeping each run under 200,000 lines (monitored by the live line counter above the input box) so processing stays fast and within server memory limits. You can drag and drop .txt, .csv, .log, or .html files directly onto the input box and press Ctrl+Enter (or Cmd+Enter) to submit.

Drafts up to 1 MB are auto-saved in browser sessionStorage so an accidental refresh will not lose your work, and automatically clear when you close the tab or click RESET. All output is UTF-8 encoded, ready to copy or download as .txt or .csv files before temporary exports are automatically and permanently deleted after several hours.

Why choose URLtoDOMAIN over other URL extractors?

Link lists often reveal client sites, internal paths, or sensitive campaigns. URLtoDOMAIN is built as a fast, zero-tracking utility so your data stays private:

ComparisonURLtoDOMAINOthers
Secure - HTTPS/TLS encryption; temporary export files automatically and permanently deleted✓⚠
Powerful - processes thousands of URLs in one run; supports multiple URI schemes, Public Suffix List root extraction, HTML extraction, frequency counts, Punycode, IPv4/IPv6, and string search✓⚠
Legally Protected - service based in the U.S. and bound by strong laws and regulations✓⚠
No Tracking - no third-party cookies, no external JavaScript, no embedded trackers✓⚠
No Conflict of Interest - we are not an SEO or data-mining company; we do not store, share, sell, or analyze your links✓⚠
URLtoDOMAIN Advantage✖
Reporting a parsing issue, Terms of Use & Privacy Policy

If a valid URL is parsed unexpectedly, click Report a problem below the Results box so we can inspect that edge case and improve the parser.

- Privacy: The tool is anonymous and does not permanently collect or store submitted URLs (except samples explicitly sent via the Report a problem link).
- Abuse prevention: Basic operational metrics (such as request counts or IP addresses) may be used to maintain service stability, and abusive automated traffic may be blocked.
- Contact: Questions, suggestions, or inquiries can be sent to info ~ urltodomain.com.