webfilteringdatabase.com
Home Find Your Solution
Features
Domain Categorization API Real-Time Classification 58 Filtering Categories Offline Database (120M) SaaS App Hostnames Managed DNS Filter ML Classification Content Classification
Industries
K-12 Schools Corporate Healthcare Government ISPs
Tools
Domain Lookup Bulk Categorization Category Explorer
Resources
Pricing API Documentation Login / Sign Up
Reference, A to Z

Web Filtering Glossary: 150+ Terms Explained

This web filtering glossary defines the words used by the people who build, sell and run web filters, from DNS filtering and SNI to delta files and OEM licences. Each entry is two or three short sentences, written for product managers, engineers and IT admins.

Search the list, pick a group, or jump to a letter. Where a term has its own guide on this site, the entry links to it.

Go to the A to Z list

Browse by group

From vocabulary to a data file

The category terms in this glossary are columns in the database we license

Most of these words describe what a filter does, and almost every filter depends on one thing it rarely builds alone: a category for each domain. Product teams take that layer from us as files, an offline database or a real-time API.

  • Category, taxonomy and multi-category fields arrive ready to load into your stack.
  • Daily delta files add the domains categorized since the last delivery.
  • The data runs inside your own systems, on-premise or fully offline.
Records from the web filtering database with several ranked categories per domain
58
categories, each with its own definition
120M+
domains carrying at least one label
300,000
fresh domains categorized on a typical day

How the terms fit together

Web filtering words belong to five layers, from the rules on paper down to the category data underneath. Results flow back up as logs and corrections, which is how a policy improves over time.

1

Rules and law

What must be blocked, logged and reviewed
3

Enforcement points

Where each allow or block decision is made
4

What the filter can see

Visibility sets the ceiling on precision
5

Category data underneath

The labels every layer above relies on

Results and feedback

Every layer is judged by what users actually hit. These terms describe the evidence that sends changes back into policy and data.

Feeds back into layers 2 and 5

One request, five checkpoints

  1. Step 1The device looks up the nameA DNS filter can refuse the answer here, seeing only the domain.
  2. Step 2The TLS handshake names the siteA firewall reads the SNI, unless ECH hides it.
  3. Step 3A gateway may decryptWith inspection the full URL and page become visible.
  4. Step 4The category is looked upFrom a local copy of the data, or a lookup API for new names.
  5. Step 5Allow, block, warn or logThe user sees the page, a block page or a soft block.

Web filtering terms A to Z

Type any word to filter the list as you go, or choose a group. Coloured edges show the group: blue for methods, navy for threats, teal for data, green for compliance and slate for business.

Showing all terms

A

Acceptable use policy (AUP)also: internet use policyCompliance

A written set of rules that says how staff, students or guests may use the network and the web. The filter is the technical part that enforces whatever in it can be checked by domain or category.

Write the policy first and map it to categories second, or the filter ends up writing the policy by accident.

AccuracyData

The share of domains whose category matches what a careful human reviewer would choose. One headline number hides a lot, so serious buyers ask for it per category and per popularity band.

Precision and recall, further down, split accuracy into the two errors a filter actually feels.

Ad blockingMethod

Refusing requests to advertising and tracking domains, usually at DNS or in the browser. It speeds up pages and closes one route for malicious ads.

AI tools categoryalso: AI / LLM ToolsData

The category for chatbots, writing and coding assistants, image generators and other AI services. Our set covers 11,800+ AI-tool domains in 18 categories and 165 subcategories, updated daily.

It lets a policy allow approved AI tools and block the rest; see the AI and LLM tools category.

Air-gapped deploymentBusiness

Running a filter and its data on a network with no connection to the internet at all. The category data then has to arrive as files copied in on a schedule, never as live cloud lookups.

Allow listalso: allowlist, whitelistMethod

A list of domains or URLs that are always permitted, whatever their category says. It sits above category rules and is the usual fix when a needed site is blocked.

Every entry is a small hole in the policy, so keep the list short and reviewed; see how to import allow and block lists.

Anonymizeralso: proxy avoidance siteThreat

A website or app built to hide where a user is browsing, usually by relaying traffic through another server. Filters treat anonymizers as high risk, because one working anonymizer defeats the whole policy.

Application controlMethod

Identifying specific applications and their functions, for example allowing a chat app while blocking its file transfers. It complements URL categories, which work at the level of whole sites.

Audit trailCompliance

A record of who changed the filter policy, when, and what exactly changed. Schools, regulated firms and MSPs use it to show that the policy on paper matched the policy in force.

B

Block listalso: blocklist, deny list, blacklistMethod

A list of domains, URLs or IP addresses that the filter always refuses. Lists are exact and easy to audit, but they only know the entries someone has added.

They come in several file formats, compared in our guide to blocklist formats.

Block pageMethod

The page a user sees in place of a refused site, usually naming the category and offering a way to ask for a review. For HTTPS sites a DNS filter can only show it if the device trusts the filter's certificate; otherwise the browser shows a connection error.

BotnetThreat

A group of infected devices that an attacker controls remotely and uses for spam, fraud or attacks. Blocking botnet domains stops infected machines from receiving orders, even when the infection itself was missed.

Browser extension filterMethod

A web filter that runs inside the browser and sees the full URL of every page. It suits managed browsers but misses traffic from other apps on the same device.

Browser isolationalso: remote browser isolation, RBIMethod

Loading risky pages in a remote, throwaway browser and sending the user only a safe rendering. Category data decides which sites are isolated, which open normally and which are refused outright.

Bulk lookupData

Sending many domains in one request or file and receiving their categories back as a batch. Teams use it to label logs, clean lists or profile a new customer's traffic before go-live.

BYODbring your own deviceMethod

Personal phones and laptops that join an organisation's network. They rarely accept certificates or agents, so DNS filtering and SNI checks are the main controls for them.

Bypass codealso: staff override, PIN bypassMethod

A short-lived permission that lets a trusted person open a blocked site, such as a teacher researching a topic. Good designs log every use and switch the block back on by themselves.

C

C2command and controlThreat

The servers that malware calls home to for instructions and to hand over stolen data. Blocking C2 domains at DNS can cut off an infection that endpoint tools did not catch.

Captive portalMethod

The web page a guest network shows before it grants access, often to accept terms or enter a code. The filter must allow the portal and everything it loads, or guests cannot get online at all.

CASBcloud access security brokerMethod

A control point between users and cloud services that shows which apps are in use and what data moves to them. It works best with a dependable record of which domains belong to which kind of service.

CategoryData

A label that says what a website is about, such as Gambling or News/Media. Policies are written in categories because nobody can list millions of sites by hand.

Our taxonomy has 58 of them, listed on the web filtering categories page.

Category-based blockingMethod

Blocking or allowing sites by their category instead of by name. One rule covers every site in the category, including sites that went live yesterday.

Setups for common devices are in how to block websites by category.

Category mappingData

A table that translates one set of categories into another, for example from a data supplier's labels into the names a product already shows. Good mappings record one-to-many cases instead of forcing a single match.

CDNcontent delivery networkData

Servers around the world that cache and deliver content for many sites at once. CDN hostnames carry traffic for unrelated sites, so they need careful labels rather than one blanket block.

Certificate pinningMethod

An app setting that accepts only one specific certificate for its server. Pinned apps break under TLS inspection, so they go on the decryption exemption list.

CIPAChildren's Internet Protection ActCompliance

A US law that ties E-Rate discounts and certain library funding to an internet safety policy and a technology protection measure. The measure must block or filter visual depictions that are obscene, child pornography or harmful to minors on computers used by minors.

The categories that matter are covered on our CIPA web filtering page.

CNAME cloakingThreat

A tracking trick where a third-party tracker is served from a subdomain of the site being visited, linked by a DNS alias. Filters that judge only the first name in a lookup miss it, so they should also check where the alias leads.

Content filteringMethod

The wider practice of controlling what reaches users, by address, by page content, by file type or in search results. URL filtering and DNS filtering are its most common forms.

Content inspectionalso: content-based filtering, dynamic analysisMethod

Deciding by reading the page itself, its words, images or scripts, at the moment it loads. It catches pages a database has never seen, at a cost in speed and with more false positives.

CoverageData

The share of real requests for which the database returns a category. Coverage measured on live traffic matters more than the raw number of domains in a file.

Our 120 million domains include the 20 million most visited, which account for 99.99% of web traffic.

Cryptojackingalso: unauthorised cryptominingThreat

Using someone else's device to mine cryptocurrency without consent, often through a script on a web page. Blocking mining pools and script hosts stops the drain on processors and batteries.

CSV, JSON and ParquetData

Three common file formats for category data: CSV for simple tables, JSON for nested records and Parquet for fast analytics on very large files. Pick the one your pipeline already reads well.

D

Data loss prevention (DLP)Method

Controls that stop sensitive data leaving the organisation through uploads, pastes, email or file sharing. URL categories tell DLP which destinations are personal storage, AI tools or file sharing.

More in URL category data for DLP.

Data processing agreement (DPA)Compliance

A contract that sets out how a supplier handles personal data on a customer's behalf. GDPR expects one when a filtering service stores or processes the browsing logs of a customer's users.

Deep packet inspection (DPI)Method

Examining the contents of network packets beyond their headers to recognise applications or threats. It is the engine behind application control in many firewalls.

Default actionalso: allow by default, deny by defaultMethod

What the filter does with traffic that no rule matches. Most web policies allow by default and block chosen categories, while high-security networks reverse that.

Delta filealso: incremental updateData

A file that holds only what changed since the last delivery: new domains, changed categories and removals. Daily deltas keep a product current without reloading the whole database.

Ours carry about 300,000 new domains a day; see real-time URL classification.

DfE filtering and monitoring standardsCompliance

Standards from the Department for Education in England that describe good filtering and monitoring in schools and colleges. They cover named roles, regular reviews, blocking harmful content without unreasonable overblocking, and effective monitoring.

They are revised from time to time, so check the current version.

DGAdomain generation algorithmThreat

Code in malware that produces large numbers of random-looking domain names, so the attacker only needs to register a few of them. Defenders spot it by the pattern of the names and by how new and unvisited they are.

DNS filter agentalso: roaming clientMethod

A small program on a laptop or phone that sends DNS lookups to the filter even away from the office network. It also stops the device from quietly switching to another resolver.

DNS filteringalso: DNS blocking, DNS content filteringMethod

Filtering at the moment a device looks up a domain name, by refusing or redirecting answers for blocked categories. It is fast and covers every app, but it sees only the domain, never the full URL.

What is DNS filtering explains the method in depth.

DNS over HTTPS (DoH)Method

DNS lookups carried inside encrypted HTTPS traffic, standardised as RFC 8484. It protects privacy, but it lets browsers and apps skip the network's filtering resolver.

How admins keep control is covered in DNS over HTTPS and web filtering.

DNS over TLS (DoT)Method

Encrypted DNS on its own port, 853, defined in RFC 7858. Because the port is dedicated, a network can allow or block it far more easily than DoH.

DNS resolveralso: recursive resolverMethod

The server that answers a device's DNS questions by asking other servers on its behalf. A filtering resolver adds one step: check the category, then answer or refuse.

DNS sinkholeMethod

A resolver rule that answers lookups for bad domains with a harmless address instead of the real one. Security teams also use sinkholes to spot which devices keep trying to reach known threats.

Domain categorizationalso: website categorization, URL classificationData

Assigning one or more categories to a domain so that policies, reports and analytics can use it. Done well, it is reviewed, validated and refreshed, because sites change.

Lookups by API are described on the domain categorization API page.

Domain frontingThreat

Hiding the real destination of a connection behind the name of an allowed, popular service, so the visible name and the real host differ. Many large providers now refuse the practice, but filters should still not trust a name alone.

Drive-by downloadThreat

Malware that installs itself when someone merely visits a page, usually through a browser or plug-in flaw. Blocking compromised and malicious domains is the first line of defence.

Dynamic DNS (DDNS)Threat

A service that keeps a name pointed at an address that changes often, such as a home connection. It has honest uses, but attackers like it for short-lived infrastructure, so many policies treat it as a risk signal.

E

E-RateCompliance

The US Schools and Libraries Universal Service Support program, which discounts internet access and network costs for eligible schools and libraries. Applicants that take discounts for internet access or internal connections must comply with CIPA.

ECHEncrypted Client HelloMethod

A TLS extension that encrypts the site name a browser sends when it opens a secure connection, published by the IETF as RFC 9849 in 2026. Where it is in use, network filters lose the SNI signal and must rely on DNS, endpoints or inspection.

EDLexternal dynamic listMethod

A plain text list of domains, URLs or IPs hosted at a web address that a firewall fetches on a schedule. The list can change without anyone editing the firewall rules.

Egress filteringMethod

Controlling which outbound connections may leave a network, not only which may come in. Category data turns egress rules from long address lists into policy people can read.

Endpoint filteringalso: agent-based filteringMethod

Filtering performed on the device itself, by an agent, a profile or the browser. It keeps working on home and public networks where no gateway sits in the path.

Enterprise browseralso: secure browserMethod

A browser built or locked down for company use, with rules for uploads, pastes, downloads and site access. It sees full URLs and page actions, so category data can drive very fine rules.

Explicit proxyMethod

A proxy that devices are told to use by name, through settings, a PAC file or WPAD. It sees each request clearly but depends on every device being configured.

F

Fail open, fail closedMethod

What a filter does when it cannot reach its policy or data: let traffic through (fail open) or stop it (fail closed). Schools often choose closed for safety, while businesses often choose open for uptime.

False negativeData

A harmful or out-of-policy site that the filter lets through because its category is wrong or missing. Users rarely report these, so they are found by testing.

False positiveData

A legitimate site that the filter blocks because of a wrong category or an overbroad rule. Each one costs a helpdesk ticket and a little trust in the filter.

Fast fluxThreat

A hosting trick where a domain's addresses change every few minutes across many compromised machines. Blocking by domain name works far better than chasing the moving addresses.

FCC Forms 486 and 479Compliance

Form 486 is where a school or library confirms that services have started and certifies its CIPA status for E-Rate. Form 479 is the matching CIPA certification that consortium members give to their consortium lead.

Forward proxyMethod

A server that makes web requests on behalf of users, so it can see, log and filter them. A secure web gateway is a forward proxy with security features added.

FQDNfully qualified domain nameData

A complete host name such as mail.example.com, spelled out all the way to the top of DNS. Category data may be stored per FQDN, per registered domain, or both.

Full refreshalso: snapshotData

A complete replacement copy of the database rather than a list of changes. A common pattern is a monthly full refresh with daily deltas applied in between.

G

GDPRGeneral Data Protection RegulationCompliance

The EU data protection law, under which browsing logs linked to a person count as personal data. A filter needs a lawful basis, a clear purpose and a retention limit for those logs.

A domain category file holds no personal data, which keeps the data supply itself simple.

Group licenceBusiness

A licence that lets a company with several products or subsidiaries use one copy of the data across all of them. It replaces a stack of separate contracts with one set of terms.

Guest Wi-Fi filteringMethod

Filtering on visitor networks in hotels, cafes, clinics and offices, usually at DNS. Its main jobs are keeping illegal and adult content off the network and protecting the venue's name.

H

Harmful to minorsCompliance

A CIPA term for visual material that is sexual in nature, patently offensive for minors and lacking serious value for them. Filters address it mainly through adult content categories.

Homograph attackThreat

A fake domain that swaps in look-alike characters from other alphabets so it reads like a trusted brand. Browsers and filters counter it by showing or checking the encoded form of the name.

HostnameData

The name of one specific service, such as www or api in front of the domain. Categorizing at hostname level lets a shared platform carry different labels for different services.

Hosts fileMethod

A local file that maps names to addresses before DNS is asked at all. Pointing a domain at 0.0.0.0 in it blocks that domain on that one device.

I

IAB Content TaxonomyData

An industry standard set of content categories used mainly in advertising, with 703 categories in version 3. Our database delivers it next to the 58 web filtering categories, in the same file.

Field layouts are on the taxonomy reference page.

IDNinternationalized domain nameData

A domain written with characters beyond basic Latin, such as accented letters or other scripts. Under the hood it is stored in an encoded ASCII form, and that form is what filters should compare.

Indicator of compromise (IOC)Threat

Evidence that a system may be compromised, such as a domain, address or file hash seen in an attack. Domain indicators become far more useful when they carry a category and an age.

Inline deploymentversus out-of-bandMethod

A filter placed directly in the traffic path, able to stop a request before it completes. Out-of-band tools only watch copies of traffic, so they can report but not block.

Internal licencealso: internal use licenceBusiness

A licence to use the data inside your own organisation, for your own network, analytics or security. It does not cover shipping the data to customers inside a product.

Internet safety policyCompliance

The written policy CIPA requires from schools and libraries, covering topics such as access to inappropriate material, safety in email and chat, unlawful activity and minors' personal information. It must be adopted after public notice and at least one public meeting or hearing.

IP-based blockingMethod

Blocking by network address rather than by name. It is blunt on the modern web, where one address can serve thousands of unrelated sites behind a CDN.

ISP-level filteringMethod

Filtering run by the internet provider, for all customers or only those who opt in, such as family plans. It works at very high volume, so lookups must be local and fast.

K

KCSIEKeeping Children Safe in EducationCompliance

Statutory guidance for schools and colleges in England that expects appropriate filtering and monitoring. It makes the designated safeguarding lead responsible for online safety, including how filtering and monitoring work.

A new edition usually appears each year, so check the current one.

L

LatencyMethod

The delay a filter adds to each request while it decides. Local lookups add almost nothing; waiting on a remote service for every request is what users notice.

Log retentionCompliance

How long a filter keeps its records of requests and decisions. Keep logs long enough for investigations and reports, and no longer than your privacy rules allow.

Lookalike domainalso: cousin domainThreat

A domain built to resemble a real brand, through misspellings, extra words or swapped characters. Lookalikes feed phishing and fake shops, so new ones deserve fast review.

Brand protection uses are covered in URL category data for digital risk protection.

Lookup APIData

A web service that returns the categories for a domain or URL on request. It suits low-volume checks and brand-new names, while a local file suits high-volume filtering.

Endpoints and fields are in the API documentation.

M

MalvertisingThreat

Malicious code or redirects delivered through ad networks, so that even a trusted site can show a harmful ad. Blocking known bad ad domains and risky redirect hosts reduces exposure.

MalwareThreat

Software written to harm devices or steal data, including ransomware, spyware and trojans. Domain filtering blocks the sites that host it, deliver it or control it.

Match ratealso: hit rateData

The share of lookups in a given log that find a category in the database. Test it on your own traffic rather than trusting a headline figure.

MDMmobile device managementMethod

Software that configures and controls company or school devices, including their web filtering settings. It can push a filtering profile, a DNS setting or an app allow list to each device.

Monitoring (online safety)Compliance

Watching how devices are used and alerting staff to signs of risk, which UK school guidance treats as separate from filtering. Category data can feed monitoring tools, but a category file does not watch anyone.

MSPmanaged service providerBusiness

A company that runs IT for other businesses, often including their firewall and web filter. MSPs want one policy model they can repeat across many client sites.

See web filtering for MSPs.

MSSPmanaged security service providerBusiness

An MSP that focuses on security monitoring and incident response. Category data helps its analysts triage alerts across clients that run different tools.

Multi-category domainData

A domain that carries more than one category because the site covers more than one subject. Our data stores several categories where a site fits more than one, ranked by how much of the site each describes.

N

Newly observed domainThreat

A domain seen in traffic for the first time, whatever its registration date. It catches old domains that suddenly come to life, which registration dates alone miss.

Newly registered domain (NRD)Threat

A domain registered in the last few days or weeks. Many phishing and scam sites are young, so a lot of policies block or warn on NRDs for their first days.

We categorize about 300,000 new domains a day and check each again after a week and a month; see how to block newly registered domains.

Next-generation firewall (NGFW)Method

A firewall that adds application awareness, intrusion prevention and URL filtering to classic port and address rules. Its URL filter relies on a category database like any other web filter.

NXDOMAINMethod

The DNS answer that says a name does not exist. Some DNS filters return it for blocked domains, which is simple but gives users no explanation.

O

OEM licencealso: embedded licenceBusiness

A licence to build the data into a product you sell or provide, such as a firewall, router, app or SaaS service. Your customers use the categories through your product, never as raw files.

Terms are explained on OEM licensing.

Offline databasealso: on-premise databaseData

A copy of the category data kept inside the product or network, so lookups never leave it. It gives the lowest latency and is the only option for air-gapped sites.

Online Safety ActCompliance

A UK law from 2023 that puts duties on online platforms and search services to tackle illegal content and protect children, with Ofcom as the regulator. It targets services rather than network filters, but it shapes what schools and parents expect.

Duties are being phased in, so check the current codes.

OverblockingCompliance

Blocking more than the policy intends, such as health information caught by an adult rule. School guidance in several countries treats it as a real harm rather than a safe default.

P

PAC fileproxy auto-configMethod

A small script with a function named FindProxyForURL that tells the browser which proxy to use for each address. It can route some destinations through inspection and send others direct.

Parental controlsMethod

Features that let parents limit what children can reach, when, and for how long. Most of them rely on category data to sort sites by age suitability.

Parked domainalso: for-sale domainThreat

A registered domain that shows only ads, a placeholder or a for-sale notice. Parked domains carry little value and can switch to a live, sometimes malicious, site overnight.

See the parked and for-sale domains category.

Path-level categorizationalso: full URL categorizationData

Labelling a specific page or path rather than the whole domain, for example one section of a large platform. It only helps filters that can see the full URL.

Peer-to-peer (P2P)Threat

Networks where users share files directly with each other instead of through a central server. Policies block P2P sites and trackers for legal, bandwidth and malware reasons.

PhishingThreat

A fake page or message that tricks people into handing over passwords, payment details or access. Phishing domains live briefly, so speed of categorization matters more here than in almost any other category.

See the phishing category.

Policy profileMethod

A named set of filter rules applied to a group, such as students, staff or guests. Profiles let one console serve very different users on the same network.

Popularity rankData

A domain's position in a list ordered by how much real users visit it. Data buyers use it to decide how many domains they need, since the busiest sites carry most traffic.

PrecisionData

Of all the sites a category labels, the share that truly belong there. Low precision in a blocked category means false positives and frustrated users.

Prevent dutyCompliance

A UK duty on schools and other bodies to have due regard to preventing people from being drawn into terrorism. Schools often show part of it through filtering of extremist content, so check the current guidance.

Primary categoryData

The category that describes most of a site when it carries several. Reports often group by primary category, while policies may act on any category the site carries.

Q

QUICMethod

A transport protocol that carries web traffic over UDP with encryption built in, and the basis of HTTP/3. Many filters block it so that browsers fall back to TCP, where SNI checks and inspection work.

R

RecallData

Of all the sites that truly belong in a category, the share the data actually labels. Low recall in a blocked category means harmful sites get through.

Recategorization requestData

A request to review a domain's category because it looks wrong or the site has changed. A short, tracked route for these requests keeps users trusting the filter.

Registered domainalso: apex domain, eTLD+1Data

The part of a name that someone actually registered, such as example.co.uk, found by stripping subdomains back to the public suffix. Most category databases key their records on it.

Remote access toolsThreat

Software that lets someone control a computer from elsewhere, used by IT support and by scammers alike. Many policies block the category and allow only the one tool the organisation actually uses.

Reportingalso: filter reportsCompliance

Summaries of blocked and allowed traffic by category, group and time. They show whether the policy works and often serve as evidence in school and audit files.

Reputation scoreThreat

A number that estimates how risky a domain or address is, based on its history and behaviour. It says how dangerous a site might be, not what it is about, so it complements categories rather than replacing them.

Resale restrictionalso: no-redistribution clauseBusiness

The licence term that forbids passing on or publishing the raw data. Licensees use the categories in their own systems or products, but cannot sell the file itself.

Restricted modeMethod

A setting on video platforms that hides mature videos and comments. Networks enforce it at DNS or with a request header so users cannot turn it off.

Router-level filteringMethod

Filtering set up on the home or office router, usually by pointing its DNS at a filtering resolver. It covers every device on that network without installing anything.

RPZresponse policy zoneMethod

A DNS zone format that tells a resolver to rewrite or refuse answers for the names it lists. It is a widely supported way to load a block list into an existing DNS server.

S

SandboxingThreat

Running a suspicious file or link in an isolated environment to see what it does. It is slower than a lookup, so filters usually sandbox only files from risky or uncategorized sources.

SASEsecure access service edgeMethod

An architecture that delivers networking and security, web filtering included, from cloud points of presence close to users. It needs one category source that every point of presence reads in the same way.

See URL category data for SASE platforms.

Schedule-based policyalso: time schedulesMethod

Rules that change with the time of day or the day of the week, such as gaming allowed after school hours. The categories stay the same; only the rule applied to them changes.

SDKsoftware development kitBusiness

A packaged library that app makers embed to add a feature, such as category lookups or parental controls. Shipping category data inside an SDK falls under an OEM licence.

Secure web gateway (SWG)Method

A cloud or on-premise proxy that filters web traffic by category, inspects HTTPS and scans downloads. It is the classic enforcement point for company web policy.

More in what is a secure web gateway.

Security categoriesData

Categories that describe risk, such as phishing, malware and botnets, as opposed to topics like sport or news. Most policies block security categories everywhere and vary content categories by group.

Security service edge (SSE)Method

The security half of SASE, usually a secure web gateway, a CASB and ZTNA delivered from the cloud. Buyers choose it when they want those controls without replacing their network.

Shadow AIThreat

AI tools that staff use without approval, often pasting in company data. A category for AI tools lets IT see which ones are in use and set rules per type of tool.

Shadow ITMethod

Cloud apps and services that teams adopt without the IT department knowing. Categorized domains in the logs are the quickest way to find them.

SIEMsecurity information and event managementMethod

A system that gathers logs from across the organisation for search, alerting and investigation. Adding categories to DNS and web logs makes them readable at a glance.

SNIserver name indicationMethod

The field in a TLS handshake where the browser names the site it wants, sent in plain text unless ECH is used. Firewalls read it to filter HTTPS by domain without decrypting anything.

Soft blockalso: warn page, continue pageMethod

A page that cautions the user and lets them carry on after a click, instead of refusing outright. It suits grey-area categories where a hard block would cause too many tickets.

Split tunnellingMethod

Sending some traffic through the company VPN or security service and the rest straight to the internet. Category data helps decide which destinations are trusted enough to go direct.

SSL/TLS inspectionalso: HTTPS inspection, decryptionMethod

Decrypting HTTPS at a gateway, checking the content and encrypting it again, using a certificate the devices trust. It reveals full URLs, but banking, health and pinned apps are usually exempted by category.

Exemption choices are covered in SSL inspection and URL categories.

SubdomainData

A name to the left of the registered domain, such as blog in blog.example.com. On shared platforms each subdomain can be a different site and may need its own category.

T

TaxonomyData

The full, structured list of categories a database uses, with a definition for each one. A clear taxonomy lets two reviewers put the same site in the same category.

Ours is set out group by group in content filtering categories.

Technology protection measure (TPM)Compliance

CIPA's name for the technology that blocks or filters internet access to the prohibited visual depictions. In practice it means a web filter with the right categories switched on.

Threat intelligence feedalso: threat feedThreat

A regularly updated stream of risky domains, URLs or addresses for loading into firewalls, resolvers and security tools. Freshness and false positive rates matter more than sheer size.

Our version is the phishing and malware domain feed.

TorThreat

A network that routes traffic through several volunteer relays to hide where it comes from and where it goes. Policies that block anonymizers usually block Tor's own website and its known entry points too.

TrackerThreat

A script or pixel that records what a user does across sites. Tracker domains sit in advertising and analytics categories that privacy-minded policies block.

Transparent proxyMethod

A proxy that intercepts web traffic without any setting on the device, usually from inside the network path. It is easy to roll out but sees little of HTTPS unless it also inspects.

TTLtime to liveMethod

How long a DNS answer may be cached before it is asked for again. Short TTLs on block answers let policy changes take effect quickly.

TyposquattingThreat

Registering misspellings of popular domains to catch people who mistype them. The sites usually host ads, phishing or malware, so they belong in risky categories early.

U

Uncategorized domainalso: unknown domainData

A domain the database holds no category for, often because it is brand new or rarely visited. Every policy needs a clear rule for these, such as allow, warn or block.

UnderblockingCompliance

Letting through content the policy says should be blocked, usually because the data missed it. Low recall in sensitive categories is the main cause.

Update subscriptionalso: refresh rightsBusiness

The part of a licence that entitles you to ongoing deliveries such as delta files and full refreshes. Without it, a one-time copy ages quickly as sites change hands and content.

URL filteringMethod

Deciding whether to allow a web request by checking its address against a policy, usually by category. It can use the domain alone or, where visible, the full path.

The full picture is in what is URL filtering.

URL rewritingalso: time-of-click protectionMethod

Replacing links in email or documents with links through a checking service, so each click is judged when it happens. It catches links that turned bad after the message was delivered.

URL shortenerThreat

A service that turns a long address into a short one that redirects. Shorteners hide the real destination, so filters either expand the link or treat the shortener with care.

V

Validation samplealso: ground truth setData

A set of domains reviewed by people and used to measure how well the data performs. A sound sample is drawn at random across categories and popularity levels.

Licence holders receive validation reports with the measured accuracy of our CIPA categories.

VPNvirtual private networkThreat

An encrypted tunnel that carries a device's traffic to another server. Company VPNs are tools, but consumer VPN apps on a filtered network are usually a way around the filter.

W

Web filteralso: internet filter, content filterMethod

Any product or service that applies a web access policy, whether in a firewall, resolver, proxy, browser or device agent. Its decisions are only as good as the data it consults.

Web filteringMethod

The umbrella term for controlling which websites people can reach, whatever the method. DNS filtering and URL filtering are its two most common forms.

How the two compare is set out in DNS filtering vs web filtering.

White labelBusiness

Selling a product under your own brand while another company builds or runs it. Many MSPs and ISPs offer white-label web filtering to their own customers.

Wildcard ruleMethod

A rule that matches a domain and all of its subdomains, for example *.example.com. It is powerful and risky, since one wildcard on a shared platform can allow far too much.

WPADweb proxy auto-discoveryMethod

A protocol that lets devices find their PAC file automatically through DHCP or DNS. It saves setup work but must be locked down, because a fake WPAD answer can redirect traffic.

Z

Zero trustMethod

A security model that trusts no user, device or network by default and checks every request. Web filtering fits in as the rule for which destinations a verified user may reach.

ZTNAzero trust network accessMethod

Access to private applications granted per user and per app, replacing broad VPN access. ZTNA products use category data to decide what goes through the tunnel and what goes direct.

See URL category data for ZTNA.

Glossary terms in live records

Six entries above, shown as real category data

Some definitions click faster with a record beside them. These are real results from our web filtering data, looked up at the root of each domain.

Term it showsDomainCategories in our dataWhy it fits the term
URL shorteneris.gdURL ShortenersOne clear label for a redirect service
Parked domainafternic.comParked / For-Sale DomainsA marketplace for names, not a content site
Anonymizerpsiphon.caVPN / Proxy / AnonymizersA tool made to get around network controls
Multi-category domainrustdesk.comComputers & Technology, Developer Tools / Code Hosting, Freeware/Software, Remote Access ToolsSeveral categories where a site fits more than one
Category-based blockingkraken.comCryptocurrency, Financial ServicesA crypto rule catches it while ordinary banks stay open
Primary categoryzoom.usWebinars/E-learning, Web-based Applications, BusinessBusiness software that no single label describes

Terms people mix up

Specs, RFPs and support tickets go wrong most often on these pairs. Each row says what separates them and when the difference costs you.

PairThe differenceWhen it matters
Allow list vs block listAn allow list always permits its entries; a block list always refuses them. Both override categories.Allow-only networks, such as kiosks, need a very complete allow list or they break.
DNS filtering vs URL filteringDNS sees only the domain at lookup time; URL filtering can see the path when traffic is visible.Large platforms with good and bad sections need URL-level control.
Precision vs recallPrecision asks whether labelled sites are right; recall asks whether the right sites are labelled.Blocked categories need high precision for users and high recall for safety.
False positive vs overblockingA false positive is one wrong verdict; overblocking is the pattern a policy produces across many sites.Fixing single sites does not fix a rule that is set too wide.
Delta file vs full refreshA delta carries only the changes; a full refresh replaces everything.Missed deltas leave gaps until the next full refresh arrives.
NRD vs newly observed domainOne is new to the registry; the other is new to traffic, whatever its age.Old domains bought and reused by attackers only show up as newly observed.
SWG vs SSE vs SASEAn SWG is one control; SSE bundles cloud security controls; SASE adds networking to SSE.Category data has to behave the same in every one of those parts.
DoH vs DoTBoth encrypt DNS; DoT uses its own port, while DoH hides inside normal HTTPS.DoT is easy to steer at the firewall, DoH needs endpoint or browser policy.
Category vs reputation scoreA category says what a site is; a reputation score says how risky it seems.Acceptable use rules need categories; threat rules often use both.
Internal licence vs OEM licenceInternal covers your own use; OEM covers data built into products you provide to others.Shipping categories to customers under an internal licence is out of scope.

Five glossary terms to put in your next data RFP

When a product team compares category data, these are the terms that turn a vague promise into something you can test. Each card shows the question to ask and our own answer.

Coverage

What is the match rate on our traffic?

A file size says little. Ask for the share of your own lookups that come back with a category.

Ours: 120 million domains, including the 20 million most visited that carry 99.99% of traffic.
Precision and recall

How is accuracy measured, and per which category?

Ask how the validation sample is drawn and whether results are reported for the categories you block hardest.

Ours: regular manual validations, with CIPA category reports for licence holders.
Delta files and NRDs

How fast do new domains arrive, and are they checked again?

New sites often launch empty and fill up later. A single early verdict can stay wrong for months.

Ours: about 300,000 new domains a day in daily deltas, each rechecked after a week and a month.
Multi-category

Can one domain carry more than one category?

A single label forces a guess on mixed sites. Ranked categories let policy and reports act on the right one.

Ours: several categories where a site fits more than one, ranked by how much of the site each covers.
Licence and deployment

Does the licence match how we ship?

Internal use, OEM and group licences cover different things. Check where the data may run as well.

Ours: internal, OEM and group licences, delivered as files that run in your own systems, air-gapped if needed.

Web filtering glossary FAQ

What is the difference between web filtering, URL filtering and DNS filtering?

Web filtering is the umbrella term for controlling which sites people can reach. DNS filtering decides when a device looks up a domain name and sees only that name, while URL filtering checks the web address and can use the full path when it is visible.

What do precision and recall mean for a URL category database?

Precision is the share of sites in a category that truly belong there, so low precision means false positives. Recall is the share of all sites that belong in a category that the data actually labels, so low recall means harmful sites slip through.

What is a delta file in category data?

A delta file holds only what changed since the last delivery, such as new domains, changed categories and removals. Products apply daily deltas on top of a full copy so they stay current without reloading the whole database.

What is the difference between an internal licence and an OEM licence?

An internal licence covers use of the data inside your own organisation, for your own network, analytics or security. An OEM licence covers building the data into a product or service you provide to customers, who then use the categories through your product.

What is overblocking and why does it matter?

Overblocking means a filter blocks more than its policy intends, such as health or education pages caught by an adult rule. School guidance in several countries treats it as a real harm, because it blocks learning and pushes users to look for workarounds.

Do encrypted DNS and Encrypted Client Hello stop web filtering?

They remove two signals that network filters rely on: the plain DNS lookup and the server name in the TLS handshake. Filtering keeps working when networks control which resolvers devices may use, when agents or managed browsers enforce policy on the device, or when traffic passes through a gateway.

What is the difference between a block list and category-based blocking?

A block list names the exact domains or URLs to refuse and only knows the entries someone has added. Category-based blocking refuses every site in a category, including sites that appeared yesterday, as long as the category data knows them.

Is a domain category file personal data under GDPR?

A file that lists domains and their categories describes websites, not people, so it holds no personal data. The browsing logs a filter writes are different, because a log line tied to a user or device can be personal data and needs a lawful basis and a retention limit.

Licences for the database begin at $999, which covers the 1 million most popular domains. Vendors that build the data into a product they sell take an OEM licence, starting at $10,000 per year.

Turn the vocabulary into a working filter

120 million categorized domains, 58 web filtering categories plus the IAB taxonomy, daily delta files and a lookup API, all running inside your own systems.

Talk to us