webfilteringdatabase.com
Home Find Your Solution
Features
Domain Categorization API Real-Time Classification 58 Filtering Categories Offline Database (120M) SaaS App Hostnames Mobile App Database Managed DNS Filter Content Classification
Industries
K-12 Schools Corporate Healthcare Government ISPs
Tools
Domain Lookup Bulk Categorization Category Explorer
Resources
Pricing API Documentation Login / Sign Up
Knowledge base

Web Filtering Knowledge Base

Plain explanations of how web filters work, how category data gets into products, and how to filter specific networks.

Full filtering solution · used by US public libraries and schools

We run the web filter for your library or school

Set one DNS address on your router and every device is filtered: CIPA categories blocked, a staff PIN for adult research, and reports for your records. Nothing to install.

From $99 / month per site
See filter plansHow it works

Web filtering basics

What each kind of filter can see, what it can block and where it falls short.

What Is URL Filtering? How Category Databases Power Web FiltersHow a web filter decides, and how categories, blocklists and reputation compare. What is DNS filtering?How a DNS filter checks each lookup against domain categories, its limits and bypass routes. What is a secure web gateway?How a gateway filters by URL category, inspects HTTPS and files, and compares to DNS filtering. DNS Filtering vs Web Filtering: What Each Can BlockWhat DNS blocking can and cannot see, HTTPS limits, and when to combine both methods. DNS over HTTPS and web filteringWhy encrypted DNS can slip past DNS filters and how admins keep filtering working. Why Is a Website Blocked? Find the Filter and the FixRead the symptom, run one lookup command, check the category and fix a block without opening a whole category. DNS Filtering and IPv6: Close the Gap That Skips Your FilterWhy IPv6 DNS from the router bypasses a filter, how to check devices, and four router fixes. SSL inspection and URL categories: what to decrypt and what to leave aloneWhich categories to exempt from decryption, what SNI and ECH change, and a decision flow. Content Filtering CategoriesThe full category taxonomy, organised into security, adult, lifestyle, business and other groups. Web Filtering Software for Business: What Separates Good FiltersA buyer's guide to coverage, update speed, false positives, deployment and reporting. Web Filtering Glossary: 150+ Terms ExplainedA searchable A to Z of filtering methods, threats, category data, compliance and licensing terms.

Category data, feeds and APIs

How domains get classified, kept current and delivered as files or lookups.

Domain Categorization APIHow the lookup API included with a database licence works next to the downloadable file. Bulk Domain Classification APIClassify thousands of domains at once with batch uploads, async processing and callbacks. Real-Time URL ClassificationHow newly registered domains are classified daily and checked again after a week and a month. Streaming Classification APIHigh throughput, event driven domain classification for resolvers, proxies and firewalls. Phishing and Malware Domain Feed for Firewalls and DNS FiltersA daily feed of new risky domains, rechecked over time and delivered as delta files. Blocklist Formats: CSV, Hosts, DNS RPZ and Firewall EDLEach blocklist format explained with examples, and which filtering tool expects which. Free Blocklists in a Commercial Product: Licence GuideWhich licences allow shipping a free domain list in a product you sell, and what to check before you do. Web Filtering Database SpecificationEvery field in a row, file formats, tiers, update deliveries and how teams load the data. Squid Proxy Category Blocklistsdstdomain lists, SquidGuard category folders, server name rules for HTTPS and safe updates. Research: Multi-Category Websites37.6% of the 20 million most visited domains carry more than one category; the pairs and what they mean. Research: What the Web Is Made OfCategory shares of 20 million domains, what presets really block, and the endings that stand out. Safe Browsing APIURL reputation checks and unsafe content warnings for browsers and apps.

Building category data into products

Notes for product teams adding URL categories to security, device and software products.

DNS Filtering IntegrationConnect a web filtering database to common DNS resolvers for category based filtering. Content Risk Intelligence IntegrationFeed category data into SIEM, SOAR, gateway, DNS and proxy stacks for risk scoring. Content Classification IntegrationHow content classification detects unsafe content and command servers, with feed update rates. URL Categorization for Email Security ProductsLink risk signals and key categories for delivery time and time of click checks. URL Category Guardrails for AI Agents That Browse the WebAllow, approve and deny tiers that keep browsing AI agents away from risky sites. URL Category API for SaaS ProductsFeatures URL categories enable in a SaaS product, and API versus licensed database. Content Filter Data for Browser ExtensionsRule limits, local lists versus lookups and the categories an extension filter needs. Web Content Filter Data for MDM ProductsEnforcement points and categories per device group for device management products. Router content filtering for OEMsBuild category filtering and parental controls into router and mesh firmware. URL Category Data for SASE PlatformsOne category store for gateway, DNS, firewall and cloud app controls across every point of presence. URL Category Data for ZTNASplit tunnel rules, agent lists and trust signals for zero trust network access products. URL Category Data for Secure Enterprise BrowsersPaste, upload and download controls by category, shipped inside the browser policy. URL Category Data for DLPUpload destination tiers for AI tools, personal storage and file sharing in data loss prevention. URL Category Data for XDRLabel every domain in your telemetry to sharpen detections, hunting and investigations. URL Category Data for Security Posture ManagementRank risky webhooks, forwarding rules, egress lists and AI apps found in configurations. URL Category Data for Human Risk ManagementRisky browsing signals, phishing simulation context and coaching nudges for awareness platforms. URL Category Data for Threat ResearchIndicator enrichment, noise filtering and infrastructure pivots for research teams. URL Category Data for MSSPsOne category set across mixed client estates for SOC triage, hunting and client reports. URL Category Data for Digital Risk ProtectionTriage lookalike domains, fake shops and leak sites, and catch the switch from parked to live. URL Category Data for OT and Industrial NetworksZone egress policy, unexpected destination alerts and offline updates for plants. URL Category Data for Mobile CarriersSecurity add-ons, family lines, business and IoT policy, and privacy-aware traffic analytics. URL Category Data for Link ModerationDecide on links posted in chats, forums, games and marketplaces before the message is delivered. URL Category Data for AI Training DataExclude, review, balance and document web corpora by the category of each source domain. URL Category Data for VPN AppsProtection toggles and split tunnelling by category, decided on your resolvers or the device. URL Category Data for Hosts and RegistrarsAcceptable use reviews, payment risk and abuse triage from a categorized customer domain list.

Business, compliance and ISP filtering

Policy design for companies and service design for internet providers.

DNS filtering for businessBuild a policy by team, roll it out in phases, close bypass routes and report usage. Enterprise Web Filtering and SecurityAcceptable use enforcement, data loss prevention and shadow IT detection for large companies. Custom Policy ManagementCategory groups, allow and block lists, per group rules, schedules and admin overrides. CIPA Web Filtering and ComplianceAudit logging, reporting and documentation for CIPA, GDPR, HIPAA and PCI DSS. Web filtering for small officesA one afternoon setup for offices of 2 to 50 people, including hybrid staff. Free DNS Filtering Services: What They Block and Where They StopFixed profiles, the controls they leave out, the bypass gap and the signs you have outgrown one. How Much Does a Web Filter Cost?Per user, device, site, lookup or appliance pricing, the costs quotes leave out and ten questions to ask. Web Content Filtering PolicyThe ten sections of a written policy, categories by network, exceptions and wording that works. Allow List for Business AppsKeep Microsoft 365, Google Workspace, Zoom and Slack working behind a web filter. Staff Web Filtering Under EU and UK Data LawLawful basis, what to tell staff, sensitive data in logs, impact assessments and works councils. Web Filtering for Multi-Location BusinessesOne policy for chains and franchises, network types per site, local exceptions and new openings. ISP Content FilteringCarrier grade filtering with clean pipe services, subscriber management and parental controls. ISP-level content filteringNetwork, router and app filtering compared, with per subscriber DNS policy and opt-in models.

Looking for step by step blocking instructions?

The blocking guides cover single apps, site types and devices. Ready made domain lists show what each blocklist contains.

Researchers can start with our web filtering research dataset.