INSIGHTS
Cybersecurity

Palo Alto NGFW Engineer: URL Filtering and DNS Security with PAN-OS

In this article
  1. Define the web-access policy before tuning categories
  2. Understand what URL filtering can and cannot see
  3. Treat DNS as an early security control
  4. Use sinkholing to find affected clients
  5. Control DNS exceptions without creating blind spots
  6. Connect URL and DNS controls to threat investigation
  7. Avoid cross-vendor assumptions about web filtering
  8. Measure effectiveness with risk-focused signals
  9. Keep web and DNS policy aligned with the wider security architecture

Web and DNS controls solve different parts of the same problem. URL filtering governs where users and applications can browse over HTTP and HTTPS, while DNS Security evaluates domain lookups that often happen before a connection is created. In PAN-OS, these controls are attached to allowed traffic through security profiles, so they work best when the surrounding Security policy already identifies the right users, applications, zones, and destinations. This is a practical part of the current Palo Alto Networks Certified Next-Generation Firewall Engineer role.

Design becomes stronger when teams avoid treating categories as absolute truth. A URL category is a risk signal, not a replacement for application context, identity, or threat analysis. DNS verdicts can identify malicious infrastructure early, but legitimate services can use shared hosting, content-delivery networks, rapidly changing domains, and third-party dependencies. Policy should therefore combine classification with user need, logging, exceptions, and investigation.

HTTPS also limits what can be seen without decryption. The firewall may know a destination domain or URL category while still lacking visibility into path-level content. That makes decryption policy, certificate trust, privacy requirements, and web filtering part of one architecture rather than separate configuration screens.

Define the web-access policy before tuning categories

Start by identifying user populations, applications, and business use cases that require internet access. General workforce browsing, developer package repositories, administrative portals, SaaS applications, and guest traffic can have very different tolerance for unknown or risky categories. One global profile for every user often becomes so permissive that it no longer communicates policy.

Use URL categories to express business risk and acceptable use, not merely to create a long list of blocks. Known malware and phishing destinations deserve stronger actions than categories that are simply unproductive or inappropriate for a specific environment. Categories such as newly registered or newly observed domains can be useful risk signals, but they may also contain legitimate services and therefore require a deliberate action and monitoring plan.

Keep category exceptions separate from broad policy whenever possible. If a business unit needs one site in an otherwise blocked category, allow the specific destination rather than weakening the category for the whole organization. Record who owns the exception and when it should be reviewed.

Create a small set of policy personas instead of endlessly cloning profiles. For example, managed workforce, privileged administrators, developers, guests, and servers may have different web needs. Each persona should have a documented category baseline, authentication expectation, decryption posture, and exception process. This approach makes category changes easier to reason about because a reviewer can ask whether a category is appropriate for a defined population rather than debating one global rule that serves everyone.

Understand what URL filtering can and cannot see

URL filtering profiles can control access to web content and can also apply actions such as allow, alert, block, continue, or credential-related controls depending on feature and platform. The useful design question is not how many categories are available, but which actions produce the right behavior for the organization’s risk model.

Encrypted HTTPS changes visibility. Without decryption, controls may rely on information available from the connection and TLS negotiation rather than the full URL path. With decryption, more detailed inspection becomes possible, but the organization must manage certificate trust, privacy exclusions, application compatibility, and regulatory requirements. The web-control team should know which traffic is actually decrypted instead of assuming full visibility.

URL policy should be reviewed with phishing risk. The techniques described in modern phishing defense show why users can be sent to newly created or convincingly branded sites that do not look obviously malicious. Category-based controls, credential submission restrictions, DNS reputation, endpoint protection, and user awareness work better together than any one of them alone.

Credential-phishing controls deserve special attention because the harm often occurs before malware is downloaded. If the platform can restrict credential submission to untrusted categories, test the user experience and define how legitimate new SaaS applications are approved. Combine that control with identity-provider sign-in protections and MFA. The objective is to reduce the chance that a user can hand enterprise credentials to an attacker-controlled site even when the page itself is technically reachable.

Treat DNS as an early security control

DNS is often the first observable step before a client reaches malicious infrastructure. DNS Security can classify requests using cloud-delivered intelligence and analysis, allowing the firewall to block or sinkhole domains associated with malware, command and control, phishing, and other threats. This gives defenders a chance to interrupt the chain before the application session starts.

Basic DNS mechanics still matter during troubleshooting. A client may resolve an A record directly, receive an answer through a recursive resolver, or reuse a cached response. If security teams do not know which resolver actually handled the query, they can misread threat logs or assume a policy is failing when the client never generated a new request.

Inventory internal resolvers, split-horizon namespaces, cloud DNS services, and encrypted DNS behavior. Decide where DNS inspection is expected to occur and whether clients are permitted to bypass enterprise resolvers. If endpoints can freely send DNS over HTTPS to arbitrary providers, a traditional DNS inspection design may lose important visibility.

DNS architecture should include the resolver path for remote users and branch networks. A laptop may use a local network resolver before GlobalProtect connects, then switch to a corporate resolver after the tunnel is established. Branches may forward to local caching servers while cloud workloads use managed DNS. Map these differences so security teams know where domain controls apply and which logs contain the client identity. Otherwise, malicious lookups can appear to come from shared resolvers with little endpoint context.

Use sinkholing to find affected clients

Sinkholing changes the response for a malicious domain so infected clients attempt to connect to a controlled sinkhole address instead of the attacker’s infrastructure. This is especially useful when the firewall sees the organization’s recursive DNS server as the source of the original lookup. The later connection to the sinkhole can reveal the actual endpoint that initiated the malicious behavior.

Choose sinkhole addresses that are operationally safe and monitor them. Analysts should know which traffic log pattern represents a successful sinkhole event and how to pivot from that event to endpoint, user, and process evidence. A sinkhole that is configured but never monitored provides little incident-response value.

Do not confuse sinkholing with remediation. It interrupts or redirects one communication path, but the client may still be compromised. Treat repeated sinkhole connections as investigation triggers and look for related network, endpoint, authentication, and file events.

During sinkhole testing, use a controlled domain or vendor-provided validation method and confirm every stage: the malicious classification, forged DNS response, endpoint connection attempt to the sinkhole address, traffic log, and analyst workflow. This validates that sinkholing produces usable attribution rather than only a threat log. If endpoint egress rules block the sinkhole connection, analysts may need another method to identify the originating host.

Control DNS exceptions without creating blind spots

DNS exceptions may be needed when a legitimate domain is misclassified or when a security research workflow intentionally accesses risky infrastructure. Narrow the exception to the specific domain or FQDN needed. Avoid wildcard patterns that cover unrelated subdomains unless the owner can justify that broader trust.

Remember that caching changes the timing of observations. The behavior described in DNS caching means a policy change may not produce an immediate fresh lookup on every client. When testing, flush caches or use controlled queries so old resolver answers do not hide the real enforcement behavior.

Review exception lists as part of the same governance process used for firewall rules. Domains change ownership, SaaS vendors change infrastructure, and temporary incident-response allowances can outlive their purpose. An exception that made sense six months ago may now create an unnecessary gap.

Encrypted DNS is an architectural consideration rather than merely a browser preference. DNS over HTTPS and similar mechanisms can move name resolution into ordinary TLS sessions and bypass traditional resolver controls. Decide whether such traffic is allowed, restricted to approved providers, or blocked. The answer should align with privacy requirements and endpoint management. If encrypted DNS is permitted broadly, defenders need another reliable source for domain-level visibility.

Connect URL and DNS controls to threat investigation

URL and DNS logs become much more useful when analysts correlate them by user, host, time, and destination. A suspicious DNS request followed by an allowed HTTPS session, a file download, and an endpoint alert is a stronger story than any one event alone. Preserve enough log detail and retention to reconstruct that sequence.

DNS manipulation is itself an attack path. The concepts in DNS spoofing and cache poisoning matter because a user can be directed to an attacker-controlled address even when they type the correct domain. DNSSEC validation, trusted resolvers, secure network paths, and endpoint protections complement PAN-OS domain reputation.

Use category changes as a hunting signal. If a frequently accessed domain moves from a normal business category into a suspicious or newly observed category, investigate whether the domain changed, the classification changed, or an application dependency was compromised. Policy should be able to respond without relying on users to report something unusual.

When correlating URL and DNS data, distinguish resolution from access. A browser, security product, or operating system can resolve a domain without the user ever establishing a session to it. Likewise, an application can connect to an IP learned earlier without a new DNS query. Analysts should look for both query and connection evidence before concluding that a user visited a malicious destination or that blocking a DNS lookup prevented every possible route to the service.

Avoid cross-vendor assumptions about web filtering

Different platforms use different category databases, update processes, proxy models, and exception semantics. A comparison with FortiGate web filtering can help engineers recognize the common objective—controlling web destinations—without assuming that profile names or evaluation order are interchangeable.

During migrations, rebuild policy from intent rather than copying category lists mechanically. Map business requirements, risky destinations, credential protections, exclusions, and logging needs to the new platform. Category names that sound identical may have different definitions or update timing.

Test high-value SaaS applications, identity providers, software-update systems, and content-delivery networks after policy changes. These services often depend on multiple domains and redirects. A simple landing-page test can succeed while background API calls or authentication redirects fail.

Cross-platform migrations are a good time to clean old exceptions. Exporting hundreds of legacy category overrides into a new system preserves historical decisions without proving they are still required. Revalidate each high-impact exception against current business applications, ownership, and risk. When an old allowance has no active owner, default toward removal and monitor for legitimate impact rather than assuming that age alone proves necessity.

Measure effectiveness with risk-focused signals

Do not judge URL filtering by the total number of blocked requests. Advertising, background refreshes, browser retries, and one infected host can inflate counts. Better measures include high-risk blocks by unique user or endpoint, repeated attempts after user coaching, malicious-domain detections that led to confirmed incidents, and the age and scope of exceptions.

Track policy coverage as well. Identify internet-access rules with no URL or DNS profile, user populations that bypass approved resolvers, and encrypted traffic categories where the firewall has limited visibility. These gaps explain why a control may miss activity even when the profile itself is well tuned.

Review false positives and false negatives with application owners and security analysts. If users frequently request overrides for a category, determine whether the category action is wrong for that population or whether one destination is misclassified. The corrective action should be as narrow as the evidence allows.

Metrics should include policy drift between intended and observed behavior. If a category is defined as blocked but a large volume of sessions still reaches destinations in that category through alternate applications, proxy services, or unmanaged DNS, the architecture has a control gap. Use test accounts and representative endpoints to validate policy from the user perspective, not only by reading configuration. Security controls are effective only on the paths that real traffic takes.

Keep web and DNS policy aligned with the wider security architecture

URL Filtering and DNS Security should support the same segmentation, identity, application, and incident-response model used elsewhere. A remote user, branch user, and data-center workload may reach the internet through different enforcement points, but the organization should still understand which protections apply and where logs are collected.

Changes in browser behavior, encrypted DNS, SaaS delivery, and certificate handling can alter visibility without an obvious firewall-policy change. Include these dependencies in operational reviews and test from representative endpoints rather than only from an administrator workstation.

The broader Palo Alto Networks certification path is useful context, but the practical goal is straightforward: web and DNS controls should block known threats early, reduce exposure to risky destinations, preserve legitimate business access, and generate evidence that defenders can use when something still gets through.

Web and DNS controls should participate in change management for major SaaS rollouts. Before onboarding a critical cloud service, identify its domains, authentication redirects, certificate dependencies, APIs, and content delivery endpoints. Test those paths under the exact user profiles that will use them. This prevents security teams from being pressured into a broad temporary allow rule during launch day, which can later remain because nobody has time to narrow it.

Filed under Cybersecurity