Threat hunting

On this page 8

Threat hunting is the proactive, human-led search for malicious activity that has slipped past automated defenses, carried out on the assumption that an attacker may already be present in the environment. In incident response it sits before the alert: instead of waiting for a detection to fire, hunters form hypotheses about how an adversary would operate and look for evidence of that behavior in endpoint, network and identity data.

The practice exists because automated tools catch only what they were built to recognize. Patient adversaries who use valid accounts and built-in system tools can remain undetected for weeks or months, and reducing that dwell time is one of the most direct ways to limit damage in cybersecurity.

How a threat hunt is conducted

A threat hunt follows a repeatable loop rather than a fixed checklist. It starts with a testable question, moves through data analysis and ends either with an incident or with improved detection. Each completed hunt should leave the organization better defended, even when nothing malicious is found.

  1. Form a hypothesis, for example that an attacker is using scheduled tasks for persistence on servers.
  2. Identify the data needed to test it, such as process creation logs and task registration events.
  3. Query and analyze, using stacking, frequency analysis and timelines to find outliers.
  4. Investigate leads by examining hosts, accounts and related activity in depth.
  5. Escalate or close, handing confirmed malicious activity to incident triage.
  6. Automate the finding, turning a useful query into a permanent detection rule.

The last step is what separates mature programs from ad hoc searching. A pattern found by hand once should never need to be found by hand again.

Hunting approaches and their starting points

Hunts differ mainly in what triggers them. The three classic approaches are hypothesis-driven, intelligence-driven and baseline or anomaly-driven hunting, and most teams use all three.

ApproachStarting pointTypical exampleBest suited for
Hypothesis-drivenKnown attacker techniqueSearch for credential dumping behaviorCovering gaps in detection logic
Intelligence-drivenNew threat report or IOC setLook for a reported malware familyResponding to current campaigns
Baseline or anomaly-drivenStatistical deviation from normalRare processes run on few hostsUnknown or novel tradecraft
SituationalBusiness or risk eventHunt after a merger or a supplier breachTargeted high-risk periods
Main threat hunting approaches

Hypotheses are commonly drawn from the MITRE ATT&CK framework, which catalogs adversary tactics and techniques. Mapping each hunt to a technique makes it easy to see which behaviors have been tested and which remain blind spots.

Threat hunting is often confused with monitoring and forensics. The difference lies in whether an alert already exists and what the activity is meant to produce.

ActivityTriggerMain questionOutput
Threat huntingHypothesis, no alert yetIs an attacker here that we missedFound intrusions and new detections
Incident triageAn existing alertIs this alert real and how urgentPriority and next action
ContainmentConfirmed incidentHow do we stop the spreadIsolated hosts and blocked access
Digital forensicsConfirmed incident or legal needWhat exactly happened and whenEvidence and detailed timeline
IOC sweepingList of known indicatorsDoes this hash or domain appearMatches or no matches
Threat hunting and neighboring activities

Searching for an IOC is the simplest form of hunting, but indicators such as hashes and IP addresses change easily. Hunting for behaviors and techniques is harder and more durable, because attackers find it much costlier to change how they operate than what files they use.

Data sources and skills a hunting team needs

A hunt can only find what the data can show, so telemetry quality limits every hunting program. The table lists the most valuable sources and what each one reveals.

Data sourceWhat it revealsTypical retention need
EDR telemetryProcess trees, command lines, file and registry activity30-90 days or more
Authentication logsLogons, privilege use, lateral movement90 days to one year
DNS and proxy logsCommand-and-control and data exfiltration90 days or more
Network flow recordsUnusual connections and data volumes30-90 days
Cloud audit logsAPI calls, role changes, new access keys90 days to one year
Key data sources for threat hunting

Retention matters because many intrusions are discovered long after they begin, and a hunt cannot look further back than the stored data. Hunters also need practical skills: query languages for the SIEM or data lake, a solid understanding of operating system internals and knowledge of current attacker tradecraft.

Measuring the value of threat hunting

Because many hunts find nothing malicious, success must be measured by more than incidents found. Useful metrics focus on coverage, detection improvement and dwell time.

  • Number of ATT&CK techniques hunted and how many are now covered by automated detections.
  • New detection rules created from hunt findings and their false positive rate.
  • Dwell time of discovered intrusions, comparing hunted findings with alert-based ones.
  • Visibility gaps identified, such as hosts without agents or missing log sources.
  • Hygiene issues uncovered, including misconfigurations and risky administrative practices.

A hunt that finds no attacker but exposes missing logging is still productive, because it fixes the conditions that would have hidden a future intrusion.

Common pitfalls in threat hunting programs

Hunting programs fail more often through organizational problems than technical ones. Teams pulled into daily alert handling rarely find time to hunt, and hunts without clear hypotheses turn into unfocused browsing of logs.

Other frequent mistakes include hunting only for indicators from the latest news, not documenting hunts so that work is repeated, and failing to convert findings into detections. Hunters must also work with a clear rule of engagement, because touching a live intruder carelessly can alert the adversary and trigger destructive actions before containment is ready.

The short version

Most security tools work like smoke detectors. They react only to things they recognize. Threat hunting is more like a detective walking through the building looking for clues. The detective assumes that a clever intruder may have avoided every detector.

The hunter starts with an idea of how a burglar would behave. Then the hunter checks the records to see whether that behavior appears. The key point is simple: hunting looks for attackers before any alarm goes off. Every useful discovery also becomes a new automatic alarm for the future.

Where it makes a difference

A security team at a university hospital forms a hypothesis: an attacker with stolen credentials might be using remote desktop to move between servers at night. The hunters query 60 days of authentication logs for remote logons outside working hours by accounts that had never used remote desktop before.

Most results are explained by maintenance staff, but one service account logged on to four servers at 3 a.m. over two weeks. EDR telemetry on those servers shows archive tools compressing research files. The case moves to incident response, the account is disabled and the servers are isolated, stopping the theft before data leaves the network. The query becomes a permanent detection rule the same week.