Security · Detection

SIEM & Log Analysis

Collecting the evidence, writing the detections, and keeping the alert queue small enough that someone reads it.

Security
01

One Place To Ask Questions

A SIEM — security information and event management — collects logs from across the estate, normalises them into a common shape, and lets you query and alert across all of them at once. Without one, an investigation means logging into fifteen systems and correlating timestamps by hand.

FunctionPurpose
CollectionAgents and forwarders pulling logs from everything
NormalisationDifferent formats into common fields — user, source, action
CorrelationRules across sources: a failed VPN login then a successful one elsewhere
AlertingTurning a matched pattern into work for a human
RetentionEvidence still available months later, when you learn you were breached
Retention is the requirement people underestimate. Intrusions are frequently discovered months after the fact, and logs that rolled off after fourteen days make the investigation impossible.
02

Log Sources That Earn Their Place

Ingesting everything is expensive and drowns the signal. The useful question for each source is which detection it enables.

SourceDetects
Authentication and identityCredential stuffing, impossible travel, privilege changes
Endpoint (EDR)Malware, suspicious process trees, persistence
Network and DNSCommand and control, exfiltration, unusual destinations
Cloud control planeNew keys, policy changes, resources created in odd regions
Application logsBusiness-logic abuse nothing else can see
Email gatewayPhishing — still the most common initial access
Log integrity matters as much as coverage. An attacker with administrative access will clear local logs, so forwarding to append-only storage the compromised host cannot edit is what preserves the evidence.
03

Detections & Alert Fatigue

A detection is a rule that says this pattern is worth a human's attention. The whole craft is precision: an alert nobody can act on is worse than no alert, because it trains the team to close the queue without reading it.

Detection typeExample
SignatureA known malicious hash or domain
ThresholdTwenty failed logins in a minute
CorrelationFailed logins, then a success, then a new mailbox rule
AnomalyA service account behaving unlike its baseline
AbsenceA log source that stopped reporting — often the first sign
Alert fatigue is the dominant failure mode of security operations. A queue of 500 daily alerts at 90% false positive gets triaged by pattern-matching rather than reading, and the real one goes past unread. Tuning is not optional maintenance — it is the work.

Every detection needs a written response: what it means, how to verify it, what to do if true, and what to check if false. A rule that fires with no runbook produces an alert nobody knows how to close.

04

The SOC Workflow

StageQuestion
TriageIs this real, and how urgent
InvestigationWhat else did this account or host do
ContainmentIsolate, disable, block — stop it spreading
EradicationRemove the access and close the way in
RecoveryRestore service, verify it is clean
Lessons learnedWhat detection would have caught this sooner

The metrics that matter are time to detect and time to contain. Alert volume and rule count measure activity, not effectiveness, and optimising for them makes the queue worse.

Every incident should end by asking what detection would have caught it earlier, and then writing that detection. A SOC that does not convert incidents into rules relearns the same lesson every quarter.
05

Threat Hunting

Hunting is the deliberate search for what the detections missed — starting from a hypothesis rather than an alert. "If an attacker were using this technique, what would it look like in our logs?"

Hunt starts fromExample
A techniqueScheduled tasks used for persistence
An anomalyA workstation talking to a cloud region nobody uses
Threat intelligenceIndicators tied to a group targeting your sector
A gapAn asset class with no detection coverage at all

Two outcomes are both successes: finding something, or finding nothing and converting the hunt into a permanent detection so it never has to be done manually again.

06

Interview Questions

What does a SIEM actually do?

Collects logs from across the estate, normalises them into common fields, correlates events across sources, raises alerts, and retains evidence long enough for an investigation months later.

Why not ingest every log you have?

Cost and signal. Each source should justify itself by the detections it enables; ingesting everything drowns the useful events and inflates the bill.

What is alert fatigue and why is it dangerous?

A queue so noisy that analysts triage by pattern rather than reading. The real alert passes unread — which is why tuning is the work rather than maintenance.

Why alert on the absence of logs?

A source that stops reporting is often the first sign of a compromised host or a broken pipeline, and nothing else will notice it.

Which SOC metrics matter?

Time to detect and time to contain. Alert volume and rule count measure activity, and optimising for them makes the queue worse.

What is threat hunting?

Hypothesis-driven searching for what detections missed. Finding nothing is still a success if the hunt becomes a permanent detection.

Quick Quiz

1. The dominant failure mode of a SOC is…
2. Logs should be forwarded off the host because…
3. A log source that goes silent should…
4. Every detection rule needs…
5. Threat hunting starts from…