Skip to content

Commit c895a9f

Browse files
authored
[RESEARCH] 02 Telemetry & Data (#25)
Add learning objectives, prerequisites, seven lesson outlines, module boundaries, and supporting references for Core Module 02. Complete the draft module metadata. Closes #11 Signed-off-by: Tallis Jordan <tj@hardcounter.io>
1 parent 623fea8 commit c895a9f

2 files changed

Lines changed: 282 additions & 0 deletions

File tree

Lines changed: 245 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,245 @@
1+
# Telemetry & Data
2+
3+
## Overview
4+
5+
This module covers the data that detections run on. Learners examine where telemetry comes from, how it is collected and parsed, where data is stored, how to assess whether it is trustworthy and compatible for a given detection. This module also covers how normalization, enrichment, and baselines prepare data for use in detection.
6+
7+
Module 01 established that a detection is a system, and that its inputs are part of that system. This module is about those inputs. Learners should be able to assess whether their environment's data can support detection, explain where data can fail, and describe what it would take to close the gaps.
8+
9+
This module uses native field names for examples rather than a normalized schema.
10+
11+
## Learning Objectives
12+
13+
By the end of this module, learners should be able to:
14+
15+
- Describe the major categories of security telemetry and what each can and cannot show.
16+
- Trace an event from the system that produces it to the platform where detections are run, and identify where it can be lost, delayed, or altered.
17+
- Compare data architecture on cost, retention, latency, resilience, searchability, and processing.
18+
- Assess a log source's fitness to support detection and document visibility gaps.
19+
- Evaluate the trade-offs of normalization approaches and common schemas.
20+
- Explain how enrichment and baselines add context that raw events lack, and how each can fail.
21+
22+
## Prerequisites
23+
24+
- Module 01: Detection Engineering Foundations
25+
26+
## Lessons
27+
28+
### 1. Telemetry & Log Sources
29+
30+
**Learning Objectives**
31+
32+
- Distinguish telemetry, events, sensors, log sources, and ATT&CK Data Components.
33+
- Categorize telemetry (endpoint, network, identity, cloud, application) by the activity each can show.
34+
- Identify common visibility gaps and failures of each category.
35+
- Relate a log source to the ATT&CK Data Components.
36+
37+
**Key Topics**
38+
39+
- Telemetry forms: audit and application logs, traces, metrics, network flows and packets, snapshots, sensor events, etc.
40+
- Source categories and what each answers
41+
- What each telemetry form and source category can and cannot show
42+
- Native event names and field names
43+
- ATT&CK Data Components and Log Sources
44+
- Data dictionaries (e.g., OSSEM)
45+
46+
**Out of scope**
47+
48+
- Configuring logging for specific systems (domain tracks)
49+
- Choosing sources for a specific requirement (03)
50+
51+
### 2. Collection and Parsing
52+
53+
**Learning Objectives**
54+
55+
- Compare common collection and transport methods and their common failures.
56+
- Trace an event from source to search, and identify where it can be lost, delayed, or altered.
57+
- Distinguish event, ingestion, and processing time; explain how clock skew affects detection.
58+
- Explain how parsing, schema drift, and pipeline behavior affect the trustworthiness of detection data.
59+
60+
**Key Topics**
61+
62+
- Collection methods (agents, forwarding, etc.)
63+
- Pipeline stages
64+
- Filtering at the source
65+
- Buffering, retries, duplicates, out of order delivery
66+
- Parsing, field extraction, character encoding, and schema drift
67+
- Event time vs. ingestion time
68+
- Silent data loss and partial failure
69+
- Pipeline as a detection dependency
70+
71+
**Out of scope**
72+
73+
- Building and operating pipelines (platform tracks)
74+
- Pipeline health monitoring (09)
75+
76+
### 3. Where Detection Data Lives
77+
78+
**Learning Objectives**
79+
80+
- Compare indexed, data lake, and other architectures on cost, retention, latency, and normalization effort.
81+
- Distinguish batch from streaming detection.
82+
- Explain how retention and storage limit lookback and investigation.
83+
- Explain how access, integrity, privacy, and minimization requirements affect telemetry storage.
84+
85+
**Key Topics**
86+
87+
- Comparison of data architectures
88+
- Storage and retention
89+
- Batch vs. streaming
90+
- Collection decisions
91+
- Cost, retention, latency, resilience, and searchability
92+
- Sensitive data in telemetry: access, privacy, and minimization
93+
94+
**Out of scope**
95+
96+
- Platform strategy and selection (10)
97+
- Query performance (05)
98+
99+
### 4. Assessing Data Quality & Visibility
100+
101+
**Learning Objectives**
102+
103+
- Build a log source inventory.
104+
- Evaluate a log source for completeness, accuracy, validity, consistency, timeliness, uniqueness, and integrity.
105+
- Determine whether data supports a detection need fully, partially, or not at all.
106+
- Document visibility gaps and how each finding was verified.
107+
108+
**Key Topics**
109+
110+
- Ingested is not the same as usable
111+
- Log source inventory
112+
- Data quality characteristics
113+
- Measuring coverage and field population
114+
- Assessments
115+
116+
**Out of scope**
117+
118+
- Feasibility of a specific requirement (03)
119+
- Prioritizing which gaps to close (03)
120+
- Log source health monitoring (09)
121+
122+
### 5. Normalization & Schemas
123+
124+
**Learning Objectives**
125+
126+
- Compare methods of normalization.
127+
- Evaluate field reliability and planning for missing fields.
128+
- Compare common schemas and what normalization gains and loses.
129+
130+
**Key Topics**
131+
132+
- The normalization problem
133+
- Normalization methods
134+
- Preserving raw values
135+
- Field reliability
136+
- Value normalization
137+
- Field dictionaries
138+
- Common schemas (OCSF, OSSEM, role of platform data models)
139+
140+
**Out of scope**
141+
142+
- Writing detections against a schema (05)
143+
- Platform data models (platform tracks)
144+
145+
### 6. Enrichment
146+
147+
**Learning Objectives**
148+
149+
- Distinguish enrichment from normalization.
150+
- Identify common enrichment sources.
151+
- Compare ingest time, query time, and alert time enrichment.
152+
- Evaluate enrichment data for freshness, provenance, confidence, temporal correctness, and join reliability.
153+
154+
**Key Topics**
155+
156+
- Identity, asset, threat intelligence, and behavioral context
157+
- Ingest time, query time, and alert time enrichment
158+
- Source provenance and confidence
159+
- Stale context and lookup failures
160+
- Enrichment as a detection dependency
161+
162+
**Out of scope**
163+
164+
- Deciding what context a detection needs (04)
165+
- Monitoring enrichment sources (09)
166+
167+
### 7. Baselines
168+
169+
**Learning Objectives**
170+
171+
- Explain what a baseline is, and why it is local to an environment.
172+
- Distinguish volumetric, temporal, and behavioral baselines.
173+
- Establish and validate a baseline for a defined entity and metric.
174+
- Explain why normal is not the same as safe.
175+
176+
**Key Topics**
177+
178+
- Static vs. calculated baselines
179+
- Volumetric, temporal, and behavioral baselines
180+
- Choosing the window, entities, and metrics
181+
- Environmental change and baseline drift
182+
- Baselines that include compromised activity
183+
184+
**Out of scope**
185+
186+
- Using baselines in logic, thresholds, and exclusions (04, 05)
187+
- Machine learning for anomaly detection
188+
189+
## Boundaries
190+
191+
| Topic | This module | Adjacent module(s) |
192+
| --- | --- | --- |
193+
| Telemetry Vocabulary | Applies the Module 01 definitions | 01 Detection Engineering Foundations |
194+
| Enrichment | Sources, stages, and common failures | 04 Detection Design (deciding on context for a detection) |
195+
| Data architecture | Architecture and trade offs | 05 Detection Development (query performance); 10 Detection Program Engineering |
196+
| Visibility gaps | Identifying what is and is not collected | 03 Detection Requirements (feasibility, and prioritizing gaps to close) |
197+
| Log source health | Data quality concepts and assessment | 09 Detection Health & Lifecycle (monitoring) |
198+
| Normalization and schemas | What they are and trade offs | 05 Detection Development (writing queries against sources) |
199+
| Baselines | Establishing what normal looks like | 04 Detection Design (using baselines to choose approaches, thresholds, and exclusions); 05 Detection Development (implementation) |
200+
| Sensitive data | Access, privacy, and minimization | 10 Detection Program Engineering (governance) |
201+
| Source specific logging configuration | Not covered | Domain tracks |
202+
| Platform ingestion and data models | Not covered | Platform tracks |
203+
204+
## Labs
205+
206+
N/A
207+
208+
## Datasets
209+
210+
N/A
211+
212+
## References
213+
214+
### Telemetry and log management
215+
216+
- [Best Practices for Event Logging and Threat Detection](https://www.cyber.gov.au/publication/best-practices-for-event-logging-and-threat-detection), Australian Signals Directorate's Australian Cyber Security Centre and international partners, 2024. Retrieved 2026-10-31.
217+
- [NIST SP 800-92: Guide to Computer Security Log Management](https://csrc.nist.gov/pubs/sp/800/92/final), Karen Kent and Murugiah Souppaya, National Institute of Standards and Technology, 2006. DOI: 10.6028/NIST.SP.800-92.
218+
- [NIST SP 800-92 Rev. 1: Cybersecurity Log Management Planning Guide, Initial Public Draft](https://csrc.nist.gov/pubs/sp/800/92/r1/ipd), Karen Scarfone and Murugiah Souppaya, National Institute of Standards and Technology, 2023. DOI: 10.6028/NIST.SP.800-92r1.ipd.
219+
- [NIST SP 800-53 Rev. 5: Security and Privacy Controls for Information Systems and Organizations](https://csrc.nist.gov/pubs/sp/800/53/r5/upd1/final), Joint Task Force, National Institute of Standards and Technology, 2020, Release 5.2.0 published 2025. DOI: 10.6028/NIST.SP.800-53r5.
220+
221+
### ATT&CK and Visibility
222+
223+
- [MITRE ATT&CK, v20.0](https://attack.mitre.org/), The MITRE Corporation, 2026. Retrieved 2026-10-31.
224+
- [ATT&CK Updates: October 2025, v18](https://attack.mitre.org/resources/updates/updates-october-2025/), The MITRE Corporation, 2025. Retrieved 2026-10-31.
225+
- [OSSEM: Open Source Security Events Metadata](https://github.com/OTRF/OSSEM), Open Threat Research Forge, n.d. Retrieved 2026-10-31.
226+
227+
### Collection, formats, and time
228+
229+
- [OpenTelemetry Logs Data Model](https://opentelemetry.io/docs/specs/otel/logs/data-model/), OpenTelemetry Project, n.d. Retrieved 2026-10-31.
230+
- [RFC 5424: The Syslog Protocol](https://www.rfc-editor.org/rfc/rfc5424), Internet Engineering Task Force, 2009.
231+
- [RFC 5425: Transport Layer Security Transport Mapping for Syslog](https://www.rfc-editor.org/rfc/rfc5425), Internet Engineering Task Force, 2009.
232+
233+
### Data quality and schemas
234+
235+
- [ISO/IEC 25012: Software Engineering — Software Product Quality Requirements and Evaluation — Data Quality Model](https://www.iso.org/standard/35736.html), International Organization for Standardization, 2008.
236+
- [Open Cybersecurity Schema Framework](https://ocsf.io/), OCSF Project, n.d. Retrieved 2026-10-31.
237+
238+
### Enrichment and baselines
239+
240+
- [STIX Version 2.1](https://docs.oasis-open.org/cti/stix/v2.1/os/stix-v2.1-os.html), OASIS Open, 2021. Retrieved 2026-10-31.
241+
- [NIST SP 800-94: Guide to Intrusion Detection and Prevention Systems](https://csrc.nist.gov/pubs/sp/800/94/final), Karen Scarfone and Peter Mell, National Institute of Standards and Technology, 2007. DOI: 10.6028/NIST.SP.800-94.
242+
243+
## AI Assistance
244+
245+
Research
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
title: Telemetry & Data
2+
slug: telemetry-and-data
3+
status: draft # draft | in-review | reviewed | stable | needs-update | deprecated
4+
version: 0.1
5+
6+
summary: >
7+
Covers the data detections run on: log sources, collection, parsing and normalization, data quality, enrichment, and the architecture of where detection data lives. Comes before Detection Requirements because what you can detect is bounded by what you can see.
8+
9+
learning_objectives:
10+
- Describe the major categories of security telemetry and what each can and cannot show.
11+
- Trace an event from the system that produces it to the platform where detections are run, and identify where it can be lost, delayed, or altered.
12+
- Compare data architecture on cost, retention, latency, resilience, searchability, and processing.
13+
- Assess a log source's fitness to support detection and document visibility gaps.
14+
- Evaluate the trade-offs of normalization approaches and common schemas.
15+
- Explain how enrichment and baselines add context that raw events lack, and how each can fail.
16+
17+
prerequisites:
18+
- Module 01 Detection Engineering Foundations
19+
20+
authors:
21+
- mndtrcks
22+
23+
reviewers: [] # GitHub handles (without @) of independent approving reviewers
24+
25+
maintainers:
26+
- mndtrcks
27+
28+
ai_assistance: >
29+
research
30+
31+
last_reviewed: null # YYYY-MM-DD, set by a maintainer on approval
32+
33+
related_tracks: []
34+
35+
related_labs: []
36+
37+
related_datasets: []

0 commit comments

Comments
 (0)