|
| 1 | +# Telemetry & Data |
| 2 | + |
| 3 | +## Overview |
| 4 | + |
| 5 | +This module covers the data that detections run on. Learners examine where telemetry comes from, how it is collected and parsed, where data is stored, how to assess whether it is trustworthy and compatible for a given detection. This module also covers how normalization, enrichment, and baselines prepare data for use in detection. |
| 6 | + |
| 7 | +Module 01 established that a detection is a system, and that its inputs are part of that system. This module is about those inputs. Learners should be able to assess whether their environment's data can support detection, explain where data can fail, and describe what it would take to close the gaps. |
| 8 | + |
| 9 | +This module uses native field names for examples rather than a normalized schema. |
| 10 | + |
| 11 | +## Learning Objectives |
| 12 | + |
| 13 | +By the end of this module, learners should be able to: |
| 14 | + |
| 15 | +- Describe the major categories of security telemetry and what each can and cannot show. |
| 16 | +- Trace an event from the system that produces it to the platform where detections are run, and identify where it can be lost, delayed, or altered. |
| 17 | +- Compare data architecture on cost, retention, latency, resilience, searchability, and processing. |
| 18 | +- Assess a log source's fitness to support detection and document visibility gaps. |
| 19 | +- Evaluate the trade-offs of normalization approaches and common schemas. |
| 20 | +- Explain how enrichment and baselines add context that raw events lack, and how each can fail. |
| 21 | + |
| 22 | +## Prerequisites |
| 23 | + |
| 24 | +- Module 01: Detection Engineering Foundations |
| 25 | + |
| 26 | +## Lessons |
| 27 | + |
| 28 | +### 1. Telemetry & Log Sources |
| 29 | + |
| 30 | +**Learning Objectives** |
| 31 | + |
| 32 | +- Distinguish telemetry, events, sensors, log sources, and ATT&CK Data Components. |
| 33 | +- Categorize telemetry (endpoint, network, identity, cloud, application) by the activity each can show. |
| 34 | +- Identify common visibility gaps and failures of each category. |
| 35 | +- Relate a log source to the ATT&CK Data Components. |
| 36 | + |
| 37 | +**Key Topics** |
| 38 | + |
| 39 | +- Telemetry forms: audit and application logs, traces, metrics, network flows and packets, snapshots, sensor events, etc. |
| 40 | +- Source categories and what each answers |
| 41 | +- What each telemetry form and source category can and cannot show |
| 42 | +- Native event names and field names |
| 43 | +- ATT&CK Data Components and Log Sources |
| 44 | +- Data dictionaries (e.g., OSSEM) |
| 45 | + |
| 46 | +**Out of scope** |
| 47 | + |
| 48 | +- Configuring logging for specific systems (domain tracks) |
| 49 | +- Choosing sources for a specific requirement (03) |
| 50 | + |
| 51 | +### 2. Collection and Parsing |
| 52 | + |
| 53 | +**Learning Objectives** |
| 54 | + |
| 55 | +- Compare common collection and transport methods and their common failures. |
| 56 | +- Trace an event from source to search, and identify where it can be lost, delayed, or altered. |
| 57 | +- Distinguish event, ingestion, and processing time; explain how clock skew affects detection. |
| 58 | +- Explain how parsing, schema drift, and pipeline behavior affect the trustworthiness of detection data. |
| 59 | + |
| 60 | +**Key Topics** |
| 61 | + |
| 62 | +- Collection methods (agents, forwarding, etc.) |
| 63 | +- Pipeline stages |
| 64 | +- Filtering at the source |
| 65 | +- Buffering, retries, duplicates, out of order delivery |
| 66 | +- Parsing, field extraction, character encoding, and schema drift |
| 67 | +- Event time vs. ingestion time |
| 68 | +- Silent data loss and partial failure |
| 69 | +- Pipeline as a detection dependency |
| 70 | + |
| 71 | +**Out of scope** |
| 72 | + |
| 73 | +- Building and operating pipelines (platform tracks) |
| 74 | +- Pipeline health monitoring (09) |
| 75 | + |
| 76 | +### 3. Where Detection Data Lives |
| 77 | + |
| 78 | +**Learning Objectives** |
| 79 | + |
| 80 | +- Compare indexed, data lake, and other architectures on cost, retention, latency, and normalization effort. |
| 81 | +- Distinguish batch from streaming detection. |
| 82 | +- Explain how retention and storage limit lookback and investigation. |
| 83 | +- Explain how access, integrity, privacy, and minimization requirements affect telemetry storage. |
| 84 | + |
| 85 | +**Key Topics** |
| 86 | + |
| 87 | +- Comparison of data architectures |
| 88 | +- Storage and retention |
| 89 | +- Batch vs. streaming |
| 90 | +- Collection decisions |
| 91 | +- Cost, retention, latency, resilience, and searchability |
| 92 | +- Sensitive data in telemetry: access, privacy, and minimization |
| 93 | + |
| 94 | +**Out of scope** |
| 95 | + |
| 96 | +- Platform strategy and selection (10) |
| 97 | +- Query performance (05) |
| 98 | + |
| 99 | +### 4. Assessing Data Quality & Visibility |
| 100 | + |
| 101 | +**Learning Objectives** |
| 102 | + |
| 103 | +- Build a log source inventory. |
| 104 | +- Evaluate a log source for completeness, accuracy, validity, consistency, timeliness, uniqueness, and integrity. |
| 105 | +- Determine whether data supports a detection need fully, partially, or not at all. |
| 106 | +- Document visibility gaps and how each finding was verified. |
| 107 | + |
| 108 | +**Key Topics** |
| 109 | + |
| 110 | +- Ingested is not the same as usable |
| 111 | +- Log source inventory |
| 112 | +- Data quality characteristics |
| 113 | +- Measuring coverage and field population |
| 114 | +- Assessments |
| 115 | + |
| 116 | +**Out of scope** |
| 117 | + |
| 118 | +- Feasibility of a specific requirement (03) |
| 119 | +- Prioritizing which gaps to close (03) |
| 120 | +- Log source health monitoring (09) |
| 121 | + |
| 122 | +### 5. Normalization & Schemas |
| 123 | + |
| 124 | +**Learning Objectives** |
| 125 | + |
| 126 | +- Compare methods of normalization. |
| 127 | +- Evaluate field reliability and planning for missing fields. |
| 128 | +- Compare common schemas and what normalization gains and loses. |
| 129 | + |
| 130 | +**Key Topics** |
| 131 | + |
| 132 | +- The normalization problem |
| 133 | +- Normalization methods |
| 134 | +- Preserving raw values |
| 135 | +- Field reliability |
| 136 | +- Value normalization |
| 137 | +- Field dictionaries |
| 138 | +- Common schemas (OCSF, OSSEM, role of platform data models) |
| 139 | + |
| 140 | +**Out of scope** |
| 141 | + |
| 142 | +- Writing detections against a schema (05) |
| 143 | +- Platform data models (platform tracks) |
| 144 | + |
| 145 | +### 6. Enrichment |
| 146 | + |
| 147 | +**Learning Objectives** |
| 148 | + |
| 149 | +- Distinguish enrichment from normalization. |
| 150 | +- Identify common enrichment sources. |
| 151 | +- Compare ingest time, query time, and alert time enrichment. |
| 152 | +- Evaluate enrichment data for freshness, provenance, confidence, temporal correctness, and join reliability. |
| 153 | + |
| 154 | +**Key Topics** |
| 155 | + |
| 156 | +- Identity, asset, threat intelligence, and behavioral context |
| 157 | +- Ingest time, query time, and alert time enrichment |
| 158 | +- Source provenance and confidence |
| 159 | +- Stale context and lookup failures |
| 160 | +- Enrichment as a detection dependency |
| 161 | + |
| 162 | +**Out of scope** |
| 163 | + |
| 164 | +- Deciding what context a detection needs (04) |
| 165 | +- Monitoring enrichment sources (09) |
| 166 | + |
| 167 | +### 7. Baselines |
| 168 | + |
| 169 | +**Learning Objectives** |
| 170 | + |
| 171 | +- Explain what a baseline is, and why it is local to an environment. |
| 172 | +- Distinguish volumetric, temporal, and behavioral baselines. |
| 173 | +- Establish and validate a baseline for a defined entity and metric. |
| 174 | +- Explain why normal is not the same as safe. |
| 175 | + |
| 176 | +**Key Topics** |
| 177 | + |
| 178 | +- Static vs. calculated baselines |
| 179 | +- Volumetric, temporal, and behavioral baselines |
| 180 | +- Choosing the window, entities, and metrics |
| 181 | +- Environmental change and baseline drift |
| 182 | +- Baselines that include compromised activity |
| 183 | + |
| 184 | +**Out of scope** |
| 185 | + |
| 186 | +- Using baselines in logic, thresholds, and exclusions (04, 05) |
| 187 | +- Machine learning for anomaly detection |
| 188 | + |
| 189 | +## Boundaries |
| 190 | + |
| 191 | +| Topic | This module | Adjacent module(s) | |
| 192 | +| --- | --- | --- | |
| 193 | +| Telemetry Vocabulary | Applies the Module 01 definitions | 01 Detection Engineering Foundations | |
| 194 | +| Enrichment | Sources, stages, and common failures | 04 Detection Design (deciding on context for a detection) | |
| 195 | +| Data architecture | Architecture and trade offs | 05 Detection Development (query performance); 10 Detection Program Engineering | |
| 196 | +| Visibility gaps | Identifying what is and is not collected | 03 Detection Requirements (feasibility, and prioritizing gaps to close) | |
| 197 | +| Log source health | Data quality concepts and assessment | 09 Detection Health & Lifecycle (monitoring) | |
| 198 | +| Normalization and schemas | What they are and trade offs | 05 Detection Development (writing queries against sources) | |
| 199 | +| Baselines | Establishing what normal looks like | 04 Detection Design (using baselines to choose approaches, thresholds, and exclusions); 05 Detection Development (implementation) | |
| 200 | +| Sensitive data | Access, privacy, and minimization | 10 Detection Program Engineering (governance) | |
| 201 | +| Source specific logging configuration | Not covered | Domain tracks | |
| 202 | +| Platform ingestion and data models | Not covered | Platform tracks | |
| 203 | + |
| 204 | +## Labs |
| 205 | + |
| 206 | +N/A |
| 207 | + |
| 208 | +## Datasets |
| 209 | + |
| 210 | +N/A |
| 211 | + |
| 212 | +## References |
| 213 | + |
| 214 | +### Telemetry and log management |
| 215 | + |
| 216 | +- [Best Practices for Event Logging and Threat Detection](https://www.cyber.gov.au/publication/best-practices-for-event-logging-and-threat-detection), Australian Signals Directorate's Australian Cyber Security Centre and international partners, 2024. Retrieved 2026-10-31. |
| 217 | +- [NIST SP 800-92: Guide to Computer Security Log Management](https://csrc.nist.gov/pubs/sp/800/92/final), Karen Kent and Murugiah Souppaya, National Institute of Standards and Technology, 2006. DOI: 10.6028/NIST.SP.800-92. |
| 218 | +- [NIST SP 800-92 Rev. 1: Cybersecurity Log Management Planning Guide, Initial Public Draft](https://csrc.nist.gov/pubs/sp/800/92/r1/ipd), Karen Scarfone and Murugiah Souppaya, National Institute of Standards and Technology, 2023. DOI: 10.6028/NIST.SP.800-92r1.ipd. |
| 219 | +- [NIST SP 800-53 Rev. 5: Security and Privacy Controls for Information Systems and Organizations](https://csrc.nist.gov/pubs/sp/800/53/r5/upd1/final), Joint Task Force, National Institute of Standards and Technology, 2020, Release 5.2.0 published 2025. DOI: 10.6028/NIST.SP.800-53r5. |
| 220 | + |
| 221 | +### ATT&CK and Visibility |
| 222 | + |
| 223 | +- [MITRE ATT&CK, v20.0](https://attack.mitre.org/), The MITRE Corporation, 2026. Retrieved 2026-10-31. |
| 224 | +- [ATT&CK Updates: October 2025, v18](https://attack.mitre.org/resources/updates/updates-october-2025/), The MITRE Corporation, 2025. Retrieved 2026-10-31. |
| 225 | +- [OSSEM: Open Source Security Events Metadata](https://github.com/OTRF/OSSEM), Open Threat Research Forge, n.d. Retrieved 2026-10-31. |
| 226 | + |
| 227 | +### Collection, formats, and time |
| 228 | + |
| 229 | +- [OpenTelemetry Logs Data Model](https://opentelemetry.io/docs/specs/otel/logs/data-model/), OpenTelemetry Project, n.d. Retrieved 2026-10-31. |
| 230 | +- [RFC 5424: The Syslog Protocol](https://www.rfc-editor.org/rfc/rfc5424), Internet Engineering Task Force, 2009. |
| 231 | +- [RFC 5425: Transport Layer Security Transport Mapping for Syslog](https://www.rfc-editor.org/rfc/rfc5425), Internet Engineering Task Force, 2009. |
| 232 | + |
| 233 | +### Data quality and schemas |
| 234 | + |
| 235 | +- [ISO/IEC 25012: Software Engineering — Software Product Quality Requirements and Evaluation — Data Quality Model](https://www.iso.org/standard/35736.html), International Organization for Standardization, 2008. |
| 236 | +- [Open Cybersecurity Schema Framework](https://ocsf.io/), OCSF Project, n.d. Retrieved 2026-10-31. |
| 237 | + |
| 238 | +### Enrichment and baselines |
| 239 | + |
| 240 | +- [STIX Version 2.1](https://docs.oasis-open.org/cti/stix/v2.1/os/stix-v2.1-os.html), OASIS Open, 2021. Retrieved 2026-10-31. |
| 241 | +- [NIST SP 800-94: Guide to Intrusion Detection and Prevention Systems](https://csrc.nist.gov/pubs/sp/800/94/final), Karen Scarfone and Peter Mell, National Institute of Standards and Technology, 2007. DOI: 10.6028/NIST.SP.800-94. |
| 242 | + |
| 243 | +## AI Assistance |
| 244 | + |
| 245 | +Research |
0 commit comments