Commit e34bc14
authored
aws: optimise cloudtrail field retention work (#14441)
In #14236 we allowed users to select which extended fields they wanted to retain in order to reduce storage costs in cases where they did not what the full set of capacities that the data stream can provide. We did not however prevent the work of collecting those unwanted fields. This change does that, avoiding retaining fields that will ultimately not be kept if possible. It is unfortunate that the wide variety of fields is needed at all, but resolving that depends on improving platform support for the diversity of fields that the data source provides and then making more efficient use of those improvements in the detection rules. Until then, this is what we have.1 parent ad442e5 commit e34bc14
File tree
3 files changed
+146
-143
lines changed- packages/aws
- data_stream/cloudtrail/elasticsearch/ingest_pipeline
3 files changed
+146
-143
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
2 | 7 | | |
3 | 8 | | |
4 | 9 | | |
| |||
0 commit comments