45 questions
0 votes
1 answer
154 views
Integration Azure Purview to Azure Sentinel
I would like to integrate my Azure Purview with Azure Sentinel. I have followed the steps described in the official documentation at this "https://learn.microsoft.com/en-us/purview/register-scan-...
0 votes
1 answer
244 views
Using custom ingest pipeline for Filebeat Netflow
I'm using Filebeat v8.8.0, and am trying to ingest Netflow data through a custom ingest pipeline to perform IP geo-location using a database that is not Maxmind. Currently, my Netflow data is enriched ...
0 votes
1 answer
32 views
Elasticsearch shared field name for different fields
I'm a bit confused how to best handle the following scenario with Elasticsearch. I've different types of documents, which have fields with semantically the same content but different field names (see ...
0 votes
1 answer
418 views
Grok processor in ingest pattern adds escaped double quotes on save
Im using elastic "Stack management" -> "Ingest pipelines" -> "Edit pipeline". In "Grok" processor fill fields "Pattern" with ^%{MESSAGE} and &...
0 votes
1 answer
103 views
KDB Q Ingestion
currently presented with data can ingest a csv file.. Currently data is all in one column but need to split the data below into sperate columns currently a space indicates its a new column and char ...
0 votes
2 answers
83 views
If the file is deleted, delete from the ElasticSearch index
I'm trying to make a piece of code that will be responsible for deleting an indexed file from the elasticsearch index, I pass with the indexed file md5(file name), to the id value. It is necessary to ...
0 votes
1 answer
168 views
Accessing metadata fields within ingestpipeline.yml set's processor in Elasticsearch
I have to write an ingest pipeline for elasticsearch within an pipeline.yml file. I was able to retrieve my field with grok and was able to divide it with the split processor. Now, I want to assign ...
0 votes
0 answers
58 views
NoAliveNodes Elasticsearch-PHP (Ingest-Attachment)
I'm new to programming. when used in php-es code "return $client->ingest()->putPipeline($params);" outputs an error "NoAliveNodes", but when using for example "return $...
0 votes
1 answer
1k views
How to add ingest node to k8s cluster with bitnami/elasticsearch helm chart
We are using bitnami/elasticsearch helm chart for install elasticsearch cluster. We start with command: helm install --namespace esn elasticsearch bitnami/elasticsearch -f es_values_bitnami.yaml ...
0 votes
1 answer
2k views
Use Ingestion Pipeline to split between two indexes
I have documents containing the field "Status", this can have three values "Draft", "In Progress", or "Approved". I am trying to pass this document through a ...
0 votes
1 answer
408 views
How to inject pdf into elasticsearch
I add the Ingest Attachment Processor Plugin on to Elastic. Than I create a very simple pdf file. This file (the content) I try to inject into Elastic. (see commands below) But the try to find a word ...
1 vote
1 answer
2k views
Azure Data Explorer oneclick Ingest from blob container (UI)
I'm trying to configure and use the Azure Data Explorer OneClick Ingest from blob container (continous ingest). Whatever I try the URL is never accepted, I always end up with this error: Invalid URL. ...
0 votes
1 answer
768 views
Azure Synapse Copy pipeline for ingesting complex XML
I have a copy pipeline set up that connects to an SFTP server (on Azure Synapse). I have used it to copy csv files and this works fine, but now I have the complex task to pull in a multi-layered xml ...
1 vote
1 answer
837 views
Elasticsearch ingest pipelines to extract log level as Field:Value
Source log sample from message field: {"log":"2022/02/15 22:47:07 insert into public.logs (time, level, message, hostname, loggerUID, appmodule) values ('2022-02-15 22:47:07.494330952','...
2 votes
1 answer
1k views
How to get the local day of week from timestamp in elasticsearch
I'm using the ingest pipeline script processors to extract the day of the week from the local time for each document. I'm using the client_ip to extract the timezone, use that along with the timestamp ...