Set up a New Azure Ingest Feed

The following steps guide you through creating a new ingest feed for Azure Event hub data.

  1. Go to Repositories and views page and select a the repository in which you want to ingest the data.

  2. Click Settings, under Ingest on the side menu click Ingest feeds.

    Ingest Feeds

    Figure 125. Ingest Feeds


  3. On the Ingest feeds page, click + New ingest feed, select New Azure ingest feed and specify the following:

    • Name

      Enter a name for the feed (required).

    • Description

      Enter a meaningful description for the feed.

    • Preprocessing

      Define how the data is processed prior to ingestion, it can be split by Azure records or by new line. The way data should be preprocessed depends on the log source.

    • Parser

      Select the parser to apply to ingest data (required). The parser can be any parser that is on repository, predefined, from a package, or custom. See Parsing Data for more information.

    Ingest Feeds - Add

    Figure 126. Ingest Feeds - Add


  4. Click Next.

Set up Ingest Feed - Credentials

In the Add credentials dialog box define:

  • Fully qualified namespace The namespace of the Event hub, the name can found in the event hub as Host Name, see Microsoft documentation for more information. The structure is usually:

    <namespace>.servicebus.windows.net

  • Event hub name The event hub name can be found on the event hub page in the Azure Portal or CLI.

  • Consumer group default: $Default) the consumer group can be found on the event hub page in the Azure portal or CLI. We recommend adding a dedicated consumer group.

  • Blob storage endpoint Can be found through the CLI structured as follows: https://<storage account name>.blob.core.windows.net/

  • Storage Blob container name Can be found in the azure portal or CLI.

  • Default checkpoint Oldest position, Custom position, Newest position

    • Oldest position: begin receiving events from the first event.

    • Custom position: add filter to specify the position in the partition to begin receiving events.

    • Newest position: begin receiving events from the event that is queued.

Azure Credentials

Figure 127. Azure Credentials


Test Azure Feed

Click Test Azure feeds to verify the feed is correctly configured.

Ingest Feeds - Test

Figure 128.