Amazon EC2 Metrics to KloudMate Using OpenTelemetry Collector

15min
This document provides a guide on how to send Amazon EC2 metrics to KloudMate using Fluentbit.
In the described setup, the Node Exporter is responsible for exposing a diverse range of metrics related to hardware and the kernel. Its role involves exporting these metrics, which can then be collected and sent to the KloudMate backend through the OpenTelemetry collector. 
Node Exporter Configuration for Linux distributions
Step 1: Prerequisites: 
Ensure that port 9100 is open and accessible for the successful export of metrics.
Verify if there are any additional layers of security, such as an application layer firewall, in place.
Step 2: Configure Node Exporter for Linux Distributions
Use the following command to download and extract the Node Exporter.
Text
|
wget https://github.com/prometheus/node_exporter/releases/download/v*/node_exporter-*.*-amd64.tar.gz
tar xvfz node_exporter-*.*-amd64.tar.gz
cd node_exporter-*.*-amd64
wget https://github.com/prometheus/node_exporter/releases/download/v*/node_exporter-*.*-amd64.tar.gz
tar xvfz node_exporter-*.*-amd64.tar.gz
cd node_exporter-*.*-amd64
﻿
Recommendation: Use the latest node exporter.
Add user as node-exporter and create a service to run.
Text
|
sudo mv node_exporter /usr/local/bin/
sudo useradd -rs /bin/false node-exporter
sudo nano /etc/systemd/system/node_exporter.service
sudo mv node_exporter /usr/local/bin/
sudo useradd -rs /bin/false node-exporter
sudo nano /etc/systemd/system/node_exporter.service
﻿
Text
|
[Unit]
Description=Node Exporter Service
After=network.target

[Service]
User=node-exporter
Group=node-exporter
Type=simple
ExecStart=/usr/local/bin/node_exporter

[Install]
WantedBy=multi-user.target

[Unit]
Description=Node Exporter Service
After=network.target

[Service]
User=node-exporter
Group=node-exporter
Type=simple
ExecStart=/usr/local/bin/node_exporter

[Install]
WantedBy=multi-user.target
﻿
Enable and start the exporter to send node metrics to the backend.
Text
|
sudo systemctl daemon-reload
sudo systemctl enable node_exporter
sudo systemctl start node_exporter	
sudo systemctl status node_exporter
sudo systemctl daemon-reload
sudo systemctl enable node_exporter
sudo systemctl start node_exporter	
sudo systemctl status node_exporter
﻿
Verify whether the metrics are being successfully exported.
curl localhost:9100
Node Exporter for Windows server
Step 1: Prerequisites: 
Ensure that port 9182 is open and accessible for the successful export of metrics.
Step 2: Download the latest release of Windows Exporter from GitHub ﻿
Text
|
https://github.com/prometheus-community/windows_exporter/releases/download/v**/windows_exporter-**.msi
https://github.com/prometheus-community/windows_exporter/releases/download/v**/windows_exporter-**.msi
﻿
Install the downloaded file on your Windows server by double-clicking on it and following the installation prompts.
Once the installation is complete, the Windows node exporter will be automatically added and started as a service.
To test the Windows node exporter, open a web browser and enter <public IP>:9182in the address bar. Replace <public IP>with the actual public IP address of your Windows server. This will browse the exposed metrics on port 9182.
Please note that the instructions assume that the installation process is straightforward and does not require any additional configuration steps. 
After the metrics are successfully exported, the OpenTelemetry collector is responsible for gathering the metrics and transmitting them to KloudMate for further analysis and processing.
Step 3: Configure the OpenTelemetry to send metrics to KloudMate:
Add the node exporter path as target under Prometheus receiver
Text
|
receivers:
    prometheus:
      config:
        scrape_configs:
          - job_name: 'node-exporter'
            scrape_interval: 5s
            static_configs:
              - targets: ['localhost:9100']
receivers:
    prometheus:
      config:
        scrape_configs:
          - job_name: 'node-exporter'
            scrape_interval: 5s
            static_configs:
              - targets: ['localhost:9100']
﻿
Configure the exporter of OpenTelemetry collector to connect to KloudMate.
Text
|
exporters:
  otlphttp:
    endpoint: 'https://otel.kloudmate.com:4318'
    headers:
      Authorization: XXXXXXXXXXXXXXXXXX
exporters:
  otlphttp:
    endpoint: 'https://otel.kloudmate.com:4318'
    headers:
      Authorization: XXXXXXXXXXXXXXXXXX
﻿
Text
|
  pipelines:
    metrics:
      receivers: [prometheus]
      processors: [batch/metrics]
      exporters: [otlphttp]
  pipelines:
    metrics:
      receivers: [prometheus]
      processors: [batch/metrics]
      exporters: [otlphttp]
﻿
﻿
Did this page help you?
Amazon EC2 Metrics to KloudMate
Amazon EC2 Metrics to KloudMate Using Fluentbit
Docs powered by
Archbee
TABLE OF CONTENTS
Node Exporter Configuration for Linux distributions
Node Exporter for Windows server