- Introduction
- What is it?
- Disclaimer
- Requirements & PreRequisites
- Workflow:
- Step 1.Get Grafana Instance Details
- Step 2. Create Access Policy for Token
- Step 3. Get Token String
- Step 4. Get OTLP Endpoint/URL
- Step 5. Create the integration In ThousandEyes Portal
- Step 6. Verify that integration is working.
- Additional Resources
Introduction
This article outlines how to configure the ThousandEyes OpenTelemetry (Integrations 1.0 tab) to stream data to Grafana.
What is it?
The ThousandEyes for OpenTelemetry integration allows you to stream ThousandEyes telemetry data in OpenTelemetry format. This allows you to seamlessly integrate data with platforms like Splunk Observability Cloud, Grafana, etc. More information on ThousandEyes for OpenTelemetry can be found here.
Disclaimer
This was tested in a controlled lab environment under specific conditions (e.g. Trial for Grafana, and ThousandEyes Licensed). However, since each customer’s setup and requirements may vary, different outcomes or errors could occur. If you encounter any issues, please open a support ticket with the appropriate team—either ThousandEyes or Grafana.
Requirements & PreRequisites
The scenario in this document assumes prior knowledge of, and access to, administrator-level permissions within the following products:
Workflow:
Step 1.Get Grafana Instance Details
Log in to Grafana Cloud Stack and navigate to Grafana Cloud > MyTestingLab > Manage Your Stack > Details. Find and record your Instance Name & Instance ID, you will need both:
Note: The Grafana Cloud Account (e.g. https://MyCustomName.grafana.net ) has a custom URL which is going to be ingesting all data sent by ThousandEyes, and the Grafana Cloud Stack page shows you instances of all the services Grafana and other settings.
Step 2. Create Access Policy for Token
From the left hand side of the Manage your stack page, navigate to Security > Access Policies and click on Create access policy:
In the next window, fill out the requested details & permissions. For this article we have used the following permissions, however, you can update or modify the rights based on your own needs. For more details please see link Scopes in Grafana:
Note: Ensure that you select the proper “realm” where policy applies in your Grafana Environment. If rights are assigned to a different realm, this integration will not work.
Note: Take time here to ensure that Grafana Cloud Access Policy created does not represent a security risk in your environment, otherwise you will need to adjust the permissions and scope according to what you need, for more details please refer to official documentation for using an Access Policy Token
Step 3. Get Token String
Once you’ve created your Access Policy, it’s time to authorize the integration. Still on the ‘Create new access policy’ screen, click Add Token, assign it a name, select No expiry and then click Create.
Critical Note: Save the string token generated at this step! You will not be able to go back to get it again.
Step 4. Get OTLP Endpoint/URL
Once the token is created, we need the endpoint URL and Instance ID that ThousandEyes will use to send data. To get these, navigate to Grafana Cloud > MyTestingLab > Manage your stack > OpenTelemetry > Configure. Remember to record both the URL & the Instance ID, as we’ll need both in the next step!
Step 5. Create the integration In ThousandEyes Portal
Now that Grafana has been prepared to receive data, it’s time to set it up on the ThousandEyes’ side! From your ThousandEyes account, navigate to Manage > Integrations > Integrations 1.0 > New Integration > ThousandEyes for OpenTelemetry and fill out the requested information.
Critical Note: It is essential that you add /v1/metrics to the end of the OTLP endpoint URL we generated in step 4. As an example:
Original URL Endpoint from step 4: https://otlp-gateway-prod-us-east-0.grafana.net/otlp
URL to be used: https://otlp-gateway-prod-us-east-0.grafana.net/otlp/v1/metrics
AuthType: Select Basic and Password is the Instance ID, and password will be the Token
Click Save, and verify you receive confirmation as below. We’re almost done!
Step 6. Verify that integration is working.
To ensure everything is working properly, it’s time to validate! Open your Grafana Cloud Account (e.g. https://MyCustomName.grafana.net ) to validate that information is being received from ThousandEyes.
On the ThousandEyes side, the status of the integration will be listed as “Pending” until the connection finalizes, when it will change to “Connected ” (example below). This process can take from a few minutes to a couple hours. For the example case we used for this article, it took around one hour.
Log in Grafana Cloud Account in order to confirm the integration is working properly and your instance is receiving data sent by ThousadEyes.
Additional Resources
ThousandEyes for OpenTelemetry
