monitor IPN interpod traffic

[Mahmoud]

Hi,

I tried to monitor the traffic between PODs but there are a lot of challenges like the traffic is encapsulated by ivxlan so I used traditional netflow to get the toptakers , it will only show vtep IPs.

any idea for this usecase

[AshSe]

Monitoring inter-PoD traffic in a Cisco ACI multi-pod setup can indeed be challenging due to the encapsulation of traffic using iVXLAN. Traditional NetFlow will only show the VTEP (Virtual Tunnel Endpoint) IPs, which doesn't provide visibility into the actual endpoints communicating across the pods. Here are some strategies and tools you can use to effectively monitor inter-PoD traffic:

1. Enhanced Visibility with Cisco Tetration:

Cisco Tetration provides comprehensive visibility into the data center and cloud environments. It can monitor traffic flows, including those encapsulated in iVXLAN, and provide detailed insights into the actual endpoints communicating across the pods.

1. Deployment: Deploy Tetration sensors in your environment to collect flow data.
2. Analysis: Use Tetration's analytics capabilities to identify top talkers, traffic patterns, and potential security issues.

2. Using Cisco Nexus Dashboard Insights:

Cisco Nexus Dashboard Insights (formerly known as Cisco Network Assurance Engine) can provide deep visibility into your ACI fabric, including inter-PoD traffic.

1. Deployment: Integrate Nexus Dashboard Insights with your ACI fabric.
2. Monitoring: Use the tool to monitor traffic flows, detect anomalies, and gain insights into the performance and health of your inter-PoD traffic.

3. Leveraging ACI's Built-in Tools:

Cisco ACI provides built-in tools that can help you monitor and analyze traffic within the fabric.

1. EPG Contracts and Filters: Use Endpoint Group (EPG) contracts and filters to monitor and control traffic between EPGs across different pods.
2. Atomic Counters: Use atomic counters to track the number of packets and bytes sent between different points in the fabric. This can help you identify traffic patterns and potential bottlenecks.

4. Third-Party Network Monitoring Tools:

There are several third-party network monitoring tools that can provide visibility into encapsulated traffic.

1. SolarWinds Network Performance Monitor (NPM): SolarWinds NPM can be configured to monitor ACI environments and provide insights into traffic flows.
2. ThousandEyes: ThousandEyes can provide visibility into network performance, including inter-PoD traffic in ACI environments.

5. Custom Scripts and Automation:

You can create custom scripts using the ACI API to collect and analyze traffic data.

1. Python Scripts: Use Python scripts to query the ACI API for traffic statistics and flow data.
2. Automation Tools: Use automation tools like Ansible or Terraform to collect and analyze traffic data periodically.

Example Python Script to Query ACI API:

Here's a simple example of a Python script that queries the ACI API for traffic statistics:

Conclusion:

Monitoring inter-PoD traffic in a Cisco ACI multi-pod setup requires tools that can understand and analyze encapsulated traffic.

1. Cisco Tetration, Nexus Dashboard Insights, and third-party tools like SolarWinds NPM and ThousandEyes can provide the necessary visibility.
2. Additionally, leveraging ACI's built-in tools and custom scripts can help you gain insights into your inter-PoD traffic.