BGP is one of the most critical routing protocol for a Service Provider. Although this protocol is very robust and scalable, it is crucial for them to monitor it.  BGP Monitoring Protocol has been built for this purpose. In this blog post, you will learn: What is BGP Monitoring Protocol (BMP) How to configure BMP on Cisco IOS-XR How to install OpenBMP collector How to collect BMP data and what are the potential usage Introduction Cisco IOS-XR 5.2.2 release introduced the support of BGP Monitoring Protocol (BMP). In a nutshell, BMP aims to: Monitor BGP session state Check BGP prefixes activity (currently IPv4, IPv6, VPNv4) Provide access to the Adj-RIB-in table (pre inbound BGP route-policy filtering) BMP architecture relies on two key components: a client (e.g IOS-XR router) and a collector (e.g OpenBMP). BMP client copies each BGP update it receives from a peer and sends it to the BMP collector. The BMP collector decodes and stores BMP records, which may be later used. BMP is currently based on draft-ietf-grow-bmp-07. IOS-XR configuration The configuration on IOS-XR is straightforward.  You first need to configure a BMP server: RP/0/RSP0/CPU0:ASR9010(config)#bmp server <1-8> ?   description             BMP server specific description   dscp                    Set IP DSCP (DiffServ CodePoint)   host                    Hostname of BMP Server   initial-delay           Initial connect delay in sending BMP server updates   initial-refresh         Initial refresh to generate BGP updates   precedence              Set precedence   shutdown                Shutdown connection to BMP server   stats-reporting-period  Stats reporting period for BMP server   update-source           Source to reach BMP server   vrf                     VRF for the BMP server   <cr> Then activate the BMP server under a BGP peer: router bgp <ASN> neighbor <neighbor>   bmp-activate server <1-8> There are few commands available to monitor BMP: RP/0/RSP0/CPU0:ASR9010#sh bgp bmp summary Tue Mar  3 17:33:48.404 CET ID   Host                 Port     State Time        NBRs 1 172.17.254.123       5555     ESTAB 00:35:34    1 RP/0/RSP0/CPU0:ASR9010# RP/0/RSP0/CPU0:ASR9010#sh bgp bmp server 1 detail Tue Mar  3 17:33:09.372 CET BMP server 1 Host 172.17.254.123 Port 5555 Connected for 00:34:55 Precedence:  internet BGP neighbors: 1 VRF: - (0x60000000) Update Source: 172.17.255.35 (Mg0/RSP0/CPU0/0) Update Source Vrf ID: 0x60000000 Message Stats: Total messages sent: 10          INITIATION: 4         TERMINATION: 1        STATS-REPORT: 0   PER-PEER messages: 5   Neighbor 99.0.1.7 Messages pending: 0 Messages sent: 5       PEER-UP: 2     PEER-DOWN: 1     ROUTE-MON: 2 RP/0/RSP0/CPU0:ASR9010# And some debugs: RP/0/RSP0/CPU0:ASR9010#debug bgp bmp RP/0/RSP0/CPU0:Mar  3 16:58:13.819 : bgp[1053]: [default-ext]: [1/172.17.254.123] vsocket -> default vrf RP/0/RSP0/CPU0:Mar  3 16:58:13.819 : bgp[1053]: [default-ext]: [1/172.17.254.123] set tos 0x0 / 0x6 afi 0x2 fd 153 RP/0/RSP0/CPU0:Mar  3 16:58:13.820 : bgp[1053]: [default-ext]: [1/172.17.254.123] set tos result 0 RP/0/RSP0/CPU0:Mar  3 16:58:13.820 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp connect: -1 RP/0/RSP0/CPU0:Mar  3 16:58:13.820 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp connect: delayed RP/0/RSP0/CPU0:Mar  3 16:58:13.820 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp statechange: NONE->CONNECT RP/0/RSP0/CPU0:Mar  3 16:58:13.821 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp select: fd: 153 rc: 0 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp callback: fd: 153 cond: 1 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp callback: fd: 153 cond: 2 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp statechange: CONNECT->ESTAB RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [BMP Message Dump : Server 172.17.254.123, nbr (None), type Initiation Message]: RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: 0300 0000 6c04 0001 0057 4369 7363 6f20 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: 494f 5320 5852 2053 6f66 7477 6172 652c RP/0/RSP0/CPU0:Mar 3 16:58:13.873 : bgp[1053]: [default-ext]: 2056 6572 7369 6f6e 2035 2e32 2e32 5b44 RP/0/RSP0/CPU0:Mar 3 16:58:13.873 : bgp[1053]: [default-ext]: 6566 6175 6c74 5d0a 436f 7079 7269 6768 RP/0/RSP0/CPU0:Mar 3 16:58:13.873 : bgp[1053]: [default-ext]: 7420 2863 2920 3230 3134 2062 7920 4369 RP/0/RSP0/CPU0:Mar 3 16:58:13.873 : bgp[1053]: [default-ext]: 7363 6f20 5379 7374 656d 732c 2049 6e63 RP/0/RSP0/CPU0:Mar 3 16:58:13.873 : bgp[1053]: [default-ext]: 2e00 0200 0741 5352 3930 3130 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp select: fd: 153 rc: 0 RP/0/RSP0/CPU0:Mar  3 16:58:13.873 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp callback: fd: 153 cond: 2 RP/0/RSP0/CPU0:Mar  3 16:58:13.876 : bgp[1053]: [default-ext]: [1/172.17.254.123] tcp callback: fd: 153 cond: 2 OpenBMP installation OpenBMP is an open-source BMP collector written by Tim Evens, Technical Leader at Cisco. OpenBMP collects BMP updates, which are then stored in a MySQL database. Installation is easy and the procedure is documented here. Once installed, we can check the BMP exchanges between the router and the collector: root@openbmp:/home/cisco# tail -f /var/log/openbmpd.log 2015-02-20T10:33:14.185583 | INFO     | runServer          | Client Connected => 172.17.255.35:22078, sock = 8 2015-02-20T10:33:14.185847 | INFO     | runServer          | Waiting for new connection, active connections = 2 2015-02-20T10:33:14.195967 | INFO     | runServer          | Client Connected => 172.17.255.35:45828, sock = 5 2015-02-20T10:33:14.195998 | INFO     | runServer          | Waiting for new connection, active connections = 2 2015-02-20T10:33:14.279303 | INFO     | ClientThread       | Thread started to monitor BMP from router 172.17.255.35 using socket 8 2015-02-20T10:33:14.279445 | INFO     | ClientThread       | Thread started to monitor BMP from router 172.17.255.35 using socket 5 2015-02-20T10:33:14.335657 | INFO     | ReadIncomingMsg    | 172.17.255.35: Init message received with length of 102 2015-02-20T10:33:14.335679 | INFO     | handleInitMsg      | Init message type 1 and length 87 parsed 2015-02-20T10:33:14.335690 | INFO     | handleInitMsg      | Init message type 1 = Cisco IOS XR Software, Version 5.2.2[Default] Copyright (c) 2014 by Cisco Systems, Inc. 2015-02-20T10:33:14.335695 | INFO     | handleInitMsg      | Init message type 2 and length 7 parsed 2015-02-20T10:33:14.335699 | INFO     | handleInitMsg      | Init message type 2 = ASR9010 2015-02-20T10:33:14.377702 | INFO     | ReadIncomingMsg    | 172.17.255.35: Init message received with length of 102 2015-02-20T10:33:14.377721 | INFO     | handleInitMsg      | Init message type 1 and length 87 parsed 2015-02-20T10:33:14.377739 | INFO     | handleInitMsg      | Init message type 1 = Cisco IOS XR Software, Version 5.2.2[Default] Copyright (c) 2014 by Cisco Systems, Inc. 2015-02-20T10:33:14.377744 | INFO     | handleInitMsg      | Init message type 2 and length 7 parsed 2015-02-20T10:33:14.377748 | INFO     | handleInitMsg      | Init message type 2 = ASR9010 2015-02-20T10:36:00.912343 | INFO     | ReadIncomingMsg    | 172.17.255.35: PEER UP Received, local addr=99.0.1.6:41962 remote addr=99.0.1.7:179 2015-02-20T10:36:02.976462 | INFO     | parseUpdateMsg     | 99.0.1.7: rtr=172.17.255.35: End-Of-RIB marker 2015-02-20T10:38:11.172338 | INFO     | parseUpdateMsg     | 99.0.1.7: rtr=172.17.255.35: End-Of-RIB marker Collecting BGP data Once your IOS-XR router and OpenBMP collector are ready, it’s time to use those BMP records you collected. The only way today is to run raw SQL queries against the OpenBMP database. Several tables are available: mysql> show tables; +---------------------------+ | Tables_in_openBMP         | +---------------------------+ | bgp_peers                 | | gen_asn_stats             | | gen_whois_asn             | | path_attr_log             | | path_attrs                | | peer_down_events          | | peer_up_events            | | prefix_aspath             | | rib                       | | routers                   | | stat_reports              | | v_peer_prefix_report      | | v_peer_prefix_report_last | | v_peers                   | | v_routes                  | | v_routes_history          | | v_routes_history2         | | withdrawn_log             | +---------------------------+ 18 rows in set (0.00 sec) From which you can collect different information. For example, it’s possible to gather details for specific prefixes: mysql> select RouterName,PeerName,Prefix,PrefixLen,Origin,Origin_AS,MED,LocalPref,NH,AS_Path from v_routes where prefix like '2.2.2%'; +------------+----------+---------+-----------+------------+-----------+------+-----------+----------+---------+ | RouterName | PeerName | Prefix  | PrefixLen | Origin     | Origin_AS | MED  | LocalPref | NH       | AS_Path | +------------+----------+---------+-----------+------------+-----------+------+-----------+----------+---------+ | ASR9010    | 99.0.1.7 | 2.2.2.2 |        32 | incomplete |      1337 | 0 |         0 | 99.0.1.7 |  1337 | +------------+----------+---------+-----------+------------+-----------+------+-----------+----------+---------+ 1 row in set (0.00 sec) We can also collect the withdraw history: mysql> select * from withdrawn_log; +----------+----------------------------------+---------+------------+---------------------+ | id       | peer_hash_id                     | prefix  | prefix_len | timestamp           | +----------+----------------------------------+---------+------------+---------------------+ | 21849170 | 3b0a6a0b8790682b3e5014618ad81589 | 1.1.1.1 |         32 | 2015-02-20 10:38:53 | +----------+----------------------------------+---------+------------+---------------------+ 1 row in set (0.00 sec) mysql> If you want to see what’s possible to do with BMP records, a demo is available here: http://demo.openbmp.org:8000/ (demo/demo) It currently uses DB_REST.  However, OpenBMP is working on OpenDaylight integration.  This looks very promising and would be the occasion of a second post once available. You can also interact directly with the OpenBMP MySQL database and build your own applications. BMP use cases BMP can be used for many applications. Here are some examples of BMP use cases: BGP looking glass: Classic looking glasses software are not always secure. With BMP, no need to give access to the router or use an alternative BGP daemon. Use the BMP collector to provide information on BGP prefixes. Removal of “soft-reconfiguration-inbound always” feature and route-policy troubleshooting: I still see many customers using BGP soft-reconfiguration-inbound. The reason I’m given is RPL troubleshooting purpose, as they can access the Adj-RIB-In and see how are the prefixes they receive BEFORE filtering. The drawback with this feature is memory consumption: router keeps a copy of the BGP table for each peer it’s enabled. With BMP, this information can be retrieved on the BMP collector directly. You can compare the view before and after the RPL application without impacting the router performance. Route analytics: Track BGP prefixes activity, convergence time, attributes modifications, etc. Conclusion You are now ready to deploy BMP on Cisco IOS-XR to monitor the critical piece BGP is in your Service Provider infrastructure. You should now understand what BMP is, how to configure it on Cisco IOS-XR and make it work with OpenBMP. Credits: I would like to thank Bertrand Duvivier and Tim Evens for the valuable information they shared with me. Frederic CUILLER – Network Consulting Engineer @fcuiller References BGP Monitoring Protocol draft v07 Cisco IOS-XR 5.2.2 Release Notes BGP Monitoring Protocol presentation by Bertrand Duvivier, Product Manager @ Cisco OpenBMP by Tim Evens, Technical Leader @ Cisco ... View more

On May 18 th 2014, we will celebrate 25 years of Cisco Live at San Francisco, with more than 600 technical sessions during 4 days! Join us and learn how Cisco is ready to support Service Providers with IOS-XR operating system and IOS-XR based platforms with the following session recommendations: IOS-XR BRKSPG-2724 - Network Function Virtualization (NFV) using IOS-XR Network Function Visualization (NFV) is being heavily adapted in Service Providers market segment.  BGP route reflectors are good candidates for NFV. They often lack the flexibility, elasticity, and agility required to meet the frequently changing demands of the services. With virtual Route Reflector (vRR), we leverage Cisco's IOS-XR already proven experience in the field and address the shortcomings brought about by physical device limitations regarding elastic flexibility of device resources such as memory and CPU. BRKSPG-2903 - Network Services in IOS-XR Service Providers are now subject to very large DDoS attacks, above the 100Gbps threshold. In the meantime, they have to manage IPv4 address exhaustion and prepare for the smooth, incremental transition to IPv6 services. Discover how they can deploy Arbor DDoS mitigation, CGv6 and Carrier Grade NAT(V4/V6) using Cisco CGSE/CGSE+ (CRS) and ISM/VSM (ASR9000) services modules to address those realities. And also: LTRARC-2002 - IOS-XR Overview and Hands-on Configuration LTRSPG-2305 - Advanced IOS-XR Lab - Configuration, Troubleshooting and Security ASR 9000 BRKSPG-2722 - SDN deployment in ASR9000 With the changing paradigm of network programmability using Software Defied Network (SDN), we are seeing new ways for monitoring, scaling and configuring network devices. With new network programmability capabilities, it is vital for network architects and operation engineers to understand how these SDN related technologies can be leveraged to streamline the way Service Providers view, design, and operate networks today. IOS XR 5.1.1 brings SDN and programmability to ASR 9000 with XNC, ODL and WAVE controller support and also introduces features such as BGP-LS, PCEP and Netconf/XML that truly enable end-to-end SDN WAN orchestration.  Discover how to implement and troubleshoot all those new exciting tools on the ASR 9000. BRKARC-2024 - Cisco ASR 9000 nV Technology and Deployment With nV technology, Cisco extends the operational simplification and cost savings to wide variety of networks. New topology models such as simple ring and layer 2 fabric will greatly help Service Providers to simplify and converge their existing access, aggregation or mobile backhaul networks into one logical routing system. nV satellite  can be operated and managed completely from one ASR 9000 as the host, whereas the satellites simply become the extended remote virtual LC/ports to the host chassis. nV cluster is a single control plane, single management plane, and fully distributed data plane across 2 physical chassis. Combining those 2 features, Service Providers can highly simplifies operations while enhancing the network resiliency. And also: BRKSPG-2202 - Deploying Carrier Ethernet Services on ASR 9000 BRKARC-2003 - Cisco ASR 9000 Architecture BRKARC-2017 - Packet Journey inside ASR 9000 BRKSPG-2904 - ASR-9000/IOS-XR Understanding forwarding, troubleshooting the system and XR operations BRKSPG-2333 - Securing Cisco ASR 9000 Routers TECSPG-3001 - Advanced - ASR 9000 Operation and Troubleshooting NCS BRKARC-2022 - Introduction to Network Convergence System (NCS6000) Cisco NCS 6000 is a high performance routing platform with 5 Terabit per slot forwarding performance capability. Discover how this platform will help Service Providers to scale the upcoming massive traffic growth driven by the IoT, including: fully virtualized Cisco IOS-XR operating system, which brings new levels of programmability and virtualization to increase application service offerings and speed up provisioning velocity Cisco nPower Network Processor Units, a state of the art programmable ASIC designed to deliver industry's first ZPL/ZTL ISSU capability Cisco CMOS photonics technology, bringing highest port density and least power consumption for technologies of 100 Gbps and beyond For more information on all activities and to register for Cisco Live US, click here. Conclusion With all these sessions focused on IOS-XR, this Cisco Live US 2014 will be technically amazing again. My colleague Igor Dayen will share more Service Provider pathway details for Cisco Live US 2014 in a separate blog post coming soon. Stay tuned! Can’t attend Cisco Live US? All these sessions are available online on the Cisco Live US website . More resources: Cisco Live SF 2014, the Evolved Programmable Network Comes to Life in the Service Provider Booth By Igor Dayen Cisco Live San Francisco Cisco Network Convergence System Cisco Carrier Routing System Cisco ASR 9000 Series Aggregation Services Routers Cisco IOS-XR software ... View more

Video: An Invitation to Cisco Live 2014, Milan Travelling to Milan this week (Jan 27-31) and joining us for Cisco Live Europe 2014? Don’t know which sessions to attend? Want to dig or simply discover the IOS-XR world and the respective Cisco platforms? Check out my Cisco Live Europe 2014 session recommendation and join me for an exciting IOS-XR journey. IOS-XR Overview and Hands-on Configuration New to the IOS-XR world? Discover our NGN Operating System designed for high-level of scalability, reliability, resiliency and modularity. This session will include an overview of IOS-XR software architecture covering routing components and other key system monitoring and troubleshooting capabilities (LPTS, Memory/CPU Usage, interface utilization, debug/trace features). More importantly, play and interact with the system through the dedicated IOS-XR hands-on! Get familiar with the CLI syntax, configure a variety of features, and become an IOS-XR rock star. Advanced - IOS-XR Troubleshooting Concepts - BRKSPG-3333 Already comfortable with IOS-XR but willing to dig deeper? Join this session and expand your IOS-XR troubleshooting skills. This session will cover CRS and ASR9000 platforms and will focus on IGP (OSPF, ISIS), Multicast , MPLS , BGP, L2VPN and L3VPN services. Cisco Service Provider Core Evolution How to scale up to petabyte forwarding?  NCS, CRS-X and Next Generation IP+Optical: we know how. Join us and learn Cisco’s core innovations to power the Internet of Everything. This session will detail how Cisco built an unmatched single system purpose built to work together and scale. Deploying Carrier Ethernet Services on ASR 9000 - BRKSPG-2202 EFP, L2VPN, IRB, EOAM: What is Carrier Ethernet and why/how to implement it on ASR 9000? Find the answers in this session and discover best practices and special features that make the ASR9000 an ideal platform for such services and features deployment. Advanced - DDoS Mitigation Deployment: Impact on your Architecture - BRKSPG- 3335 This session will show how Arbor Threat Management System (TMS) software running on the Cisco CRS CGSE service card is able to effectively prevent network traffic from being interrupted by distributed denial of service (DDoS) attacks. Especially, the presentation will go through the detailed description of numerous use-cases and address design approaches. Advanced - Carrier Grade NAT44 on IOS-XR Deployment Experience – BRKSPG-3334 Carrier Grade NAT enables Service Providers to migrate to IPv6 while continuing to support existing IPv4 devices and content. This session will cover the configuration and troubleshooting of a CGN service on CRS and ASR9000, including: technology, design, sizing rules and monitoring of the solution. A large section will be dedicated to the routing impact and consideration behind the CGN insertion, through the study of many use-cases based on real-life deployments. Conclusion Wow! This looks promising and I can’t wait to hear your feedback after this XR-flavored Italian trip. Can’t attend Cisco Live Europe? All those sessions are available online on the Cisco Live Milan website. More Resources Cisco Live Milan Cisco Network Convergence System Cisco Carrier Routing System Cisco ASR 9000 Series Aggregation Services Routers Cisco IOS-XR software Follow Frederic on Twitter @Fcuiller ... View more