はじめに
EVPN+VXLAN Fabric (サイト) を相互接続する EVPN マルチサイトがある
マルチサイトでは Fabric 間に DCI となるネットワークとそのサイト間接続のゲートウェイになる BorderGateWay (BGW) を構築して複数の Fabric サイトを接続する
BGW を実機で構築する際はライセンスが NX-OS Advantage である必要があるため注意が必要 (Leaf/Spine など BGW 以外は Essentials で可)
この記事では自宅ラボ上のサーバにある Cisco CML で試した内容を記載する
CML 構成・動作試験
試験環境
自宅ラボで実施しているので CPU とメモリに制限がある。Nexus9K が12GBもメモリを必要とするため台数に限界が発生する
以前に記載した(記事1, 記事2) で記載した自宅ラボ環境 (メモリは128GBに増強済)
| 項目 | スペック |
|---|---|
| サーバ | NUC14RVKU5 |
| CPU | Intel(R) Core(TM) Ultra 5 125H 12Core(P4/E8/LPE2)/18Thread (CML 割り当て 16vCPU) |
| Memory | 128GiB (DDR5-5600 64GiB x2) (CML 割り当て 125GiB) |
| Disk | 1TB PCIe Gen4 (CML 割り当て 256GB) |
| 拡張 NIC | USB NIC 1G x1 (LUA5-U3-AGTE-NBK) |
| Host OS | Ubuntu24.02 LTS |
| HyperVisor | KVM |
| CML Verion | CML-Personal 2.8.1 |
試験構成
EVPN+VXLAN については別記事で書いているので詳細はそっちを参照で、少し修正しているがそちらをベースに拡張している
ルータ構成
- 各サイト内の Fabric は Spine/Leaf 構成
- サイト単位の Spine/Leaf/BGW(BorderGateway) の台数とホスト名は以下の通り (イメージ: NX-OS 9000)
- 1サイト目
- Spine 2台: spsw0101, spsw0102
- 動作試験時は起動台数の上限(スペック)があり、spsw0102 を停止している
- Leaf 4台: lfsw0101, lfsw0102, lfsw0103, lfsw0104
- lfsw0101とlfsw0102 は vPC ペア
- lfsw0103とlfsw0104 は vPC ペア
- 動作試験時は起動台数の上限(スペック)があり、lfsw0103/0104 を停止している
- BGW 2台: bgw0101, bgw0102
- Spine 2台: spsw0101, spsw0102
- 2サイト目
- Spine 2台: spsw0201, spsw0202
- 動作試験時は起動台数の上限(スペック)があり、spsw0202 を停止している
- Leaf 2台: lfsw0201, lfsw0202
- lfsw0201とlfsw0202 は vPC ペア
- BGW 2台: bgw0201, bgw0202
- Spine 2台: spsw0201, spsw0202
- 1サイト目
- サイト間で BGW 同士を接続するために WANルータを一台設置 (イメージ: IOSv)
- CML 以外から接続 + vPC keepalive 用に L2スイッチを Fabric 単位で設置 (イメージ: IOSvL2)
- Fabric01用: mgagsw01
- Fabric02用: mgagsw02
構成図
下記が Fabric01 と Fabric02 およびその間を接続する DCI の構成概要図となる
Down 表示になっているルータはこの環境での起動台数上限スペックの関係で絞った関係で落としている
アドレス設計
Spine - Leaf 構成 Underlay アドレス
今回は Fabric01 と Fabric02 の 2つの Fabric を用意している。
主にアンダーレイアドレスを 10.0.0.0/16, 10.1.0.0/16 と第二オクテッドで分離できるようにしている
| サブネット (Fabric01) | サブネット (Fabric02) | 利用アサインサイズ | 利用用途 |
|---|---|---|---|
| 10.0.0.0/24 | 10.1.0.0/24 | /32 | Loopback0 |
| 10.0.1.0/24 | 10.1.1.0/24 | /32 | Loopback1 |
| 10.0.2.0/24 | 10.1.2.0/24 | /32 | Loopback1 Secondary (vPC用) |
| 10.0.3.0/24 | 10.1.3.0/24 | /31 | Spine1 - Leaf 接続サブネット |
| 10.0.4.0/24 | 10.1.4.0/24 | /31 | Spine2 - Leaf 接続サブネット |
| 10.0.254.0/24 | 10.1.254.0/24 | /32 | Multi Site BGW interface Loopback112 (サイト内の Leaf からの他サイトの NextHop に見える) |
管理ネットワーク (mgmt0 ~ 外部サーバアクセス用)
主に CML より外の環境から直接 NX-OS へアクセスする用の接続経路。
vPC の peer-keepalive にも利用しているので変更時は注意。
| サブネット | 利用用途 |
|---|---|
| 192.168.129.0/24 | 外部 NW からの管理 IF アクセス |
DCI アドレス
主に 10.255.0.0/16 を利用する。BGW とサイト間接続のアドレスとして使用する
| サブネット | 利用アサインサイズ | 利用用途 |
|---|---|---|
| 10.255.0.0/24 | /32 | DCI ルータ Loopback0 |
| 10.255.1.0/24 | /31 | BGW (Fabric01) - WAN-PE(DCIルータ) 接続サブネット |
| 10.255.2.0/24 | /31 | BGW (Fabric02) - WAN-PE(DCIルータ) 接続サブネット |
| 10.255.255.0/24 | /32 | Multi Site BGW BGP Neighbor interface Loopback10 |
オーバレイ
2つのテナントを用意してオーバレイ環境での通信を試験する
| 項目 | Tenant A (Controller) | Tnenat B (tenant1) |
|---|---|---|
| 想定用途 | Private Cloud コントローラ プロバイダテナント1 | Private Cloud ユーザテナント1 |
| VPC (VRF) 名称 | controller-vpc1 | tenant1-vpc1 |
| VPC L3VNI | 9001 | 19001 |
| L3VNI VLAN (LeafSet1) | 3000 | 3001 |
| L3VNI VLAN (LeafSet2) | 3000 | 3001 |
| L3VNI VLAN (LeafSet3) | 3000 | 3001 |
| セグメント1 名称 | controller-vpc1-seg1 | tenant1-vpc1-server-seg1 |
| セグメント1 アドレス | 100.64.0.0/24 fd12:0:0:1::/64 |
172.16.0.0/24 fd21:0:0:1::/64 |
| セグメント1 VNI | 100 | 10100 |
| セグメント1 VLAN (LeafSet1) | 2001 | 100 |
| セグメント1 VLAN (LeafSet2) | - | 10 |
| セグメント1 VLAN (LeafSet3) | - | 100 |
| セグメント2 名称 | controller-vpc1-seg2 | - |
| セグメント2 アドレス | 100.64.1.0/24 fd12:0:0:2::/64 |
- |
| セグメント2 VNI | 101 | - |
| セグメント2 VLAN (LeafSet1) | - | - |
| セグメント2 VLAN (LeafSet2) | - | - |
| セグメント2 VLAN (LeafSet3) | 2002 | - |
配置サーバは下記の通り
| 項目 | controller-server01 | controller-server02 | tenant1-server01 | tenant1-server04 |
|---|---|---|---|---|
| 所属 Fabric | Fabric01 | Fabric02 | Fabric01 | Fabric02 |
| 所属 LeafSet | LeafSet1 | LeafSet3 | LeafSet1 | LeafSet3 |
| 所属 VRF | controller-vpc1 | controller-vpc1 | tenant1-vpc1 | tenant1-vpc1 |
| アドレス | 100.64.0.1/24 | 100.64.1.1/24 | 172.16.0.1/24 | 172.16.0.4/24 |
| 試験用途 | DCI L3ルーティング試験 | DCI L3ルーティング試験 | DCI L2ルーティング試験 | DCI L2ルーティング試験 |
CML 設定
CML 設定は Qiita で書くと編集で重くなるので、下記リンク先の GitHub に公開した
Fabric 設定は BGW 以外は単独で Spine-Leaf を構築するのと変わらないので上記リンク先参照として本記事では割愛する
BGW (Border-GateWay) 設定
BGW と他の Leaf と異なる設定ポイントを下記に抜粋して記載する
Border-Gateway の設定
border-gateway の定義を実施する。<site-id>はサイトごとに変える (ここでは Fabric01 が 101, Fabric02 が 102 としている)
evpn multisite border-gateway 101
delay-restore time 300
BUM トラフィック設定 + マルチサイト送信もとインターフェース(エニーキャストおよび仮装 IP VTEP)
NVE インターフェース (VTE) をマルチサイト用に拡張する。L2 VNI には 追加で multisite ingress-replication を設定する (Ingress Replication を使用している場合)
interface nve1
no shutdown
host-reachability protocol bgp
source-interface loopback1
+ multisite border-gateway interface loopback112
member vni 9001 associate-vrf
member vni 10100
+ multisite ingress-replication
ingress-replication protocol bgp
member vni 19001 associate-vrf
サイト間 eBGP 設定
外部 BGP への neighbor 作成および peer-type fabric-external 設定記載と rewrite-evpn-rt-asn を実施することで、書き換えと再発信ができる (自動ルートターゲット (ASN:VNI) の ASN をリライト(書き換え)を実施する)
router bgp 65001
...
neighbor 10.255.255.21
remote-as 65002
update-source loopback10
ebgp-multihop 5
+ peer-type fabric-external
address-family l2vpn evpn
send-community
send-community extended
+ rewrite-evpn-rt-asn
neighbor 10.255.255.22
remote-as 65002
update-source loopback10
ebgp-multihop 5
+ peer-type fabric-external
address-family l2vpn evpn
send-community
send-community extended
+ rewrite-evpn-rt-asn
...
インターフェース定義 (evpn multisite XXX-tracking)
evpn multisite fabric-tracking を内部インターフェース (Spine接続インターフェース)、
evpn multisite dci-tracking を外部インターフェース (WANルータ) 向けに設定する
...
interface Ethernet1/1
description spsw0101 eth1/8
no switchport
mtu 9216
ip address 10.0.3.8/31
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip ospf bfd
no shutdown
+ evpn multisite fabric-tracking
interface Ethernet1/2
description spsw0102 eth1/8
no switchport
mtu 9216
ip address 10.0.4.8/31
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
ip ospf bfd
no shutdown
+ evpn multisite fabric-tracking
...
interface Ethernet1/8
description WAN-PE01 Gi0/0
no switchport
mtu 9216
ip address 10.255.1.0/31
ip ospf network point-to-point
ip router ospf UNDERLAY area 0.0.0.0
no shutdown
+ evpn multisite dci-tracking
...
動作試験
DCI で疎通可能な L2/L3 接続での状態を確認して共有する
リソース制限で実際には NX-OS 9000 イメージは 10台が同時起動やっとだった。(+でWANルータ(IOSv )1台と、サーバ4(Ubuntu)台, mgmt集約用のスイッチ(IOSvL2)を2台を動かしている)
そのため、Fabric01 は LeafSet1 の lfsw0101/0102 と spsw0101 bgw0101/0102 の 5台、Fabric02 は LeafSet3 の lfsw0201/0202 と spsw0201, bgw0201, bgw0202 の 5台を動かしている
下記 show コマンドはホワイトペーパーの確認およびshowコマンドで確認しているので、詳細・確認ポイントは合わせて参照
show nve interface nve 1 detail
show nve multisite dci-links
show nve multisite fabric-links
show nve ethernet-segment
show bgp l2vpn evpn route-type 4
Leaf の状態も合わせて取ったのでこちらも記載する
show bgp l2vpn evpn
show ip route vrf all
show nve peers
show nve vni
show bgp l2vpn evpn summary
show l2route evpn mac all
show l2route evpn mac-ip all
show vpc brief
bgw0101
bgw0101# show nve interface nve 1 detail
dci-links
show nve multisite fabric-links
show nve ethernet-segment
show bgp l2vpn evpn route-type Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 525f.e240.1b08
Host Learning Mode: Control-Plane
Source-Interface: loopback1 (primary: 10.0.1.5, secondary: 0.0.0.0)
Source Interface State: Up
Virtual RMAC Advertisement: No
NVE Flags:
Interface Handle: 0x49000001
Source Interface hold-down-time: 180
Source Interface hold-up-time: 30
Remaining hold-down time: 0 seconds
Virtual Router MAC: N/A
Virtual Router MAC Re-origination: 0200.0a00.fe70
Interface state: nve-intf-add-complete
Fabric convergence time: 135 seconds
Fabric convergence time left: 0 seconds
Multisite delay-restore time: 300 seconds
Multisite delay-restore time left: 0 seconds
Multisite dci-advertise-pip configured: False
Multisite fabric-advertise-pip l3 configured: False
Multisite bgw-if: loopback112 (ip: 10.0.254.112, admin: Up, oper: Up)
Multisite bgw-if oper down reason:
bgw0101# show nve multisite dci-links
4Interface State
--------- -----
Ethernet1/8 Up
bgw0101# show nve multisite fabric-links
Interface State
--------- -----
Ethernet1/1 Up
Ethernet1/2 Up
bgw0101# show nve ethernet-segment
ESI: 0300.0000.0000.6500.0309
Parent interface: nve1
ES State: Up
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans: 100,3000
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 0
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.0.1.5 10.0.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
ESI: 0300.0000.0000.65ff.0309
Parent interface: nve1
ES State: Up
Used for split-horizon only
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans:
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 0
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.0.1.5 10.0.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
bgw0101# show bgp l2vpn evpn route-type 4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.0.0.6:27001
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.6]/136, version 812
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.6500.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.6:28001
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.6]/136, version 790
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.65ff.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.5:27001 (ES [0300.0000.0000.6500.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.5]/136, version 68
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.0.1.5 (metric 0) from 0.0.0.0 (10.0.0.5)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:0000.0000.0065
Path-id 1 advertised to peers:
10.0.0.254 10.255.255.21 10.255.255.22
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.6]/136, version 813
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.0.0.6:27001:[4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.6]/136
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.5:28001 (ES [0300.0000.0000.65ff.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.5]/136, version 6
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.0.1.5 (metric 0) from 0.0.0.0 (10.0.0.5)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:8000.0000.0065
Path-id 1 advertised to peers:
10.0.0.254 10.255.255.21 10.255.255.22
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.6]/136, version 791
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.0.0.6:28001:[4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.6]/136
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
bgw0101#
bgw0102
bgw0102# show nve interface nve 1 detail
dci-links
show nve multisite fabric-links
show nve ethernet-segment
show bgp l2vpn evpn route-type Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 5221.b497.1b08
Host Learning Mode: Control-Plane
Source-Interface: loopback1 (primary: 10.0.1.6, secondary: 0.0.0.0)
Source Interface State: Up
Virtual RMAC Advertisement: No
NVE Flags:
Interface Handle: 0x49000001
Source Interface hold-down-time: 180
Source Interface hold-up-time: 30
Remaining hold-down time: 0 seconds
Virtual Router MAC: N/A
Virtual Router MAC Re-origination: 0200.0a00.fe70
Interface state: nve-intf-add-complete
Fabric convergence time: 225 seconds
Fabric convergence time left: 0 seconds
Multisite delay-restore time: 300 seconds
Multisite delay-restore time left: 0 seconds
Multisite dci-advertise-pip configured: False
Multisite fabric-advertise-pip l3 configured: False
Multisite bgw-if: loopback112 (ip: 10.0.254.112, admin: Up, oper: Up)
Multisite bgw-if oper down reason:
bgw0102# show nve multisite dci-links
4Interface State
--------- -----
Ethernet1/8 Up
bgw0102# show nve multisite fabric-links
Interface State
--------- -----
Ethernet1/1 Up
Ethernet1/2 Up
bgw0102# show nve ethernet-segment
ESI: 0300.0000.0000.6500.0309
Parent interface: nve1
ES State: Up
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans: 1,3001
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 1
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.0.1.5 10.0.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
ESI: 0300.0000.0000.65ff.0309
Parent interface: nve1
ES State: Up
Used for split-horizon only
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans:
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 1
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.0.1.5 10.0.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
bgw0102# show bgp l2vpn evpn route-type 4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.0.0.5:27001
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.5]/136, version 163
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.6500.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.5 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0065
Originator: 10.0.0.5 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.5:28001
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.5]/136, version 162
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.65ff.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.5 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0065
Originator: 10.0.0.5 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.6:27001 (ES [0300.0000.0000.6500.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.5]/136, version 165
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.0.0.5:27001:[4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.5]/136
AS-Path: NONE, path sourced internal to AS
10.0.1.5 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0065
Originator: 10.0.0.5 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.6]/136, version 97
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.0.1.6 (metric 0) from 0.0.0.0 (10.0.0.6)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:0000.0000.0065
Path-id 1 advertised to peers:
10.0.0.254 10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.6:28001 (ES [0300.0000.0000.65ff.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.5]/136, version 164
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.0.0.5:28001:[4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.5]/136
AS-Path: NONE, path sourced internal to AS
10.0.1.5 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0065
Originator: 10.0.0.5 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.6]/136, version 2
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.0.1.6 (metric 0) from 0.0.0.0 (10.0.0.6)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:8000.0000.0065
Path-id 1 advertised to peers:
10.0.0.254 10.255.255.21 10.255.255.22
bgw0102#
bgw0201
bgw0201# show nve interface nve 1 detail
dci-links
show nve multisite fabric-links
show nve ethernet-segment
show bgp l2vpn evpn route-type 4Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 5248.790c.1b08
Host Learning Mode: Control-Plane
Source-Interface: loopback1 (primary: 10.1.1.5, secondary: 0.0.0.0)
Source Interface State: Up
Virtual RMAC Advertisement: No
NVE Flags:
Interface Handle: 0x49000001
Source Interface hold-down-time: 180
Source Interface hold-up-time: 30
Remaining hold-down time: 0 seconds
Virtual Router MAC: N/A
Virtual Router MAC Re-origination: 0200.0a01.fe70
Interface state: nve-intf-add-complete
Fabric convergence time: 225 seconds
Fabric convergence time left: 0 seconds
Multisite delay-restore time: 300 seconds
Multisite delay-restore time left: 0 seconds
Multisite dci-advertise-pip configured: False
Multisite fabric-advertise-pip l3 configured: False
Multisite bgw-if: loopback112 (ip: 10.1.254.112, admin: Up, oper: Up)
Multisite bgw-if oper down reason:
bgw0201# show nve multisite dci-links
Interface State
--------- -----
Ethernet1/8 Up
bgw0201# show nve multisite fabric-links
Interface State
--------- -----
Ethernet1/1 Up
Ethernet1/2 Up
bgw0201# show nve ethernet-segment
ESI: 0300.0000.0000.6600.0309
Parent interface: nve1
ES State: Up
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans: 100,3000
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 0
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.1.1.5 10.1.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
ESI: 0300.0000.0000.66ff.0309
Parent interface: nve1
ES State: Up
Used for split-horizon only
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans:
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 0
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.1.1.5 10.1.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
bgw0201# show bgp l2vpn evpn route-type 4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.1.0.6:27001
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.6]/136, version 808
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.6600.0309
AS-Path: NONE, path sourced internal to AS
10.1.1.6 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0066
Originator: 10.1.0.6 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.6:28001
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.6]/136, version 801
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.66ff.0309
AS-Path: NONE, path sourced internal to AS
10.1.1.6 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0066
Originator: 10.1.0.6 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.5:27001 (ES [0300.0000.0000.6600.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.5]/136, version 28
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.1.1.5 (metric 0) from 0.0.0.0 (10.1.0.5)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:0000.0000.0066
Path-id 1 advertised to peers:
10.1.0.254 10.255.255.11 10.255.255.12
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.6]/136, version 809
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.1.0.6:27001:[4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.6]/136
AS-Path: NONE, path sourced internal to AS
10.1.1.6 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0066
Originator: 10.1.0.6 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.5:28001 (ES [0300.0000.0000.66ff.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.5]/136, version 2
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.1.1.5 (metric 0) from 0.0.0.0 (10.1.0.5)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:8000.0000.0066
Path-id 1 advertised to peers:
10.1.0.254 10.255.255.11 10.255.255.12
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.6]/136, version 802
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.1.0.6:28001:[4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.6]/136
AS-Path: NONE, path sourced internal to AS
10.1.1.6 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0066
Originator: 10.1.0.6 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
bgw0201#
bgw0202
bgw0202# show nve interface nve 1 detail
Interface: nve1, State: Up, encapsulation: VXLAN
VPC Capability: VPC-VIP-Only [not-notified]
Local Router MAC: 5275.345d.1b08
Host Learning Mode: Control-Plane
Source-Interface: loopback1 (primary: 10.1.1.6, secondary: 0.0.0.0)
Source Interface State: Up
Virtual RMAC Advertisement: No
NVE Flags:
Interface Handle: 0x49000001
Source Interface hold-down-time: 180
Source Interface hold-up-time: 30
Remaining hold-down time: 0 seconds
Virtual Router MAC: N/A
Virtual Router MAC Re-origination: 0200.0a01.fe70
Interface state: nve-intf-add-complete
Fabric convergence time: 225 seconds
Fabric convergence time left: 0 seconds
Multisite delay-restore time: 300 seconds
Multisite delay-restore time left: 0 seconds
Multisite dci-advertise-pip configured: False
Multisite fabric-advertise-pip l3 configured: False
Multisite bgw-if: loopback112 (ip: 10.1.254.112, admin: Up, oper: Up)
Multisite bgw-if oper down reason:
bgw0202# show nve multisite dci-links
e ethernet-segment
show bgp l2vpn evpn route-type 4Interface State
--------- -----
Ethernet1/8 Up
bgw0202# show nve multisite fabric-links
Interface State
--------- -----
Ethernet1/1 Up
Ethernet1/2 Up
bgw0202# show nve ethernet-segment
ESI: 0300.0000.0000.6600.0309
Parent interface: nve1
ES State: Up
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans: 1,3001
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 1
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.1.1.5 10.1.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
ESI: 0300.0000.0000.66ff.0309
Parent interface: nve1
ES State: Up
Used for split-horizon only
Port-channel state: N/A
NVE Interface: nve1
NVE State: Up
Host Learning Mode: control-plane
Active Vlans: 1,100,3000-3001
DF Vlans:
Active VNIs: 9001,10100,19001
DF BDs:
DF VNIs:
CC failed for VLANs:
VLAN CC timer: no-timer
Number of ES members: 2
My ordinal: 1
DF timer start time: 00:00:00
Config State: N/A
DF List: 10.1.1.5 10.1.1.6
ES route added to L2RIB: True
EAD/ES routes added to L2RIB: False
EAD/EVI route timer age: not running
ESI type: Ether-segment
----------------------------------------
bgw0202# show bgp l2vpn evpn route-type 4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.1.0.5:27001
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.5]/136, version 123
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.6600.0309
AS-Path: NONE, path sourced internal to AS
10.1.1.5 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0066
Originator: 10.1.0.5 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.5:28001
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.5]/136, version 122
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.66ff.0309
AS-Path: NONE, path sourced internal to AS
10.1.1.5 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0066
Originator: 10.1.0.5 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.6:27001 (ES [0300.0000.0000.6600.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.5]/136, version 125
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.1.0.5:27001:[4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.5]/136
AS-Path: NONE, path sourced internal to AS
10.1.1.5 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0066
Originator: 10.1.0.5 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
BGP routing table entry for [4]:[0300.0000.0000.6600.0309]:[32]:[10.1.1.6]/136, version 89
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.1.1.6 (metric 0) from 0.0.0.0 (10.1.0.6)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:0000.0000.0066
Path-id 1 advertised to peers:
10.1.0.254 10.255.255.11 10.255.255.12
Route Distinguisher: 10.1.0.6:28001 (ES [0300.0000.0000.66ff.0309 0])
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.5]/136, version 124
Paths: (1 available, best #1)
Flags: (0x000012) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop
Imported from 10.1.0.5:28001:[4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.5]/136
AS-Path: NONE, path sourced internal to AS
10.1.1.5 (metric 42) from 10.1.0.254 (10.1.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0066
Originator: 10.1.0.5 Cluster list: 10.1.0.254
Path-id 1 advertised to peers:
10.255.255.11 10.255.255.12
BGP routing table entry for [4]:[0300.0000.0000.66ff.0309]:[32]:[10.1.1.6]/136, version 2
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn
Advertised path-id 1
Path type: local, path is valid, is best path, no labeled nexthop, is extd
AS-Path: NONE, path locally originated
10.1.1.6 (metric 0) from 0.0.0.0 (10.1.0.6)
Origin IGP, MED not set, localpref 100, weight 32768
Extcommunity: ENCAP:8 RT:8000.0000.0066
Path-id 1 advertised to peers:
10.1.0.254 10.255.255.11 10.255.255.12
bgw0202#
lfsw0101
lfsw0101# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 340, Local Router ID is 10.0.0.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 101:9001
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
Route Distinguisher: 101:10100
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
Route Distinguisher: 10.0.0.1:32867 (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.0.1.6 100 0 i
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.0.1.5 100 0 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.0.2.1 100 32768 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
10.0.1.5 100 0 i
*>i[3]:[0]:[32]:[10.0.1.6]/88
10.0.1.6 100 0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.1:32967 (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.1:34768 (L2VNI 100)
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[32]:[100.64.0.1]/272
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[128]:[fd12:0:0:1::101]/368
10.0.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.2:4
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.0.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
Route Distinguisher: 10.0.0.2:5
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.2 0 100 0 ?
Route Distinguisher: 10.0.0.2:6
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.0.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.0.1.2 0 100 0 ?
Route Distinguisher: 10.0.0.5:32867
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.0.1.5 100 0 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
10.0.1.5 100 0 i
Route Distinguisher: 10.0.0.6:32867
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.0.1.6 100 0 i
*>i[3]:[0]:[32]:[10.0.1.6]/88
10.0.1.6 100 0 i
Route Distinguisher: 10.0.0.1:4 (L3VNI 9001)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
* i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
Route Distinguisher: 10.0.0.1:5 (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
* i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
Route Distinguisher: 10.0.0.1:6 (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
* i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
lfsw0101# show ip route vrf all
all
show vpc briefIP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
10.0.0.1/32, ubest/mbest: 2/0, attached
*via 10.0.0.1, Lo0, [0/0], 1d02h, local
*via 10.0.0.1, Lo0, [0/0], 1d02h, direct
10.0.0.2/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.0.5/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d02h, ospf-UNDERLAY, intra
10.0.0.6/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 02:33:13, ospf-UNDERLAY, intra
10.0.0.254/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/41], 1d02h, ospf-UNDERLAY, intra
10.0.1.1/32, ubest/mbest: 2/0, attached
*via 10.0.1.1, Lo1, [0/0], 1d02h, local
*via 10.0.1.1, Lo1, [0/0], 1d02h, direct
10.0.1.2/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.1.5/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d02h, ospf-UNDERLAY, intra
10.0.1.6/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 02:33:13, ospf-UNDERLAY, intra
10.0.2.1/32, ubest/mbest: 2/0, attached
*via 10.0.2.1, Lo1, [0/0], 1d02h, local
*via 10.0.2.1, Lo1, [0/0], 1d02h, direct
10.0.3.0/31, ubest/mbest: 1/0, attached
*via 10.0.3.0, Eth1/8, [0/0], 1d02h, direct
10.0.3.0/32, ubest/mbest: 1/0, attached
*via 10.0.3.0, Eth1/8, [0/0], 1d02h, local
10.0.3.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/80], 1d02h, ospf-UNDERLAY, intra
10.0.3.4/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/80], 1d02h, ospf-UNDERLAY, intra
10.0.3.6/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/80], 1d02h, ospf-UNDERLAY, intra
10.0.3.8/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/80], 1d02h, ospf-UNDERLAY, intra
10.0.3.10/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/80], 1d02h, ospf-UNDERLAY, intra
10.0.4.0/31, ubest/mbest: 1/0, attached
*via 10.0.4.0, Eth1/7, [0/0], 1d02h, direct
10.0.4.0/32, ubest/mbest: 1/0, attached
*via 10.0.4.0, Eth1/7, [0/0], 1d02h, local
10.0.4.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.0.4.8/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.0.4.10/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/120], 02:33:13, ospf-UNDERLAY, intra
10.0.254.112/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d02h, ospf-UNDERLAY, intra
10.1.0.1/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/202], 1d02h, ospf-UNDERLAY, intra
10.1.0.2/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.0.5/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 1d02h, ospf-UNDERLAY, intra
10.1.0.6/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 02:33:04, ospf-UNDERLAY, intra
10.1.0.254/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/162], 1d02h, ospf-UNDERLAY, intra
10.1.1.1/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/202], 1d02h, ospf-UNDERLAY, intra
10.1.1.2/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.1.5/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 1d02h, ospf-UNDERLAY, intra
10.1.1.6/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 02:33:04, ospf-UNDERLAY, intra
10.1.2.1/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/202], 1d02h, ospf-UNDERLAY, intra
10.1.3.0/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/201], 1d02h, ospf-UNDERLAY, intra
10.1.3.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/201], 1d02h, ospf-UNDERLAY, intra
10.1.3.4/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/201], 1d02h, ospf-UNDERLAY, intra
10.1.3.6/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/201], 1d02h, ospf-UNDERLAY, intra
10.1.3.8/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/161], 1d02h, ospf-UNDERLAY, intra
10.1.3.10/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/161], 02:33:04, ospf-UNDERLAY, intra
10.1.4.0/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/241], 1d02h, ospf-UNDERLAY, intra
10.1.4.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.1.4.8/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/161], 1d02h, ospf-UNDERLAY, intra
10.1.4.10/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/161], 02:33:04, ospf-UNDERLAY, intra
10.1.254.112/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 1d02h, ospf-UNDERLAY, intra
10.255.0.1/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/121], 1d02h, ospf-UNDERLAY, intra
10.255.1.0/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/120], 1d02h, ospf-UNDERLAY, intra
10.255.1.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/120], 02:33:13, ospf-UNDERLAY, intra
10.255.2.0/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/121], 1d02h, ospf-UNDERLAY, intra
10.255.2.2/31, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/121], 1d02h, ospf-UNDERLAY, intra
10.255.255.11/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 1d02h, ospf-UNDERLAY, intra
10.255.255.12/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/81], 02:33:13, ospf-UNDERLAY, intra
10.255.255.21/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 1d02h, ospf-UNDERLAY, intra
10.255.255.22/32, ubest/mbest: 1/0
*via 10.0.3.1, Eth1/8, [110/122], 02:33:04, ospf-UNDERLAY, intra
IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
0.0.0.0/0, ubest/mbest: 1/0
*via 192.168.129.254, [1/0], 1d02h, static
192.168.129.0/24, ubest/mbest: 1/0, attached
*via 192.168.129.71, mgmt0, [0/0], 1d02h, direct
192.168.129.71/32, ubest/mbest: 1/0, attached
*via 192.168.129.71, mgmt0, [0/0], 1d02h, local
IP Route Table for VRF "controller-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
100.64.0.0/24, ubest/mbest: 1/0, attached
*via 100.64.0.254, Vlan2001, [0/0], 1d02h, direct
100.64.0.1/32, ubest/mbest: 1/0, attached
*via 100.64.0.1, Vlan2001, [190/0], 00:52:00, hmm
100.64.0.254/32, ubest/mbest: 1/0, attached
*via 100.64.0.254, Vlan2001, [0/0], 1d02h, local
100.64.1.0/24, ubest/mbest: 1/0
*via 10.0.254.112%default, [200/1], 1d01h, bgp-65001, internal, tag 65002, segid: 9001 tunnelid: 0xa00fe70 encap: VXLAN
IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.16.0.0/24, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d02h, direct
172.16.0.1/32, ubest/mbest: 1/0, attached
*via 172.16.0.1, Vlan100, [190/0], 00:22:01, hmm
172.16.0.4/32, ubest/mbest: 1/0
*via 10.0.254.112%default, [200/2000], 1d01h, bgp-65001, internal, tag 65002, segid: 19001 tunnelid: 0xa00fe70 encap: VXLAN
172.16.0.254/32, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d02h, local
IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.17.0.0/24, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d02h, direct
172.17.0.254/32, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d02h, local
IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
lfsw0101#
lfsw0101# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 10.0.1.2 Up CP 1d01h 527e.b8b1.1b08
nve1 10.0.1.5 Up CP 1d02h n/a
nve1 10.0.1.6 Up CP 02:31:02 n/a
nve1 10.0.254.112 Up CP 1d02h 0200.0a00.fe70
lfsw0101# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
S-ND - Suppress ND
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
HYB - Hybrid IRB mode
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 100 UnicastBGP Up CP L2 [2001]
nve1 9001 n/a Up CP L3 [controller-vpc1]
nve1 10100 UnicastBGP Up CP L2 [100]
nve1 19001 n/a Up CP L3 [tenant1-vpc1]
nve1 20200 UnicastBGP Up CP L2 [200]
nve1 29001 n/a Up CP L3 [tenant2-vpc1]
lfsw0101# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.1, local AS number 65001
BGP table version is 336, L2VPN EVPN config peers 2, capable peers 1
52 network entries and 58 paths using 14160 bytes of memory
BGP attribute entries [49/18032], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [3/12]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.0.0.253 4 0 63 36 0 0 0 1d01h Idle
10.0.0.254 4 65001 1735 1627 336 0 0 1d02h 18
Neighbor T AS PfxRcd Type-2 Type-3 Type-4 Type-5 Type-12
10.0.0.253 I 0 Idle 0 0 0 0 0
10.0.0.254 I 65001 18 8 2 0 8 0
lfsw0101# show l2route evpn mac all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan
(PipOrp): Directly connected Orphan to PIP based vPC BGW
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Prod Flags Seq No Next-Hops
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
100 eeb5.9b9e.afc7 BGP SplRcv 0 10.0.254.112 (Label: 10100)
100 fa20.ddcf.46a4 Local L, 0 Po12
200 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
2001 3eb0.6034.0816 Local L, 0 Po11
2001 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3000 0200.0a00.fe70 VXLAN Rmac, 0 10.0.254.112
3000 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3000 527e.b8b1.1b08 VXLAN Rmac, 0 10.0.1.2
3001 0200.0a00.fe70 VXLAN Rmac, 0 10.0.254.112
3001 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3001 527e.b8b1.1b08 VXLAN Rmac, 0 10.0.1.2
3002 523e.d42c.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3002 527e.b8b1.1b08 VXLAN Rmac, 0 10.0.1.2
lfsw0101# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW
(Pipporp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Host IP Prod Flags Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ----------------- ---------- ---------------------------------------------------------
100 fa20.ddcf.46a4 172.16.0.1 HMM L, 0 Local
100 eeb5.9b9e.afc7 172.16.0.4 BGP -- 0 10.0.254.112 (Label: 10100)
2001 3eb0.6034.0816 100.64.0.1 HMM L, 0 Local
lfsw0101# show vpc brief
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 1
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary
Number of vPCs configured : 3
Peer Gateway : Enabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled, timer is off.(timeout = 240s)
Delay-restore status : Timer is off.(timeout = 150s)
Delay-restore SVI status : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router : Disabled
Virtual-peerlink mode : Enabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ -------------------------------------------------
1 Po1 up 1,100,200,2001,3000-3002
vPC status
----------------------------------------------------------------------------
Id Port Status Consistency Reason Active vlans
-- ------------ ------ ----------- ------ ---------------
11 Po11 up success success 1,100,200,2001,
3000-3002
12 Po12 up success success 1,100,200,2001,
3000-3002
13 Po13 down* success success -
Please check "show vpc consistency-parameters vpc <vpc-num>" for the
consistency reason of down vpc and for type-2 consistency reasons for
any vpc.
lfsw0101#
lfsw0102
lfsw0102# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 239, Local Router ID is 10.0.0.2
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 101:9001
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
Route Distinguisher: 101:10100
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
Route Distinguisher: 10.0.0.1:4
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.1 0 100 0 ?
Route Distinguisher: 10.0.0.1:5
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.1 0 100 0 ?
Route Distinguisher: 10.0.0.1:6
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.0.1.1 0 100 0 ?
Route Distinguisher: 10.0.0.2:32867 (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.0.1.6 100 0 i
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.0.1.5 100 0 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.0.2.1 100 32768 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
10.0.1.5 100 0 i
*>i[3]:[0]:[32]:[10.0.1.6]/88
10.0.1.6 100 0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.2:32967 (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.2:34768 (L2VNI 100)
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[32]:[100.64.0.1]/272
10.0.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[3eb0.6034.0816]:[128]:[fd12:0:0:1::101]/368
10.0.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
Route Distinguisher: 10.0.0.5:32867
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.0.1.5 100 0 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
10.0.1.5 100 0 i
Route Distinguisher: 10.0.0.6:32867
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.0.1.6 100 0 i
*>i[3]:[0]:[32]:[10.0.1.6]/88
10.0.1.6 100 0 i
Route Distinguisher: 10.0.0.2:4 (L3VNI 9001)
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
* i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.0.1.1 0 100 0 ?
*>l 10.0.1.2 0 100 32768 ?
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.0.1.1 0 100 0 ?
*>l[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 32768 ?
* i 10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
*>i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.0.1.1 0 100 0 ?
Route Distinguisher: 10.0.0.2:5 (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.1 0 100 0 ?
*>l 10.0.1.2 0 100 32768 ?
*>l[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.2 0 100 32768 ?
* i 10.0.1.1 0 100 0 ?
Route Distinguisher: 10.0.0.2:6 (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.0.1.1 0 100 0 ?
*>l 10.0.1.2 0 100 32768 ?
*>l[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.0.1.2 0 100 32768 ?
* i 10.0.1.1 0 100 0 ?
lfsw0102# show ip route vrf all
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
10.0.0.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.0.2/32, ubest/mbest: 2/0, attached
*via 10.0.0.2, Lo0, [0/0], 1d01h, local
*via 10.0.0.2, Lo0, [0/0], 1d01h, direct
10.0.0.5/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.0.6/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 02:34:18, ospf-UNDERLAY, intra
10.0.0.254/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/41], 1d01h, ospf-UNDERLAY, intra
10.0.1.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.1.2/32, ubest/mbest: 2/0, attached
*via 10.0.1.2, Lo1, [0/0], 1d01h, local
*via 10.0.1.2, Lo1, [0/0], 1d01h, direct
10.0.1.5/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.0.1.6/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 02:34:18, ospf-UNDERLAY, intra
10.0.2.1/32, ubest/mbest: 2/0, attached
*via 10.0.2.1, Lo1, [0/0], 1d01h, local
*via 10.0.2.1, Lo1, [0/0], 1d01h, direct
10.0.3.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.0.3.2/31, ubest/mbest: 1/0, attached
*via 10.0.3.2, Eth1/8, [0/0], 1d01h, direct
10.0.3.2/32, ubest/mbest: 1/0, attached
*via 10.0.3.2, Eth1/8, [0/0], 1d01h, local
10.0.3.4/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.0.3.6/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.0.3.8/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.0.3.10/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.0.4.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.0.4.2/31, ubest/mbest: 1/0, attached
*via 10.0.4.2, Eth1/7, [0/0], 1d01h, direct
10.0.4.2/32, ubest/mbest: 1/0, attached
*via 10.0.4.2, Eth1/7, [0/0], 1d01h, local
10.0.4.8/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.0.4.10/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/120], 02:34:18, ospf-UNDERLAY, intra
10.0.254.112/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.0.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.0.2/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.0.5/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.1.0.6/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 02:34:09, ospf-UNDERLAY, intra
10.1.0.254/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/162], 1d01h, ospf-UNDERLAY, intra
10.1.1.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.1.2/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.1.5/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.1.1.6/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 02:34:09, ospf-UNDERLAY, intra
10.1.2.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.1.3.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.1.3.2/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.1.3.4/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.1.3.6/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.1.3.8/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/161], 1d01h, ospf-UNDERLAY, intra
10.1.3.10/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/161], 02:34:09, ospf-UNDERLAY, intra
10.1.4.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.1.4.2/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.1.4.8/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/161], 1d01h, ospf-UNDERLAY, intra
10.1.4.10/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/161], 02:34:09, ospf-UNDERLAY, intra
10.1.254.112/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.255.0.1/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.1.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.255.1.2/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/120], 02:34:18, ospf-UNDERLAY, intra
10.255.2.0/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.2.2/31, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.255.11/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.255.255.12/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/81], 02:34:18, ospf-UNDERLAY, intra
10.255.255.21/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.255.255.22/32, ubest/mbest: 1/0
*via 10.0.3.3, Eth1/8, [110/122], 02:34:09, ospf-UNDERLAY, intra
IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
0.0.0.0/0, ubest/mbest: 1/0
*via 192.168.129.254, [1/0], 1d01h, static
192.168.129.0/24, ubest/mbest: 1/0, attached
*via 192.168.129.72, mgmt0, [0/0], 1d01h, direct
192.168.129.72/32, ubest/mbest: 1/0, attached
*via 192.168.129.72, mgmt0, [0/0], 1d01h, local
IP Route Table for VRF "controller-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
100.64.0.0/24, ubest/mbest: 1/0, attached
*via 100.64.0.254, Vlan2001, [0/0], 1d01h, direct
100.64.0.1/32, ubest/mbest: 1/0, attached
*via 100.64.0.1, Vlan2001, [190/0], 00:53:06, hmm
100.64.0.254/32, ubest/mbest: 1/0, attached
*via 100.64.0.254, Vlan2001, [0/0], 1d01h, local
IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.16.0.0/24, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d01h, direct
172.16.0.1/32, ubest/mbest: 1/0, attached
*via 172.16.0.1, Vlan100, [190/0], 00:23:06, hmm
172.16.0.4/32, ubest/mbest: 1/0
*via 10.0.254.112%default, [200/2000], 1d01h, bgp-65001, internal, tag 65002, segid: 19001 tunnelid: 0xa00fe70 encap: VXLAN
172.16.0.254/32, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d01h, local
IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.17.0.0/24, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d01h, direct
172.17.0.254/32, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d01h, local
IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
lfsw0102#
lfsw0102# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 10.0.1.1 Up CP 1d01h 523e.d42c.1b08
nve1 10.0.1.5 Up CP 1d01h n/a
nve1 10.0.1.6 Up CP 02:32:06 n/a
nve1 10.0.254.112 Up CP 1d01h 0200.0a00.fe70
lfsw0102# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
S-ND - Suppress ND
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
HYB - Hybrid IRB mode
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 100 UnicastBGP Up CP L2 [2001]
nve1 9001 n/a Up CP L3 [controller-vpc1]
nve1 10100 UnicastBGP Up CP L2 [100]
nve1 19001 n/a Up CP L3 [tenant1-vpc1]
nve1 20200 UnicastBGP Up CP L2 [200]
nve1 29001 n/a Up CP L3 [tenant2-vpc1]
lfsw0102# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.2, local AS number 65001
BGP table version is 235, L2VPN EVPN config peers 2, capable peers 1
55 network entries and 61 paths using 14772 bytes of memory
BGP attribute entries [49/18032], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [3/12]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.0.0.253 4 0 0 0 0 0 0 1d01h Idle
10.0.0.254 4 65001 1680 1593 235 0 0 1d01h 18
Neighbor T AS PfxRcd Type-2 Type-3 Type-4 Type-5 Type-12
10.0.0.253 I 0 Idle 0 0 0 0 0
10.0.0.254 I 65001 18 8 2 0 8 0
lfsw0102# show l2route evpn mac all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan
(PipOrp): Directly connected Orphan to PIP based vPC BGW
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Prod Flags Seq No Next-Hops
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
100 eeb5.9b9e.afc7 BGP SplRcv 0 10.0.254.112 (Label: 10100)
100 fa20.ddcf.46a4 Local L, 0 Po12
200 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
2001 3eb0.6034.0816 Local L, 0 Po11
2001 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3000 0200.0a00.fe70 VXLAN Rmac, 0 10.0.254.112
3000 523e.d42c.1b08 VXLAN Rmac, 0 10.0.1.1
3000 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3001 0200.0a00.fe70 VXLAN Rmac, 0 10.0.254.112
3001 523e.d42c.1b08 VXLAN Rmac, 0 10.0.1.1
3001 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
3002 523e.d42c.1b08 VXLAN Rmac, 0 10.0.1.1
3002 527e.b8b1.1b08 VXLAN Stt,Nho,Dum, 0 10.0.2.1
lfsw0102# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW
(Pipporp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Host IP Prod Flags Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ----------------- ---------- ---------------------------------------------------------
100 fa20.ddcf.46a4 172.16.0.1 HMM L, 0 Local
100 eeb5.9b9e.afc7 172.16.0.4 BGP -- 0 10.0.254.112 (Label: 10100)
2001 3eb0.6034.0816 100.64.0.1 HMM L, 0 Local
lfsw0102# show vpc brief
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 1
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary
Number of vPCs configured : 3
Peer Gateway : Enabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled, timer is off.(timeout = 240s)
Delay-restore status : Timer is off.(timeout = 150s)
Delay-restore SVI status : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router : Disabled
Virtual-peerlink mode : Enabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ -------------------------------------------------
1 Po1 up 1,100,200,2001,3000-3002
vPC status
----------------------------------------------------------------------------
Id Port Status Consistency Reason Active vlans
-- ------------ ------ ----------- ------ ---------------
11 Po11 up success success 1,100,200,2001,
3000-3002
12 Po12 up success success 1,100,200,2001,
3000-3002
13 Po13 down* success success -
Please check "show vpc consistency-parameters vpc <vpc-num>" for the
consistency reason of down vpc and for type-2 consistency reasons for
any vpc.
lfsw0102#
lfsw0201
lfsw0201# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 618, Local Router ID is 10.1.0.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 102:9001
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.1.254.112 1 100 0 65001 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
Route Distinguisher: 102:10100
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
Route Distinguisher: 102:19001
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
Route Distinguisher: 10.1.0.1:32867 (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.1.1.5 100 0 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.1.1.6 100 0 i
*>i[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>l[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
*>i[3]:[0]:[32]:[10.1.1.5]/88
10.1.1.5 100 0 i
*>i[3]:[0]:[32]:[10.1.1.6]/88
10.1.1.6 100 0 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.1:32967 (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.1:34769 (L2VNI 101)
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[32]:[100.64.1.1]/272
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[128]:[fd12:0:0:2::101]/368
10.1.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.2:4
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.1.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.1.1.2 0 100 0 ?
Route Distinguisher: 10.1.0.2:5
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.1.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.1.1.2 0 100 0 ?
Route Distinguisher: 10.1.0.2:6
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.1.1.2 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.1.1.2 0 100 0 ?
Route Distinguisher: 10.1.0.5:32867
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.1.1.5 100 0 i
*>i[3]:[0]:[32]:[10.1.1.5]/88
10.1.1.5 100 0 i
Route Distinguisher: 10.1.0.6:32867
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.1.1.6 100 0 i
*>i[3]:[0]:[32]:[10.1.1.6]/88
10.1.1.6 100 0 i
Route Distinguisher: 10.1.0.1:4 (L3VNI 9001)
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
Route Distinguisher: 10.1.0.1:5 (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
Route Distinguisher: 10.1.0.1:6 (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
* i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.1.1.2 0 100 0 ?
*>l 10.1.1.1 0 100 32768 ?
lfsw0201# show ip route vrf all
all
show vpc briefIP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
10.0.0.1/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 1d02h, ospf-UNDERLAY, intra
10.0.0.2/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.0.5/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/122], 1d06h, ospf-UNDERLAY, intra
10.0.0.6/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 02:34:53, ospf-UNDERLAY, intra
10.0.0.254/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/162], 1d04h, ospf-UNDERLAY, intra
10.0.1.1/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 1d02h, ospf-UNDERLAY, intra
10.0.1.2/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.1.5/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/122], 1d06h, ospf-UNDERLAY, intra
10.0.1.6/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 02:34:53, ospf-UNDERLAY, intra
10.0.2.1/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 1d07h, ospf-UNDERLAY, intra
10.0.3.0/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/201], 1d04h, ospf-UNDERLAY, intra
10.0.3.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/201], 1d04h, ospf-UNDERLAY, intra
10.0.3.4/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/201], 1d04h, ospf-UNDERLAY, intra
10.0.3.6/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/201], 1d04h, ospf-UNDERLAY, intra
10.0.3.8/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/161], 1d06h, ospf-UNDERLAY, intra
10.0.3.10/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/201], 21:24:55, ospf-UNDERLAY, intra
10.0.4.0/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.0.4.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.0.4.8/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/161], 1d06h, ospf-UNDERLAY, intra
10.0.4.10/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/241], 02:34:53, ospf-UNDERLAY, intra
10.0.254.112/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/122], 1d07h, ospf-UNDERLAY, intra
10.1.0.1/32, ubest/mbest: 2/0, attached
*via 10.1.0.1, Lo0, [0/0], 2d08h, local
*via 10.1.0.1, Lo0, [0/0], 2d08h, direct
10.1.0.2/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.0.5/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 2d08h, ospf-UNDERLAY, intra
10.1.0.6/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 02:34:45, ospf-UNDERLAY, intra
10.1.0.254/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/41], 2d08h, ospf-UNDERLAY, intra
10.1.1.1/32, ubest/mbest: 2/0, attached
*via 10.1.1.1, Lo1, [0/0], 2d08h, local
*via 10.1.1.1, Lo1, [0/0], 2d08h, direct
10.1.1.2/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.1.5/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 2d08h, ospf-UNDERLAY, intra
10.1.1.6/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 02:34:45, ospf-UNDERLAY, intra
10.1.2.1/32, ubest/mbest: 2/0, attached
*via 10.1.2.1, Lo1, [0/0], 2d08h, local
*via 10.1.2.1, Lo1, [0/0], 2d08h, direct
10.1.3.0/31, ubest/mbest: 1/0, attached
*via 10.1.3.0, Eth1/8, [0/0], 2d08h, direct
10.1.3.0/32, ubest/mbest: 1/0, attached
*via 10.1.3.0, Eth1/8, [0/0], 2d08h, local
10.1.3.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/80], 2d08h, ospf-UNDERLAY, intra
10.1.3.4/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/80], 2d08h, ospf-UNDERLAY, intra
10.1.3.6/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/80], 2d08h, ospf-UNDERLAY, intra
10.1.3.8/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/80], 2d08h, ospf-UNDERLAY, intra
10.1.3.10/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/80], 2d08h, ospf-UNDERLAY, intra
10.1.4.0/31, ubest/mbest: 1/0, attached
*via 10.1.4.0, Eth1/7, [0/0], 2d08h, direct
10.1.4.0/32, ubest/mbest: 1/0, attached
*via 10.1.4.0, Eth1/7, [0/0], 2d08h, local
10.1.4.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.1.4.8/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/120], 1d04h, ospf-UNDERLAY, intra
10.1.4.10/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/120], 02:34:45, ospf-UNDERLAY, intra
10.1.254.112/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 2d08h, ospf-UNDERLAY, intra
10.255.0.1/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/121], 1d07h, ospf-UNDERLAY, intra
10.255.1.0/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/121], 1d07h, ospf-UNDERLAY, intra
10.255.1.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/121], 1d07h, ospf-UNDERLAY, intra
10.255.2.0/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/120], 1d07h, ospf-UNDERLAY, intra
10.255.2.2/31, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/120], 02:34:45, ospf-UNDERLAY, intra
10.255.255.11/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/122], 1d06h, ospf-UNDERLAY, intra
10.255.255.12/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/202], 02:34:53, ospf-UNDERLAY, intra
10.255.255.21/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 2d08h, ospf-UNDERLAY, intra
10.255.255.22/32, ubest/mbest: 1/0
*via 10.1.3.1, Eth1/8, [110/81], 02:34:45, ospf-UNDERLAY, intra
IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
0.0.0.0/0, ubest/mbest: 1/0
*via 192.168.129.254, [1/0], 2d08h, static
192.168.129.0/24, ubest/mbest: 1/0, attached
*via 192.168.129.81, mgmt0, [0/0], 2d08h, direct
192.168.129.81/32, ubest/mbest: 1/0, attached
*via 192.168.129.81, mgmt0, [0/0], 2d08h, local
IP Route Table for VRF "controller-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
100.64.0.0/24, ubest/mbest: 1/0
*via 10.1.254.112%default, [200/1], 1d04h, bgp-65002, internal, tag 65001, segid: 9001 tunnelid: 0xa01fe70 encap: VXLAN
100.64.1.0/24, ubest/mbest: 1/0, attached
*via 100.64.1.254, Vlan2002, [0/0], 2d08h, direct
100.64.1.1/32, ubest/mbest: 1/0, attached
*via 100.64.1.1, Vlan2002, [190/0], 00:42:37, hmm
100.64.1.254/32, ubest/mbest: 1/0, attached
*via 100.64.1.254, Vlan2002, [0/0], 2d08h, local
IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.16.0.0/24, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 2d08h, direct
172.16.0.1/32, ubest/mbest: 1/0
*via 10.1.254.112%default, [200/2000], 1d04h, bgp-65002, internal, tag 65001, segid: 19001 tunnelid: 0xa01fe70 encap: VXLAN
172.16.0.4/32, ubest/mbest: 1/0, attached
*via 172.16.0.4, Vlan100, [190/0], 00:25:14, hmm
172.16.0.254/32, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 2d08h, local
IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.17.0.0/24, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 2d08h, direct
172.17.0.254/32, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 2d08h, local
IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
lfsw0201#
lfsw0201# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 10.1.1.2 Up CP 1d01h 5264.0db8.1b08
nve1 10.1.1.5 Up CP 2d08h n/a
nve1 10.1.1.6 Up CP 02:32:33 n/a
nve1 10.1.254.112 Up CP 1d07h 0200.0a01.fe70
lfsw0201# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
S-ND - Suppress ND
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
HYB - Hybrid IRB mode
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 101 UnicastBGP Up CP L2 [2002]
nve1 9001 n/a Up CP L3 [controller-vpc1]
nve1 10100 UnicastBGP Up CP L2 [100]
nve1 19001 n/a Up CP L3 [tenant1-vpc1]
nve1 20200 UnicastBGP Up CP L2 [200]
nve1 29001 n/a Up CP L3 [tenant2-vpc1]
lfsw0201# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.1.0.1, local AS number 65002
BGP table version is 612, L2VPN EVPN config peers 2, capable peers 1
52 network entries and 58 paths using 14256 bytes of memory
BGP attribute entries [47/17296], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [3/12]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.1.0.253 4 0 18 11 0 0 0 1d04h Idle
10.1.0.254 4 65002 3615 3499 612 0 0 2d08h 19
Neighbor T AS PfxRcd Type-2 Type-3 Type-4 Type-5 Type-12
10.1.0.253 I 0 Idle 0 0 0 0 0
10.1.0.254 I 65002 19 8 2 0 9 0
lfsw0201# show l2route evpn mac all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan
(PipOrp): Directly connected Orphan to PIP based vPC BGW
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Prod Flags Seq No Next-Hops
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
100 eeb5.9b9e.afc7 Local L, 0 Po12
100 fa20.ddcf.46a4 BGP SplRcv 0 10.1.254.112 (Label: 10100)
200 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
2002 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
2002 c289.d7e2.fe6e Local L, 0 Po11
3000 0200.0a01.fe70 VXLAN Rmac, 0 10.1.254.112
3000 5264.0db8.1b08 VXLAN Rmac, 0 10.1.1.2
3000 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
3001 0200.0a01.fe70 VXLAN Rmac, 0 10.1.254.112
3001 5264.0db8.1b08 VXLAN Rmac, 0 10.1.1.2
3001 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
3002 5264.0db8.1b08 VXLAN Rmac, 0 10.1.1.2
3002 52b5.b939.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
lfsw0201# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW
(Pipporp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Host IP Prod Flags Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ----------------- ---------- ---------------------------------------------------------
100 fa20.ddcf.46a4 172.16.0.1 BGP -- 0 10.1.254.112 (Label: 10100)
100 eeb5.9b9e.afc7 172.16.0.4 HMM L, 0 Local
2002 c289.d7e2.fe6e 100.64.1.1 HMM L, 0 Local
lfsw0201# show vpc brief
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 1
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : primary
Number of vPCs configured : 3
Peer Gateway : Enabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled, timer is off.(timeout = 240s)
Delay-restore status : Timer is off.(timeout = 150s)
Delay-restore SVI status : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router : Disabled
Virtual-peerlink mode : Enabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ -------------------------------------------------
1 Po1 up 1,100,200,2002,3000-3002
vPC status
----------------------------------------------------------------------------
Id Port Status Consistency Reason Active vlans
-- ------------ ------ ----------- ------ ---------------
11 Po11 up success success 1,100,200,2002,
3000-3002
12 Po12 up success success 1,100,200,2002,
3000-3002
13 Po13 down* success success -
Please check "show vpc consistency-parameters vpc <vpc-num>" for the
consistency reason of down vpc and for type-2 consistency reasons for
any vpc.
lfsw0201#
lfsw0202
lfsw0202# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 231, Local Router ID is 10.1.0.2
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 102:9001
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.1.254.112 1 100 0 65001 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
Route Distinguisher: 102:10100
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
Route Distinguisher: 102:19001
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
Route Distinguisher: 10.1.0.1:4
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.1.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.1.1.1 0 100 0 ?
Route Distinguisher: 10.1.0.1:5
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.1.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.1.1.1 0 100 0 ?
Route Distinguisher: 10.1.0.1:6
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.1.1.1 0 100 0 ?
*>i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.1.1.1 0 100 0 ?
Route Distinguisher: 10.1.0.2:32867 (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.1.1.5 100 0 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 100 0 65001 i
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.1.1.6 100 0 i
*>i[2]:[0]:[0]:[48]:[527e.b8b1.1b08]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>l[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.1.254.112 2000 100 0 65001 i
*>l[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
*>i[3]:[0]:[32]:[10.1.1.5]/88
10.1.1.5 100 0 i
*>i[3]:[0]:[32]:[10.1.1.6]/88
10.1.1.6 100 0 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.2:32967 (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.2:34769 (L2VNI 101)
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[32]:[100.64.1.1]/272
10.1.2.1 100 32768 i
*>l[2]:[0]:[0]:[48]:[c289.d7e2.fe6e]:[128]:[fd12:0:0:2::101]/368
10.1.2.1 100 32768 i
*>l[3]:[0]:[32]:[10.1.2.1]/88
10.1.2.1 100 32768 i
Route Distinguisher: 10.1.0.5:32867
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.1.1.5 100 0 i
*>i[3]:[0]:[32]:[10.1.1.5]/88
10.1.1.5 100 0 i
Route Distinguisher: 10.1.0.6:32867
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.1.1.6 100 0 i
*>i[3]:[0]:[32]:[10.1.1.6]/88
10.1.1.6 100 0 i
Route Distinguisher: 10.1.0.2:4 (L3VNI 9001)
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
Route Distinguisher: 10.1.0.2:5 (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.1.254.112 2000 100 0 65001 i
*>i[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[128]:[fd21:0:0:1::101]/368
10.1.254.112 2000 100 0 65001 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.1.254.112 1 100 0 65001 ?
* i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
Route Distinguisher: 10.1.0.2:6 (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.1.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
* i[5]:[0]:[0]:[64]:[fd22:0:0:1::]/416
10.1.1.1 0 100 0 ?
*>l 10.1.1.2 0 100 32768 ?
lfsw0202# show ip route vrf all
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
10.0.0.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.0.2/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.0.5/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.0.0.6/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 02:35:28, ospf-UNDERLAY, intra
10.0.0.254/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/162], 1d01h, ospf-UNDERLAY, intra
10.0.1.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.1.2/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.1.5/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.0.1.6/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 02:35:28, ospf-UNDERLAY, intra
10.0.2.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 1d01h, ospf-UNDERLAY, intra
10.0.3.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.0.3.2/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.0.3.4/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.0.3.6/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/201], 1d01h, ospf-UNDERLAY, intra
10.0.3.8/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/161], 1d01h, ospf-UNDERLAY, intra
10.0.3.10/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/201], 21:25:29, ospf-UNDERLAY, intra
10.0.4.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.0.4.2/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/241], 1d01h, ospf-UNDERLAY, intra
10.0.4.8/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/161], 1d01h, ospf-UNDERLAY, intra
10.0.4.10/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/241], 02:35:28, ospf-UNDERLAY, intra
10.0.254.112/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.1.0.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.0.2/32, ubest/mbest: 2/0, attached
*via 10.1.0.2, Lo0, [0/0], 1d01h, local
*via 10.1.0.2, Lo0, [0/0], 1d01h, direct
10.1.0.5/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.0.6/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 02:35:19, ospf-UNDERLAY, intra
10.1.0.254/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/41], 1d01h, ospf-UNDERLAY, intra
10.1.1.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.1.2/32, ubest/mbest: 2/0, attached
*via 10.1.1.2, Lo1, [0/0], 1d01h, local
*via 10.1.1.2, Lo1, [0/0], 1d01h, direct
10.1.1.5/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.1.1.6/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 02:35:19, ospf-UNDERLAY, intra
10.1.2.1/32, ubest/mbest: 2/0, attached
*via 10.1.2.1, Lo1, [0/0], 1d01h, local
*via 10.1.2.1, Lo1, [0/0], 1d01h, direct
10.1.3.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.1.3.2/31, ubest/mbest: 1/0, attached
*via 10.1.3.2, Eth1/8, [0/0], 1d01h, direct
10.1.3.2/32, ubest/mbest: 1/0, attached
*via 10.1.3.2, Eth1/8, [0/0], 1d01h, local
10.1.3.4/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.1.3.6/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.1.3.8/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.1.3.10/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/80], 1d01h, ospf-UNDERLAY, intra
10.1.4.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.1.4.2/31, ubest/mbest: 1/0, attached
*via 10.1.4.2, Eth1/7, [0/0], 1d01h, direct
10.1.4.2/32, ubest/mbest: 1/0, attached
*via 10.1.4.2, Eth1/7, [0/0], 1d01h, local
10.1.4.8/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.1.4.10/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/120], 02:35:19, ospf-UNDERLAY, intra
10.1.254.112/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.255.0.1/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.1.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.1.2/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/121], 1d01h, ospf-UNDERLAY, intra
10.255.2.0/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/120], 1d01h, ospf-UNDERLAY, intra
10.255.2.2/31, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/120], 02:35:19, ospf-UNDERLAY, intra
10.255.255.11/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/122], 1d01h, ospf-UNDERLAY, intra
10.255.255.12/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/202], 02:35:28, ospf-UNDERLAY, intra
10.255.255.21/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 1d01h, ospf-UNDERLAY, intra
10.255.255.22/32, ubest/mbest: 1/0
*via 10.1.3.3, Eth1/8, [110/81], 02:35:19, ospf-UNDERLAY, intra
IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
0.0.0.0/0, ubest/mbest: 1/0
*via 192.168.129.254, [1/0], 1d01h, static
192.168.129.0/24, ubest/mbest: 1/0, attached
*via 192.168.129.82, mgmt0, [0/0], 1d01h, direct
192.168.129.82/32, ubest/mbest: 1/0, attached
*via 192.168.129.82, mgmt0, [0/0], 1d01h, local
IP Route Table for VRF "controller-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
100.64.0.0/24, ubest/mbest: 1/0
*via 10.1.254.112%default, [200/1], 1d01h, bgp-65002, internal, tag 65001, segid: 9001 tunnelid: 0xa01fe70 encap: VXLAN
100.64.1.0/24, ubest/mbest: 1/0, attached
*via 100.64.1.254, Vlan2002, [0/0], 1d01h, direct
100.64.1.1/32, ubest/mbest: 1/0, attached
*via 100.64.1.1, Vlan2002, [190/0], 00:43:11, hmm
100.64.1.254/32, ubest/mbest: 1/0, attached
*via 100.64.1.254, Vlan2002, [0/0], 1d01h, local
IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.16.0.0/24, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d01h, direct
172.16.0.1/32, ubest/mbest: 1/0
*via 10.1.254.112%default, [200/2000], 1d01h, bgp-65002, internal, tag 65001, segid: 19001 tunnelid: 0xa01fe70 encap: VXLAN
172.16.0.4/32, ubest/mbest: 1/0, attached
*via 172.16.0.4, Vlan100, [190/0], 00:25:49, hmm
172.16.0.254/32, ubest/mbest: 1/0, attached
*via 172.16.0.254, Vlan100, [0/0], 1d01h, local
IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
172.17.0.0/24, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d01h, direct
172.17.0.254/32, ubest/mbest: 1/0, attached
*via 172.17.0.254, Vlan200, [0/0], 1d01h, local
IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>
lfsw0202#
lfsw0202# show nve peers
Interface Peer-IP State LearnType Uptime Router-Mac
--------- -------------------------------------- ----- --------- -------- -----------------
nve1 10.1.1.1 Up CP 1d01h 52b5.b939.1b08
nve1 10.1.1.5 Up CP 1d01h n/a
nve1 10.1.1.6 Up CP 02:33:06 n/a
nve1 10.1.254.112 Up CP 1d01h 0200.0a01.fe70
lfsw0202# show nve vni
Codes: CP - Control Plane DP - Data Plane
UC - Unconfigured SA - Suppress ARP
S-ND - Suppress ND
SU - Suppress Unknown Unicast
Xconn - Crossconnect
MS-IR - Multisite Ingress Replication
HYB - Hybrid IRB mode
Interface VNI Multicast-group State Mode Type [BD/VRF] Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1 101 UnicastBGP Up CP L2 [2002]
nve1 9001 n/a Up CP L3 [controller-vpc1]
nve1 10100 UnicastBGP Up CP L2 [100]
nve1 19001 n/a Up CP L3 [tenant1-vpc1]
nve1 20200 UnicastBGP Up CP L2 [200]
nve1 29001 n/a Up CP L3 [tenant2-vpc1]
lfsw0202# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.1.0.2, local AS number 65002
BGP table version is 225, L2VPN EVPN config peers 2, capable peers 1
52 network entries and 58 paths using 14256 bytes of memory
BGP attribute entries [47/17296], BGP AS path entries [1/6]
BGP community entries [0/0], BGP clusterlist entries [3/12]
Neighbor V AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down State/PfxRcd
10.1.0.253 4 0 0 0 0 0 0 1d01h Idle
10.1.0.254 4 65002 1699 1574 225 0 0 1d01h 19
Neighbor T AS PfxRcd Type-2 Type-3 Type-4 Type-5 Type-12
10.1.0.253 I 0 Idle 0 0 0 0 0
10.1.0.254 I 65002 19 8 2 0 9 0
lfsw0202# show l2route evpn mac all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan
(PipOrp): Directly connected Orphan to PIP based vPC BGW
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Prod Flags Seq No Next-Hops
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
100 eeb5.9b9e.afc7 Local L, 0 Po12
100 fa20.ddcf.46a4 BGP SplRcv 0 10.1.254.112 (Label: 10100)
200 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
2002 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
2002 c289.d7e2.fe6e Local L, 0 Po11
3000 0200.0a01.fe70 VXLAN Rmac, 0 10.1.254.112
3000 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
3000 52b5.b939.1b08 VXLAN Rmac, 0 10.1.1.1
3001 0200.0a01.fe70 VXLAN Rmac, 0 10.1.254.112
3001 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
3001 52b5.b939.1b08 VXLAN Rmac, 0 10.1.1.1
3002 5264.0db8.1b08 VXLAN Stt,Nho,Dum, 0 10.1.2.1
3002 52b5.b939.1b08 VXLAN Rmac, 0 10.1.1.1
lfsw0202# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW
(Pipporp): Orphan connected to peer of PIP based vPC BGW
Topology Mac Address Host IP Prod Flags Seq No Next-Hops
----------- -------------- --------------------------------------- ------ ----------------- ---------- ---------------------------------------------------------
100 fa20.ddcf.46a4 172.16.0.1 BGP -- 0 10.1.254.112 (Label: 10100)
100 eeb5.9b9e.afc7 172.16.0.4 HMM L, 0 Local
2002 c289.d7e2.fe6e 100.64.1.1 HMM L, 0 Local
lfsw0202# show vpc brief
Legend:
(*) - local vPC is down, forwarding via vPC peer-link
vPC domain id : 1
Peer status : peer adjacency formed ok
vPC keep-alive status : peer is alive
Configuration consistency status : success
Per-vlan consistency status : success
Type-2 consistency status : success
vPC role : secondary
Number of vPCs configured : 3
Peer Gateway : Enabled
Dual-active excluded VLANs : -
Graceful Consistency Check : Enabled
Auto-recovery status : Enabled, timer is off.(timeout = 240s)
Delay-restore status : Timer is off.(timeout = 150s)
Delay-restore SVI status : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router : Disabled
Virtual-peerlink mode : Enabled
vPC Peer-link status
---------------------------------------------------------------------
id Port Status Active vlans
-- ---- ------ -------------------------------------------------
1 Po1 up 1,100,200,2002,3000-3002
vPC status
----------------------------------------------------------------------------
Id Port Status Consistency Reason Active vlans
-- ------------ ------ ----------- ------ ---------------
11 Po11 up success success 1,100,200,2002,
3000-3002
12 Po12 up success success 1,100,200,2002,
3000-3002
13 Po13 down* success success -
Please check "show vpc consistency-parameters vpc <vpc-num>" for the
consistency reason of down vpc and for type-2 consistency reasons for
any vpc.
lfsw0202#
BGW show 結果の抜粋
bgw0101# show nve interface nve 1 detail
Interface: nve1, State: Up, encapsulation: VXLAN
...
Multisite bgw-if: loopback112 (ip: 10.0.254.112, admin: Up, oper: Up)
Multisite bgw-if oper down reason:
bgw0101# show nve multisite fabric-links
Interface State
--------- -----
Ethernet1/1 Up
Ethernet1/2 Up
bgw0101# show nve multisite dci-links
Interface State
--------- -----
Ethernet1/8 Up
bgw0101# show bgp l2vpn evpn route-type 4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 10.0.0.6:27001
BGP routing table entry for [4]:[0300.0000.0000.6500.0309]:[32]:[10.0.1.6]/136, version 812
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.6500.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:0000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
Route Distinguisher: 10.0.0.6:28001
BGP routing table entry for [4]:[0300.0000.0000.65ff.0309]:[32]:[10.0.1.6]/136, version 790
Paths: (1 available, best #1)
Flags: (0x000002) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW
Advertised path-id 1
Path type: internal, path is valid, is best path, no labeled nexthop, is extd
Imported to 1 destination(s)
Imported paths list: esi_0300.0000.0000.65ff.0309
AS-Path: NONE, path sourced internal to AS
10.0.1.6 (metric 81) from 10.0.0.254 (10.0.0.254)
Origin IGP, MED not set, localpref 100, weight 0
Extcommunity: ENCAP:8 RT:8000.0000.0065
Originator: 10.0.0.6 Cluster list: 10.0.0.254
Path-id 1 advertised to peers:
10.255.255.21 10.255.255.22
...
leaf switch show 結果抜粋
Fabric02 の AS:65002 が Path についていることが見える
Fabric02 の同 L2 で L2VNI で接続している lfsw0201/0202 の配下サーバ telant1-server04 の MAC アドレス(eeb5.9b9e.afc7) と IPアドレス(172.16.0.4) が見え、
L3VNI で接続する VNI:9001 でも Fabric02 の 100.64.1.0/24 が見える
lfsw0101# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 338, Local Router ID is 10.0.0.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2
Network Next Hop Metric LocPrf Weight Path
Route Distinguisher: 101:9001
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
Route Distinguisher: 101:10100
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
Route Distinguisher: 10.0.0.1:32867 (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5221.b497.1b08]:[0]:[0.0.0.0]/216
10.0.1.6 100 0 i
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[5248.790c.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[525f.e240.1b08]:[0]:[0.0.0.0]/216
10.0.1.5 100 0 i
*>i[2]:[0]:[0]:[48]:[5264.0db8.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[5275.345d.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[52b5.b939.1b08]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[0]:[0.0.0.0]/216
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
*>l[2]:[0]:[0]:[48]:[fa20.ddcf.46a4]:[32]:[172.16.0.1]/272
10.0.2.1 100 32768 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
10.0.1.5 100 0 i
*>i[3]:[0]:[32]:[10.0.1.6]/88
10.0.1.6 100 0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
10.0.2.1 100 32768 i
...
Route Distinguisher: 10.0.0.1:4 (L3VNI 9001)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
* i[5]:[0]:[0]:[24]:[100.64.0.0]/224
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[24]:[100.64.1.0]/224
10.0.254.112 1 100 0 65002 ?
* i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:2::]/416
10.0.254.112 1 100 0 65002 ?
Route Distinguisher: 10.0.0.1:5 (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[523e.d42c.1b08]:[0]:[0.0.0.0]/216
10.0.2.1 100 32768 i
*>i[2]:[0]:[0]:[48]:[eeb5.9b9e.afc7]:[32]:[172.16.0.4]/272
10.0.254.112 2000 100 0 65002 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
*>i[5]:[0]:[0]:[64]:[fd12:0:0:1::]/416
10.0.1.2 0 100 0 ?
* i[5]:[0]:[0]:[64]:[fd21:0:0:1::]/416
10.0.1.2 0 100 0 ?
*>l 10.0.1.1 0 100 32768 ?
...
lfsw0101#
サーバでの Ping 確認
L2 での疎通確認を下記で IPv4/v6 両方で実施済み
cisco@tenant1-server01:~$ ping 172.16.0.4 -c 3
PING 172.16.0.4 (172.16.0.4) 56(84) bytes of data.
64 bytes from 172.16.0.4: icmp_seq=1 ttl=64 time=40.9 ms
64 bytes from 172.16.0.4: icmp_seq=2 ttl=64 time=27.1 ms
64 bytes from 172.16.0.4: icmp_seq=3 ttl=64 time=29.8 ms
--- 172.16.0.4 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 27.144/32.628/40.945/5.979 ms
cisco@tenant1-server01:~$ ping6 fd21:0:0:1::104 -c 3
PING fd21:0:0:1::104 (fd21:0:0:1::104) 56 data bytes
64 bytes from fd21:0:0:1::104: icmp_seq=1 ttl=64 time=43.5 ms
64 bytes from fd21:0:0:1::104: icmp_seq=2 ttl=64 time=38.6 ms
64 bytes from fd21:0:0:1::104: icmp_seq=3 ttl=64 time=43.7 ms
--- fd21:0:0:1::104 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 38.577/41.926/43.739/2.371 ms
cisco@tenant1-server01:~$
L3 での疎通確認を下記で IPv4/v6 両方で実施済み
cisco@controller-server01:~$ ping 100.64.1.1 -c 3
PING 100.64.1.1 (100.64.1.1) 56(84) bytes of data.
64 bytes from 100.64.1.1: icmp_seq=1 ttl=60 time=30.2 ms
64 bytes from 100.64.1.1: icmp_seq=2 ttl=60 time=28.5 ms
64 bytes from 100.64.1.1: icmp_seq=3 ttl=60 time=28.6 ms
--- 100.64.1.1 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2001ms
rtt min/avg/max/mdev = 28.489/29.077/30.166/0.770 ms
cisco@controller-server01:~$ ping6 fd12:0:0:2::101 -c 3
PING fd12:0:0:2::101 (fd12:0:0:2::101) 56 data bytes
64 bytes from fd12:0:0:2::101: icmp_seq=1 ttl=60 time=27.7 ms
64 bytes from fd12:0:0:2::101: icmp_seq=2 ttl=60 time=26.9 ms
64 bytes from fd12:0:0:2::101: icmp_seq=3 ttl=60 time=31.5 ms
--- fd12:0:0:2::101 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 26.876/28.679/31.458/1.993 ms
cisco@controller-server01:~$
以上で試験環境初期構築での疎通試験まで完了
おわりに
EVPN VXLAN ファブリックのサイト間接続を CML 上で試した
試したレベルなので設計としては DCI と Fabric のアドレス重複やルーティングの分離などなどもっと検討・検証が必要
また、下記もどこまでできるかも実際の設計時は確認が必要そう
- 設計で検討が必要
- VNI 番号
- 今回は Fabric 間で重複しない VNI を使用できたが、VNI 設計時期によっては VNI 重複環境間の接続可否の試験が必要
- DCI アドレスの IPv6 検討
- 今回は IPv4 アドレスを使用したが、IPv6 の使用も検討可能
- ただし制限もありそうなのでそこを調べる必要があり
- ルートサーバの設置
- このままだと3サイト以上だと eBGP フルメッシュとなってしまうので、ルートサーバを設置してピア先の集約を実施することを検討した方が良い
- 参照: VXLAN EVPN マルチサイト設計および導入ホワイトペーパーの「ルートサーバ(eBGP ルートリフレクタ)」
- このままだと3サイト以上だと eBGP フルメッシュとなってしまうので、ルートサーバを設置してピア先の集約を実施することを検討した方が良い
- VNI 番号
ちなみに、CML はこの構成で CPU が約 50%、メモリは約 80% となり限界が近い。
リソースがオレンジ色の状態になると追加起動がハードウェアリソース不足として起動できなくなる
参考



