はじめに

CML (シミュレータ) 内にお試しで EVPN+VXLAN 構成を構築したので、構築内容と軽い動作確認を記載する

今回使用する自宅ラボでの CML 構築の過去記事はこちら → 記事1, 記事2

シミュレータ内のサーバを LACP 接続するときに癖があったのでその対応も記載する

構築構成図

3-Stage Clos 構成 (リソース懸念があるため一部簡略版)

Spine 2台構成
- Underlay : OSPF
- Overlay : iBGP (Spine BGP-RR)
Leaf
- 1/2系は冗長での vPC 構成
  - 直結の渡りは作らずに Fabric 側で vPC Peering で構成
- 3系は冗長無し (ラボのスペック懸念のため)
  - EVPN+VXLAN 各 Leaf セットは VLAN を別なもの利用が可能なことを試験するためにあえて別 VLAN で同一サブネットを構築する
- Border-Leaf も冗長無し (ラボのスペック懸念のため)
  - CML サーバの外の NW に L2 接続を実施する
Server
- 1/2系接続は LACP 構成をするために Node Type を Ubuntu で構築
- 3系接続は消費リソース節約のため Node Type Server で構築
- Server 向けポートはすべて Trunk allowed all で接続し、Server 側で tag を識別してインターフェースを作成する
External Connector
- スイッチへ直接外部サーバから接続するために、mgmt-nw を接続
- L2VPN 試験のために外部NWのVLAN300を Border-Leaf へ接続

構築用パラメータ

上記構成のパラメータの概要は下記の通り

アドレス

Spine - Leaf 構成 Underlay アドレス

サブネット	利用アサインサイズ	利用用途
10.0.0.0/24	/32	Loopback0
10.0.1.0/24	/32	Loopback1
10.0.2.0/24	/32	Loopback1 Secondary (vPC用)
10.0.3.0/24	/31	Spine1 - Leaf 接続サブネット
10.0.4.0/24	/31	Spine2 - Leaf 接続サブネット

管理ネットワーク (mgmt0 ~ 外部サーバアクセス用)

サブネット	利用用途
192.168.129.0/24	外部 NW からの管理 IF アクセス

オーバレイ

テナント3つで試している

tenant1
- サブネット内・サブネット間の通信試験用
tenant2
- 複数テナント試験用
tenant3
- 外部からの L2 での引き込み試験用

L2

テナント	サブネット	VNI	Leaf1/2 VLAN	Leaf3 VLAN	Border-Leaf VLAN
tenant1	172.16.0.0/24	L2VNI : 10100	100	10	-
tenant1	172.16.1.0/24	L2VNI : 10101	101	11	-
tenant2	172.17.0.0/24	L2VNI : 20200	200	20	-
tenant3	192.168.133.0/24	L2VNI : 30300	1001	-	300

L3

テナント	VNI	VLAN
tenant1	19001	3001
tenant2	29001	3002
tenant3	-	-

設定内容

設定 YAML

CML のラボ設定は YAML でダウンロードできるので Export した YAML を下記にそのまま記載する (長いので折りたたみ)

　ラボ全体 YAML　

annotations:
  - border_color: '#808080FF'
    border_style: ''
    color: '#FFFFFFFF'
    line_end: null
    line_start: null
    thickness: 1
    type: line
    x1: 1080.0
    y1: -760.0
    x2: 1080.0
    y2: -760.0
    z_index: 1
  - border_color: '#808080FF'
    border_style: ''
    color: '#FFFFFFFF'
    line_end: null
    line_start: null
    thickness: 1
    type: line
    x1: 1080.0
    y1: -760.0
    x2: 1080.0
    y2: -760.0
    z_index: 2
smart_annotations: []
nodes:
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Sat Mar  1 11:07:54 2025
          !Time: Sat Mar  1 11:07:55 2025

          version 10.5(1) Bios:version
          hostname lfsw01
          vdc lfsw01 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          cfs ipv4 distribute
          nv overlay evpn
          feature ospf
          feature bgp
          feature interface-vlan
          feature vn-segment-vlan-based
          feature lacp
          feature vpc
          feature lldp
          feature bfd
          clock timezone JST 9 0
          feature nv overlay

          no password strength-check
          username admin password 5 $5$PJAMHI$W4Ih7NfB87rKZatB0F3LTQtWPHkZK4uhH6Byb767Oj5  role network-admin
          username cisco password 5 $5$FCPIIG$RRagIkHJeow6kxDTamd2Xsp4TUkeGCRQeVdz0pHwlD0  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          no ip domain-lookup
          copp profile strict
          bfd startup-timer 0
          snmp-server user admin network-admin auth md5 3328CD1117679702547B2F13039654E3AC6A priv aes-128 0153CA151511AC3C1C4A5A330C9253ACA93D localizedV2key
          snmp-server user cisco network-admin auth md5 056E98403323A677350C5F675BC31EC5F735 priv aes-128 33199E4E4743BF3E6A11426643C317B4A667 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          fabric forwarding anycast-gateway-mac 2020.0000.00aa
          vlan 1,100-101,200,1001,3001-3002
          vlan 100
            name tenant1-server-seg1
            vn-segment 10100
          vlan 101
            name tenant1-vlan101
            vn-segment 10101
          vlan 200
            name tenant2-vlan200
            vn-segment 20200
          vlan 1001
            name tenant3-nw-vlan300
            vn-segment 30300
          vlan 3001
            name tenant1-vpc1-l3vni
            vn-segment 19001
          vlan 3002
            name tenant2-vpc1-l3vni
            vn-segment 29001

          ip prefix-list all-v4 seq 10 permit 0.0.0.0/0 ge 1 le 32
          route-map permit-all-v4 permit 100
            match ip address prefix-list all-v4
          vrf context management
            ip name-server 192.168.129.254
            ip route 0.0.0.0/0 192.168.129.254
          vrf context tenant1-vpc1
            vni 19001
            rd auto
            address-family ipv4 unicast
              route-target both auto
              route-target both auto evpn
          vrf context tenant2-vpc1
            vni 29001
            rd auto
            address-family ipv4 unicast
              route-target both auto
              route-target both auto evpn
          vpc domain 1
            role priority 100
            peer-keepalive destination 192.168.129.52 source 192.168.129.51
            virtual peer-link destination 10.0.0.2 source 10.0.0.1 dscp 56


          interface Vlan1

          interface Vlan100
            description tenant1-server-seg1
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan101
            description tenant1-server-seg2
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.1.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan200
            description tenant2-server-seg1
            no shutdown
            vrf member tenant2-vpc1
            ip address 172.17.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan3001
            no shutdown
            vrf member tenant1-vpc1
            ip forward

          interface Vlan3002
            no shutdown
            vrf member tenant2-vpc1
            ip forward

          interface port-channel1
            description virtual-vpc-peer-link
            switchport mode trunk
            spanning-tree port type network
            vpc peer-link

          interface port-channel11
            description tenant1-server01 bond0
            switchport mode trunk
            vpc 11

          interface port-channel12
            description tenant2-server01 bond0
            switchport mode trunk
            vpc 12

          interface port-channel13
            description tenant3-server01 bond0
            switchport mode trunk
            vpc 13

          interface nve1
            no shutdown
            host-reachability protocol bgp
            advertise virtual-rmac
            source-interface loopback1
            member vni 10100
              ingress-replication protocol bgp
            member vni 10101
              ingress-replication protocol bgp
            member vni 19001 associate-vrf
            member vni 20200
              ingress-replication protocol bgp
            member vni 29001 associate-vrf
            member vni 30300
              ingress-replication protocol bgp

          interface Ethernet1/1
            description tenant1-server01 ens2
            lacp rate fast
            switchport mode trunk
            channel-group 11 mode active

          interface Ethernet1/2
            description tenant2-server01 ens2
            lacp rate fast
            switchport mode trunk
            channel-group 12 mode active

          interface Ethernet1/3
            description tenant3-server01 ens2
            lacp rate fast
            switchport mode trunk
            channel-group 13 mode active

          interface Ethernet1/4
            shutdown

          interface Ethernet1/5
            shutdown

          interface Ethernet1/6
            shutdown

          interface Ethernet1/7
            shutdown

          interface Ethernet1/8
            shutdown

          interface Ethernet1/9
            shutdown

          interface Ethernet1/10
            shutdown

          interface Ethernet1/11
            shutdown

          interface Ethernet1/12
            shutdown

          interface Ethernet1/13
            shutdown

          interface Ethernet1/14
            shutdown

          interface Ethernet1/15
            shutdown

          interface Ethernet1/16
            shutdown

          interface Ethernet1/17
            shutdown

          interface Ethernet1/18
            shutdown

          interface Ethernet1/19
            shutdown

          interface Ethernet1/20
            shutdown

          interface Ethernet1/21
            shutdown

          interface Ethernet1/22
            shutdown

          interface Ethernet1/23
            shutdown

          interface Ethernet1/24
            shutdown

          interface Ethernet1/25
            shutdown

          interface Ethernet1/26
            shutdown

          interface Ethernet1/27
            shutdown

          interface Ethernet1/28
            shutdown

          interface Ethernet1/29
            shutdown

          interface Ethernet1/30
            shutdown

          interface Ethernet1/31
            shutdown

          interface Ethernet1/32
            shutdown

          interface Ethernet1/33
            shutdown

          interface Ethernet1/34
            shutdown

          interface Ethernet1/35
            shutdown

          interface Ethernet1/36
            shutdown

          interface Ethernet1/37
            shutdown

          interface Ethernet1/38
            shutdown

          interface Ethernet1/39
            shutdown

          interface Ethernet1/40
            shutdown

          interface Ethernet1/41
            shutdown

          interface Ethernet1/42
            shutdown

          interface Ethernet1/43
            shutdown

          interface Ethernet1/44
            shutdown

          interface Ethernet1/45
            shutdown

          interface Ethernet1/46
            shutdown

          interface Ethernet1/47
            description spsw02 eth1/1
            no switchport
            mtu 9216
            port-type fabric
            ip address 10.0.4.0/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/48
            description spsw01 eth1/1
            no switchport
            mtu 9216
            port-type fabric
            ip address 10.0.3.0/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.51/24

          interface loopback0
            description RouterID Loopback
            ip address 10.0.0.1/32
            ip router ospf 1 area 0.0.0.0

          interface loopback1
            description VTEP Loopback
            ip address 10.0.1.1/32
            ip address 10.0.2.1/32 secondary
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            bfd
            router-id 10.0.0.1
          router bgp 65001
            router-id 10.0.0.1
            address-family l2vpn evpn
              advertise-pip
            neighbor 10.0.0.253
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            neighbor 10.0.0.254
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            vrf tenant1-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
            vrf tenant2-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
          evpn
            vni 10100 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 10101 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 20200 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 30300 l2
              rd auto
              route-target import auto
              route-target export auto

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n0
    image_definition: null
    label: lfsw01
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: -80
    y: -200
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
      - id: i7
        label: Ethernet1/6
        mac_address: null
        slot: 6
        type: physical
      - id: i8
        label: Ethernet1/7
        mac_address: null
        slot: 7
        type: physical
      - id: i9
        label: Ethernet1/8
        mac_address: null
        slot: 8
        type: physical
      - id: i10
        label: Ethernet1/9
        mac_address: null
        slot: 9
        type: physical
      - id: i11
        label: Ethernet1/10
        mac_address: null
        slot: 10
        type: physical
      - id: i12
        label: Ethernet1/11
        mac_address: null
        slot: 11
        type: physical
      - id: i13
        label: Ethernet1/12
        mac_address: null
        slot: 12
        type: physical
      - id: i14
        label: Ethernet1/13
        mac_address: null
        slot: 13
        type: physical
      - id: i15
        label: Ethernet1/14
        mac_address: null
        slot: 14
        type: physical
      - id: i16
        label: Ethernet1/15
        mac_address: null
        slot: 15
        type: physical
      - id: i17
        label: Ethernet1/16
        mac_address: null
        slot: 16
        type: physical
      - id: i18
        label: Ethernet1/17
        mac_address: null
        slot: 17
        type: physical
      - id: i19
        label: Ethernet1/18
        mac_address: null
        slot: 18
        type: physical
      - id: i20
        label: Ethernet1/19
        mac_address: null
        slot: 19
        type: physical
      - id: i21
        label: Ethernet1/20
        mac_address: null
        slot: 20
        type: physical
      - id: i22
        label: Ethernet1/21
        mac_address: null
        slot: 21
        type: physical
      - id: i23
        label: Ethernet1/22
        mac_address: null
        slot: 22
        type: physical
      - id: i24
        label: Ethernet1/23
        mac_address: null
        slot: 23
        type: physical
      - id: i25
        label: Ethernet1/24
        mac_address: null
        slot: 24
        type: physical
      - id: i26
        label: Ethernet1/25
        mac_address: null
        slot: 25
        type: physical
      - id: i27
        label: Ethernet1/26
        mac_address: null
        slot: 26
        type: physical
      - id: i28
        label: Ethernet1/27
        mac_address: null
        slot: 27
        type: physical
      - id: i29
        label: Ethernet1/28
        mac_address: null
        slot: 28
        type: physical
      - id: i30
        label: Ethernet1/29
        mac_address: null
        slot: 29
        type: physical
      - id: i31
        label: Ethernet1/30
        mac_address: null
        slot: 30
        type: physical
      - id: i32
        label: Ethernet1/31
        mac_address: null
        slot: 31
        type: physical
      - id: i33
        label: Ethernet1/32
        mac_address: null
        slot: 32
        type: physical
      - id: i34
        label: Ethernet1/33
        mac_address: null
        slot: 33
        type: physical
      - id: i35
        label: Ethernet1/34
        mac_address: null
        slot: 34
        type: physical
      - id: i36
        label: Ethernet1/35
        mac_address: null
        slot: 35
        type: physical
      - id: i37
        label: Ethernet1/36
        mac_address: null
        slot: 36
        type: physical
      - id: i38
        label: Ethernet1/37
        mac_address: null
        slot: 37
        type: physical
      - id: i39
        label: Ethernet1/38
        mac_address: null
        slot: 38
        type: physical
      - id: i40
        label: Ethernet1/39
        mac_address: null
        slot: 39
        type: physical
      - id: i41
        label: Ethernet1/40
        mac_address: null
        slot: 40
        type: physical
      - id: i42
        label: Ethernet1/41
        mac_address: null
        slot: 41
        type: physical
      - id: i43
        label: Ethernet1/42
        mac_address: null
        slot: 42
        type: physical
      - id: i44
        label: Ethernet1/43
        mac_address: null
        slot: 43
        type: physical
      - id: i45
        label: Ethernet1/44
        mac_address: null
        slot: 44
        type: physical
      - id: i46
        label: Ethernet1/45
        mac_address: null
        slot: 45
        type: physical
      - id: i47
        label: Ethernet1/46
        mac_address: null
        slot: 46
        type: physical
      - id: i48
        label: Ethernet1/47
        mac_address: null
        slot: 47
        type: physical
      - id: i49
        label: Ethernet1/48
        mac_address: null
        slot: 48
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n1
    image_definition: null
    label: mgmtnw(lfsw01)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: -280
    y: -200
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Sat Mar  1 11:11:48 2025
          !Time: Sat Mar  1 11:11:49 2025

          version 10.5(1) Bios:version
          hostname bdsw01
          vdc bdsw01 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          cfs eth distribute
          nv overlay evpn
          feature ospf
          feature bgp
          feature interface-vlan
          feature vn-segment-vlan-based
          feature lacp
          feature lldp
          feature bfd
          clock timezone JST 9 0
          feature nv overlay

          no password strength-check
          username admin password 5 $5$DCALLD$97LM57TD1qBqvKxSPC.zrFWkwLb.mcI3oelSIY2ezK6  role network-admin
          username cisco password 5 $5$PLGLCI$KPPOvBPkC9lKtmwVpmhHOPkkAMuMSqfWf2Lj7yVmBX0  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          no ip domain-lookup
          copp profile strict
          snmp-server user admin network-admin auth md5 4976440ADE75ACA80D512BEB0C28C2391689 priv aes-128 174C152CF52BB2BA0C0D5F90515ECB771395 localizedV2key
          snmp-server user cisco network-admin auth md5 53150C1621F12906B9B08951D9C85FB8D557 priv aes-128 01462E3AB6CF0D1A9FEAC459969410F98A55 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          fabric forwarding anycast-gateway-mac 2020.0000.00aa
          vlan 1,300
          vlan 300
            name tenant3-nw-vlan300
            vn-segment 30300

          ip prefix-list all-v4 seq 10 permit 0.0.0.0/0 ge 1 le 32
          route-map permit-all-v4 permit 100
            match ip address prefix-list all-v4
          vrf context management
            ip name-server 192.168.129.254
            ip route 0.0.0.0/0 192.168.129.254


          interface Vlan1

          interface Vlan3001
            no shutdown
            vrf member tenant1-vpc1
            ip forward

          interface nve1
            no shutdown
            host-reachability protocol bgp
            source-interface loopback1
            member vni 30300
              ingress-replication protocol bgp

          interface Ethernet1/1
            description tenant3-nw-vlan300
            switchport access vlan 300

          interface Ethernet1/2
            shutdown

          interface Ethernet1/3
            shutdown

          interface Ethernet1/4
            shutdown

          interface Ethernet1/5
            shutdown

          interface Ethernet1/6
            shutdown

          interface Ethernet1/7
            shutdown

          interface Ethernet1/8
            shutdown

          interface Ethernet1/9
            shutdown

          interface Ethernet1/10
            shutdown

          interface Ethernet1/11
            shutdown

          interface Ethernet1/12
            shutdown

          interface Ethernet1/13
            shutdown

          interface Ethernet1/14
            shutdown

          interface Ethernet1/15
            shutdown

          interface Ethernet1/16
            shutdown

          interface Ethernet1/17
            shutdown

          interface Ethernet1/18
            shutdown

          interface Ethernet1/19
            shutdown

          interface Ethernet1/20
            shutdown

          interface Ethernet1/21
            shutdown

          interface Ethernet1/22
            shutdown

          interface Ethernet1/23
            shutdown

          interface Ethernet1/24
            shutdown

          interface Ethernet1/25
            shutdown

          interface Ethernet1/26
            shutdown

          interface Ethernet1/27
            shutdown

          interface Ethernet1/28
            shutdown

          interface Ethernet1/29
            shutdown

          interface Ethernet1/30
            shutdown

          interface Ethernet1/31
            shutdown

          interface Ethernet1/32
            shutdown

          interface Ethernet1/33
            shutdown

          interface Ethernet1/34
            shutdown

          interface Ethernet1/35
            shutdown

          interface Ethernet1/36
            shutdown

          interface Ethernet1/37
            shutdown

          interface Ethernet1/38
            shutdown

          interface Ethernet1/39
            shutdown

          interface Ethernet1/40
            shutdown

          interface Ethernet1/41
            shutdown

          interface Ethernet1/42
            shutdown

          interface Ethernet1/43
            shutdown

          interface Ethernet1/44
            shutdown

          interface Ethernet1/45
            shutdown

          interface Ethernet1/46
            shutdown

          interface Ethernet1/47
            description spsw02 eth1/3
            no switchport
            mtu 9216
            ip address 10.0.4.8/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/48
            description spsw01 eth1/3
            no switchport
            mtu 9216
            ip address 10.0.3.8/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.55/24

          interface loopback0
            description RouterID Loopback
            ip address 10.0.0.5/32
            ip router ospf 1 area 0.0.0.0

          interface loopback1
            description VTEP Loopback
            ip address 10.0.1.5/32
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            router-id 10.0.0.5
          router bgp 65001
            router-id 10.0.0.5
            address-family l2vpn evpn
            neighbor 10.0.0.253
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            neighbor 10.0.0.254
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            vrf tenant1-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
          evpn
            vni 30300 l2
              rd auto
              route-target import auto
              route-target export auto

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n2
    image_definition: null
    label: bdsw01
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: 800
    y: -200
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
      - id: i7
        label: Ethernet1/6
        mac_address: null
        slot: 6
        type: physical
      - id: i8
        label: Ethernet1/7
        mac_address: null
        slot: 7
        type: physical
      - id: i9
        label: Ethernet1/8
        mac_address: null
        slot: 8
        type: physical
      - id: i10
        label: Ethernet1/9
        mac_address: null
        slot: 9
        type: physical
      - id: i11
        label: Ethernet1/10
        mac_address: null
        slot: 10
        type: physical
      - id: i12
        label: Ethernet1/11
        mac_address: null
        slot: 11
        type: physical
      - id: i13
        label: Ethernet1/12
        mac_address: null
        slot: 12
        type: physical
      - id: i14
        label: Ethernet1/13
        mac_address: null
        slot: 13
        type: physical
      - id: i15
        label: Ethernet1/14
        mac_address: null
        slot: 14
        type: physical
      - id: i16
        label: Ethernet1/15
        mac_address: null
        slot: 15
        type: physical
      - id: i17
        label: Ethernet1/16
        mac_address: null
        slot: 16
        type: physical
      - id: i18
        label: Ethernet1/17
        mac_address: null
        slot: 17
        type: physical
      - id: i19
        label: Ethernet1/18
        mac_address: null
        slot: 18
        type: physical
      - id: i20
        label: Ethernet1/19
        mac_address: null
        slot: 19
        type: physical
      - id: i21
        label: Ethernet1/20
        mac_address: null
        slot: 20
        type: physical
      - id: i22
        label: Ethernet1/21
        mac_address: null
        slot: 21
        type: physical
      - id: i23
        label: Ethernet1/22
        mac_address: null
        slot: 22
        type: physical
      - id: i24
        label: Ethernet1/23
        mac_address: null
        slot: 23
        type: physical
      - id: i25
        label: Ethernet1/24
        mac_address: null
        slot: 24
        type: physical
      - id: i26
        label: Ethernet1/25
        mac_address: null
        slot: 25
        type: physical
      - id: i27
        label: Ethernet1/26
        mac_address: null
        slot: 26
        type: physical
      - id: i28
        label: Ethernet1/27
        mac_address: null
        slot: 27
        type: physical
      - id: i29
        label: Ethernet1/28
        mac_address: null
        slot: 28
        type: physical
      - id: i30
        label: Ethernet1/29
        mac_address: null
        slot: 29
        type: physical
      - id: i31
        label: Ethernet1/30
        mac_address: null
        slot: 30
        type: physical
      - id: i32
        label: Ethernet1/31
        mac_address: null
        slot: 31
        type: physical
      - id: i33
        label: Ethernet1/32
        mac_address: null
        slot: 32
        type: physical
      - id: i34
        label: Ethernet1/33
        mac_address: null
        slot: 33
        type: physical
      - id: i35
        label: Ethernet1/34
        mac_address: null
        slot: 34
        type: physical
      - id: i36
        label: Ethernet1/35
        mac_address: null
        slot: 35
        type: physical
      - id: i37
        label: Ethernet1/36
        mac_address: null
        slot: 36
        type: physical
      - id: i38
        label: Ethernet1/37
        mac_address: null
        slot: 37
        type: physical
      - id: i39
        label: Ethernet1/38
        mac_address: null
        slot: 38
        type: physical
      - id: i40
        label: Ethernet1/39
        mac_address: null
        slot: 39
        type: physical
      - id: i41
        label: Ethernet1/40
        mac_address: null
        slot: 40
        type: physical
      - id: i42
        label: Ethernet1/41
        mac_address: null
        slot: 41
        type: physical
      - id: i43
        label: Ethernet1/42
        mac_address: null
        slot: 42
        type: physical
      - id: i44
        label: Ethernet1/43
        mac_address: null
        slot: 43
        type: physical
      - id: i45
        label: Ethernet1/44
        mac_address: null
        slot: 44
        type: physical
      - id: i46
        label: Ethernet1/45
        mac_address: null
        slot: 45
        type: physical
      - id: i47
        label: Ethernet1/46
        mac_address: null
        slot: 46
        type: physical
      - id: i48
        label: Ethernet1/47
        mac_address: null
        slot: 47
        type: physical
      - id: i49
        label: Ethernet1/48
        mac_address: null
        slot: 48
        type: physical
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Mon Feb 24 14:58:31 2025
          !Time: Mon Feb 24 14:58:32 2025

          version 10.5(1) Bios:version
          hostname spsw01
          vdc spsw01 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          nv overlay evpn
          feature ospf
          feature bgp
          feature vn-segment-vlan-based
          feature bfd
          feature nv overlay

          no password strength-check
          username admin password 5 $5$OKFIOP$.ECirSUNMFJ3N4MLVUsCl9/IJyiYzdf9rUb2fRIi9l/  role network-admin
          username cisco password 5 $5$FELGCK$zhm3i0lUM8jDTJ/znDTG5/Qpj9TYi3hfjdm79s165xD  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          ip domain-lookup
          copp profile strict
          bfd startup-timer 0
          snmp-server user admin network-admin auth md5 00701D0AF41A8BB428E045A2288EED4BF3B1 priv aes-128 040F792AC455FD8536D915D97E84B4199DD2 localizedV2key
          snmp-server user cisco network-admin auth md5 33297A78FC5A89AE5EAB6AAF7582E60EBFB1 priv aes-128 17780A26DB65A88112E31AEB3794E90AB8E2 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          vlan 1

          vrf context management

          interface Ethernet1/1
            description lfsw01 eth1/48
            no switchport
            mtu 9216
            no ip redirects
            ip address 10.0.3.1/31
            no ipv6 redirects
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/2
            description lfsw02 eth1/48
            no switchport
            mtu 9216
            ip address 10.0.3.3/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/3
            description lfsw03 eth1/48
            no switchport
            mtu 9216
            ip address 10.0.3.5/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/4
            description lfsw04 eth1/48
            no switchport
            mtu 9216
            ip address 10.0.3.7/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0

          interface Ethernet1/5
            description bdsw01 eth1/48
            no switchport
            mtu 9216
            ip address 10.0.3.9/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/6

          interface Ethernet1/7

          interface Ethernet1/8

          interface Ethernet1/9

          interface Ethernet1/10

          interface Ethernet1/11

          interface Ethernet1/12

          interface Ethernet1/13

          interface Ethernet1/14

          interface Ethernet1/15

          interface Ethernet1/16

          interface Ethernet1/17

          interface Ethernet1/18

          interface Ethernet1/19

          interface Ethernet1/20

          interface Ethernet1/21

          interface Ethernet1/22

          interface Ethernet1/23

          interface Ethernet1/24

          interface Ethernet1/25

          interface Ethernet1/26

          interface Ethernet1/27

          interface Ethernet1/28

          interface Ethernet1/29

          interface Ethernet1/30

          interface Ethernet1/31

          interface Ethernet1/32

          interface Ethernet1/33

          interface Ethernet1/34

          interface Ethernet1/35

          interface Ethernet1/36

          interface Ethernet1/37

          interface Ethernet1/38

          interface Ethernet1/39

          interface Ethernet1/40

          interface Ethernet1/41

          interface Ethernet1/42

          interface Ethernet1/43

          interface Ethernet1/44

          interface Ethernet1/45

          interface Ethernet1/46

          interface Ethernet1/47

          interface Ethernet1/48

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.59/24

          interface loopback0
            ip address 10.0.0.254/32
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            bfd
            router-id 10.0.0.254
          router bgp 65001
            router-id 10.0.0.254
            address-family l2vpn evpn
              retain route-target all
            template peer leaf
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
                route-reflector-client
            neighbor 10.0.0.1
              inherit peer leaf
            neighbor 10.0.0.2
              inherit peer leaf
            neighbor 10.0.0.3
              inherit peer leaf
            neighbor 10.0.0.4
              inherit peer leaf
            neighbor 10.0.0.5
              inherit peer leaf

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n3
    image_definition: null
    label: spsw01
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: 240
    y: -520
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n4
    image_definition: null
    label: mgmtnw(bdsw01)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 960
    y: -200
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n5
    image_definition: null
    label: mgmtnw(spsw01)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 40
    y: -520
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Sat Mar  1 11:19:00 2025
          !Time: Sat Mar  1 11:19:00 2025

          version 10.5(1) Bios:version
          hostname lfsw02
          vdc lfsw02 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          cfs ipv4 distribute
          nv overlay evpn
          feature ospf
          feature bgp
          feature interface-vlan
          feature vn-segment-vlan-based
          feature lacp
          feature vpc
          feature lldp
          feature bfd
          clock timezone JST 9 0
          feature nv overlay

          no password strength-check
          username admin password 5 $5$MIABHO$I4vvga9QpydmKdK1iLAnJtqJx/sFAUrWABoY6cEgBr.  role network-admin
          username cisco password 5 $5$GMELDH$8v4a2WA5YuNub3XWE9/EKcgcIZpXPNPSGyubE/r0eLA  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          no ip domain-lookup
          copp profile strict
          snmp-server user admin network-admin auth md5 00514DE2E2F0FAE3138880548031669F521C priv aes-128 323C6DD1DD1B212C9C760EC557EEA547FEF8 localizedV2key
          snmp-server user cisco network-admin auth md5 37427EC18B623A31C73A5FD91EE3AE1B83D7 priv aes-128 482F13A7F6505F4B96351E8D11EE8403C2D5 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          fabric forwarding anycast-gateway-mac 2020.0000.00aa
          vlan 1,100-101,200,1001,3001-3002
          vlan 100
            name tenant1-server-seg1
            vn-segment 10100
          vlan 101
            name tenant1-vlan101
            vn-segment 10101
          vlan 200
            name tenant2-vlan200
            vn-segment 20200
          vlan 1001
            name tenant3-nw-vlan300
            vn-segment 30300
          vlan 3001
            name tenant1-vpc1-l3vni
            vn-segment 19001
          vlan 3002
            name tenant2-vpc1-l3vni
            vn-segment 29001

          ip prefix-list all-v4 seq 10 permit 0.0.0.0/0 ge 1 le 32
          route-map permit-all-v4 permit 100
            match ip address prefix-list all-v4
          vrf context management
            ip name-server 192.168.129.254
            ip route 0.0.0.0/0 192.168.129.254
          vrf context tenant1-vpc1
            vni 19001
            rd auto
            address-family ipv4 unicast
              route-target both auto
              route-target both auto evpn
          vrf context tenant2-vpc1
            vni 29001
            rd auto
            address-family ipv4 unicast
              route-target both auto
              route-target both auto evpn
          vpc domain 1
            role priority 200
            peer-keepalive destination 192.168.129.51 source 192.168.129.52
            virtual peer-link destination 10.0.0.1 source 10.0.0.2 dscp 56


          interface Vlan1

          interface Vlan100
            description tenant1-server-seg1
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan101
            description tenant1-server-seg2
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.1.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan200
            description tenant2-server-seg1
            no shutdown
            vrf member tenant2-vpc1
            ip address 172.17.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan3001
            no shutdown
            vrf member tenant1-vpc1
            ip forward

          interface Vlan3002
            no shutdown
            vrf member tenant2-vpc1
            ip forward

          interface port-channel1
            description virtual-vpc-peer-link
            switchport mode trunk
            spanning-tree port type network
            vpc peer-link

          interface port-channel11
            description tenant1-server01 bond0
            switchport mode trunk
            vpc 11

          interface port-channel12
            description tenant2-server01 bond0
            switchport mode trunk
            vpc 12

          interface port-channel13
            description tenant3-server01 bond0
            switchport mode trunk
            vpc 13

          interface nve1
            no shutdown
            host-reachability protocol bgp
            advertise virtual-rmac
            source-interface loopback1
            member vni 10100
              ingress-replication protocol bgp
            member vni 10101
              ingress-replication protocol bgp
            member vni 19001 associate-vrf
            member vni 20200
              ingress-replication protocol bgp
            member vni 29001 associate-vrf
            member vni 30300
              ingress-replication protocol bgp

          interface Ethernet1/1
            description tenant1-server01 ens3
            lacp rate fast
            switchport mode trunk
            channel-group 11 mode active

          interface Ethernet1/2
            description tenant2-server01 ens3
            lacp rate fast
            switchport mode trunk
            channel-group 12 mode active

          interface Ethernet1/3
            description tenant3-server01 ens3
            lacp rate fast
            switchport mode trunk
            channel-group 13 mode active

          interface Ethernet1/4
            shutdown

          interface Ethernet1/5
            shutdown

          interface Ethernet1/6
            shutdown

          interface Ethernet1/7
            shutdown

          interface Ethernet1/8
            shutdown

          interface Ethernet1/9
            shutdown

          interface Ethernet1/10
            shutdown

          interface Ethernet1/11
            shutdown

          interface Ethernet1/12
            shutdown

          interface Ethernet1/13
            shutdown

          interface Ethernet1/14
            shutdown

          interface Ethernet1/15
            shutdown

          interface Ethernet1/16
            shutdown

          interface Ethernet1/17
            shutdown

          interface Ethernet1/18
            shutdown

          interface Ethernet1/19
            shutdown

          interface Ethernet1/20
            shutdown

          interface Ethernet1/21
            shutdown

          interface Ethernet1/22
            shutdown

          interface Ethernet1/23
            shutdown

          interface Ethernet1/24
            shutdown

          interface Ethernet1/25
            shutdown

          interface Ethernet1/26
            shutdown

          interface Ethernet1/27
            shutdown

          interface Ethernet1/28
            shutdown

          interface Ethernet1/29
            shutdown

          interface Ethernet1/30
            shutdown

          interface Ethernet1/31
            shutdown

          interface Ethernet1/32
            shutdown

          interface Ethernet1/33
            shutdown

          interface Ethernet1/34
            shutdown

          interface Ethernet1/35
            shutdown

          interface Ethernet1/36
            shutdown

          interface Ethernet1/37
            shutdown

          interface Ethernet1/38
            shutdown

          interface Ethernet1/39
            shutdown

          interface Ethernet1/40
            shutdown

          interface Ethernet1/41
            shutdown

          interface Ethernet1/42
            shutdown

          interface Ethernet1/43
            shutdown

          interface Ethernet1/44
            shutdown

          interface Ethernet1/45
            shutdown

          interface Ethernet1/46
            shutdown

          interface Ethernet1/47
            description spsw02 eth1/2
            no switchport
            mtu 9216
            port-type fabric
            ip address 10.0.4.2/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/48
            description spsw01 eth1/2
            no switchport
            mtu 9216
            port-type fabric
            ip address 10.0.3.2/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.52/24

          interface loopback0
            description RouterID Loopback
            ip address 10.0.0.2/32
            ip router ospf 1 area 0.0.0.0

          interface loopback1
            description VTEP Loopback
            ip address 10.0.1.2/32
            ip address 10.0.2.1/32 secondary
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            router-id 10.0.0.2
          router bgp 65001
            router-id 10.0.0.2
            address-family l2vpn evpn
              advertise-pip
            neighbor 10.0.0.253
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            neighbor 10.0.0.254
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            vrf tenant1-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
            vrf tenant2-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
          evpn
            vni 10100 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 10101 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 20200 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 30300 l2
              rd auto
              route-target import auto
              route-target export auto

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n6
    image_definition: null
    label: lfsw02
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: 80
    y: -200
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
      - id: i7
        label: Ethernet1/6
        mac_address: null
        slot: 6
        type: physical
      - id: i8
        label: Ethernet1/7
        mac_address: null
        slot: 7
        type: physical
      - id: i9
        label: Ethernet1/8
        mac_address: null
        slot: 8
        type: physical
      - id: i10
        label: Ethernet1/9
        mac_address: null
        slot: 9
        type: physical
      - id: i11
        label: Ethernet1/10
        mac_address: null
        slot: 10
        type: physical
      - id: i12
        label: Ethernet1/11
        mac_address: null
        slot: 11
        type: physical
      - id: i13
        label: Ethernet1/12
        mac_address: null
        slot: 12
        type: physical
      - id: i14
        label: Ethernet1/13
        mac_address: null
        slot: 13
        type: physical
      - id: i15
        label: Ethernet1/14
        mac_address: null
        slot: 14
        type: physical
      - id: i16
        label: Ethernet1/15
        mac_address: null
        slot: 15
        type: physical
      - id: i17
        label: Ethernet1/16
        mac_address: null
        slot: 16
        type: physical
      - id: i18
        label: Ethernet1/17
        mac_address: null
        slot: 17
        type: physical
      - id: i19
        label: Ethernet1/18
        mac_address: null
        slot: 18
        type: physical
      - id: i20
        label: Ethernet1/19
        mac_address: null
        slot: 19
        type: physical
      - id: i21
        label: Ethernet1/20
        mac_address: null
        slot: 20
        type: physical
      - id: i22
        label: Ethernet1/21
        mac_address: null
        slot: 21
        type: physical
      - id: i23
        label: Ethernet1/22
        mac_address: null
        slot: 22
        type: physical
      - id: i24
        label: Ethernet1/23
        mac_address: null
        slot: 23
        type: physical
      - id: i25
        label: Ethernet1/24
        mac_address: null
        slot: 24
        type: physical
      - id: i26
        label: Ethernet1/25
        mac_address: null
        slot: 25
        type: physical
      - id: i27
        label: Ethernet1/26
        mac_address: null
        slot: 26
        type: physical
      - id: i28
        label: Ethernet1/27
        mac_address: null
        slot: 27
        type: physical
      - id: i29
        label: Ethernet1/28
        mac_address: null
        slot: 28
        type: physical
      - id: i30
        label: Ethernet1/29
        mac_address: null
        slot: 29
        type: physical
      - id: i31
        label: Ethernet1/30
        mac_address: null
        slot: 30
        type: physical
      - id: i32
        label: Ethernet1/31
        mac_address: null
        slot: 31
        type: physical
      - id: i33
        label: Ethernet1/32
        mac_address: null
        slot: 32
        type: physical
      - id: i34
        label: Ethernet1/33
        mac_address: null
        slot: 33
        type: physical
      - id: i35
        label: Ethernet1/34
        mac_address: null
        slot: 34
        type: physical
      - id: i36
        label: Ethernet1/35
        mac_address: null
        slot: 35
        type: physical
      - id: i37
        label: Ethernet1/36
        mac_address: null
        slot: 36
        type: physical
      - id: i38
        label: Ethernet1/37
        mac_address: null
        slot: 37
        type: physical
      - id: i39
        label: Ethernet1/38
        mac_address: null
        slot: 38
        type: physical
      - id: i40
        label: Ethernet1/39
        mac_address: null
        slot: 39
        type: physical
      - id: i41
        label: Ethernet1/40
        mac_address: null
        slot: 40
        type: physical
      - id: i42
        label: Ethernet1/41
        mac_address: null
        slot: 41
        type: physical
      - id: i43
        label: Ethernet1/42
        mac_address: null
        slot: 42
        type: physical
      - id: i44
        label: Ethernet1/43
        mac_address: null
        slot: 43
        type: physical
      - id: i45
        label: Ethernet1/44
        mac_address: null
        slot: 44
        type: physical
      - id: i46
        label: Ethernet1/45
        mac_address: null
        slot: 45
        type: physical
      - id: i47
        label: Ethernet1/46
        mac_address: null
        slot: 46
        type: physical
      - id: i48
        label: Ethernet1/47
        mac_address: null
        slot: 47
        type: physical
      - id: i49
        label: Ethernet1/48
        mac_address: null
        slot: 48
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n7
    image_definition: null
    label: mgmtnw(lfsw02)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 240
    y: -200
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: bridge1
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n8
    image_definition: null
    label: tenant2-nw-vlan300
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 800
    y: 0
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Mon Feb 24 14:58:37 2025
          !Time: Mon Feb 24 14:58:37 2025

          version 10.5(1) Bios:version
          hostname spsw02
          vdc spsw02 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          nv overlay evpn
          feature ospf
          feature bgp
          feature vn-segment-vlan-based
          feature bfd
          feature nv overlay

          no password strength-check
          username admin password 5 $5$OKFIOP$.ECirSUNMFJ3N4MLVUsCl9/IJyiYzdf9rUb2fRIi9l/  role network-admin
          username cisco password 5 $5$FELGCK$zhm3i0lUM8jDTJ/znDTG5/Qpj9TYi3hfjdm79s165xD  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          ip domain-lookup
          copp profile strict
          snmp-server user admin network-admin auth md5 00701D0AF41A8BB428E045A2288EED4BF3B1 priv aes-128 040F792AC455FD8536D915D97E84B4199DD2 localizedV2key
          snmp-server user cisco network-admin auth md5 33297A78FC5A89AE5EAB6AAF7582E60EBFB1 priv aes-128 17780A26DB65A88112E31AEB3794E90AB8E2 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          vlan 1

          vrf context management

          interface Ethernet1/1
            description lfsw01 eth1/47
            no switchport
            mtu 9216
            no bfd
            no ip redirects
            ip address 10.0.4.1/31
            no ipv6 redirects
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/2
            description lfsw02 eth1/47
            no switchport
            mtu 9216
            ip address 10.0.4.3/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/3
            description lfsw03 eth1/47
            no switchport
            mtu 9216
            ip address 10.0.4.5/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/4
            description lfsw04 eth1/47
            no switchport
            mtu 9216
            ip address 10.0.4.7/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0

          interface Ethernet1/5
            description bdsw01 eth1/47
            no switchport
            mtu 9216
            ip address 10.0.4.9/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/6

          interface Ethernet1/7

          interface Ethernet1/8

          interface Ethernet1/9

          interface Ethernet1/10

          interface Ethernet1/11

          interface Ethernet1/12

          interface Ethernet1/13

          interface Ethernet1/14

          interface Ethernet1/15

          interface Ethernet1/16

          interface Ethernet1/17

          interface Ethernet1/18

          interface Ethernet1/19

          interface Ethernet1/20

          interface Ethernet1/21

          interface Ethernet1/22

          interface Ethernet1/23

          interface Ethernet1/24

          interface Ethernet1/25

          interface Ethernet1/26

          interface Ethernet1/27

          interface Ethernet1/28

          interface Ethernet1/29

          interface Ethernet1/30

          interface Ethernet1/31

          interface Ethernet1/32

          interface Ethernet1/33

          interface Ethernet1/34

          interface Ethernet1/35

          interface Ethernet1/36

          interface Ethernet1/37

          interface Ethernet1/38

          interface Ethernet1/39

          interface Ethernet1/40

          interface Ethernet1/41

          interface Ethernet1/42

          interface Ethernet1/43

          interface Ethernet1/44

          interface Ethernet1/45

          interface Ethernet1/46

          interface Ethernet1/47

          interface Ethernet1/48

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.58/24

          interface loopback0
            ip address 10.0.0.253/32
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            router-id 10.0.0.253
          router bgp 65001
            router-id 10.0.0.253
            address-family l2vpn evpn
              retain route-target all
            template peer leaf
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
                route-reflector-client
            neighbor 10.0.0.1
              inherit peer leaf
            neighbor 10.0.0.2
              inherit peer leaf
            neighbor 10.0.0.3
              inherit peer leaf
            neighbor 10.0.0.4
              inherit peer leaf
            neighbor 10.0.0.5
              inherit peer leaf

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n9
    image_definition: null
    label: spsw02
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: 440
    y: -520
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n10
    image_definition: null
    label: mgmtnw(spsw02)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 640
    y: -520
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: user-data
        content: |-
          #cloud-config
          hostname: tenant1-server01
          manage_etc_hosts: True
          system_info:
            default_user:
              name: cisco
          password: cisco
          chpasswd: { expire: False }
          ssh_pwauth: True
          ssh_authorized_keys:
            - your-ssh-pubkey-line-goes-here
          bootcmd:
            - |
              if [ ! -e "/etc/systemd/network/10-bond0.link" ]; then
              echo "[Match]
              OriginalName=ens2
              OriginalName=ens3
              [Link]
              Duplex=full
              BitsPerSecond=1000M" | tee /etc/systemd/network/10-bond0.link
              chmod +x /etc/systemd/network/10-bond0.link
              reboot
              fi
      - name: network-config
        content: |-
          #network-config
          network:
            version: 2
            ethernets:
              ens2:
                optional: true
              ens3:
                optional: true
            bonds:
              bond0:
                interfaces: [ens2, ens3]
                parameters:
                  mode: 802.3ad
                  lacp-rate: fast
            vlans:
              bond0.100:
                id: 100
                link: bond0
                addresses:
                  - 172.16.0.2/24
                gateway4: 172.16.0.254
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n11
    image_definition: null
    label: tenant1-server01
    node_definition: ubuntu
    parameters: {}
    ram: null
    tags: []
    x: -160
    y: 0
    interfaces:
      - id: i0
        label: ens2
        mac_address: null
        slot: 0
        type: physical
      - id: i1
        label: ens3
        mac_address: null
        slot: 1
        type: physical
  - boot_disk_size: null
    configuration:
      - name: user-data
        content: |-
          #cloud-config
          hostname: tenant2-server01
          manage_etc_hosts: True
          system_info:
            default_user:
              name: cisco
          password: cisco
          chpasswd: { expire: False }
          ssh_pwauth: True
          ssh_authorized_keys:
            - your-ssh-pubkey-line-goes-here
          bootcmd:
            - |
              if [ ! -e "/etc/systemd/network/10-bond0.link" ]; then
              echo "[Match]
              OriginalName=ens2
              OriginalName=ens3
              [Link]
              Duplex=full
              BitsPerSecond=1000M" | tee /etc/systemd/network/10-bond0.link
              chmod +x /etc/systemd/network/10-bond0.link
              reboot
              fi
      - name: network-config
        content: |-
          #network-config
          network:
            version: 2
            ethernets:
              ens2:
                optional: true
              ens3:
                optional: true
            bonds:
              bond0:
                interfaces: [ens2, ens3]
                parameters:
                  mode: 802.3ad
                  lacp-rate: fast
            vlans:
              bond0.200:
                id: 200
                link: bond0
                addresses:
                  - 172.17.0.1/24
                gateway4: 172.17.0.254
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n12
    image_definition: null
    label: tenant2-server01
    node_definition: ubuntu
    parameters: {}
    ram: null
    tags: []
    x: 0
    y: 0
    interfaces:
      - id: i0
        label: ens2
        mac_address: null
        slot: 0
        type: physical
      - id: i1
        label: ens3
        mac_address: null
        slot: 1
        type: physical
  - boot_disk_size: null
    configuration:
      - name: user-data
        content: |-
          #cloud-config
          hostname: tenant3-server01
          manage_etc_hosts: True
          system_info:
            default_user:
              name: cisco
          password: cisco
          chpasswd: { expire: False }
          ssh_pwauth: True
          ssh_authorized_keys:
            - your-ssh-pubkey-line-goes-here
          bootcmd:
            - |
              if [ ! -e "/etc/systemd/network/10-bond0.link" ]; then
              echo "[Match]
              OriginalName=ens2
              OriginalName=ens3
              [Link]
              Duplex=full
              BitsPerSecond=1000M" | tee /etc/systemd/network/10-bond0.link
              chmod +x /etc/systemd/network/10-bond0.link
              reboot
              fi
      - name: network-config
        content: |-
          #network-config
          network:
            version: 2
            ethernets:
              ens2:
                optional: true
              ens3:
                optional: true
            bonds:
              bond0:
                interfaces: [ens2, ens3]
                parameters:
                  mode: 802.3ad
                  lacp-rate: fast
            vlans:
              bond0.1001:
                id: 1001
                link: bond0
                addresses:
                  - 192.168.133.31/24
                gateway4: 192.168.133.1
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n13
    image_definition: null
    label: tenant3-server01
    node_definition: ubuntu
    parameters: {}
    ram: null
    tags: []
    x: 160
    y: 0
    interfaces:
      - id: i0
        label: ens2
        mac_address: null
        slot: 0
        type: physical
      - id: i1
        label: ens3
        mac_address: null
        slot: 1
        type: physical
  - boot_disk_size: null
    configuration:
      - name: nxos_config.txt
        content: |2-

          !Command: show running-config
          !Running configuration last done at: Sat Mar  1 17:43:05 2025
          !Time: Sat Mar  1 17:43:05 2025

          version 10.5(1) Bios:version
          hostname lfsw03
          vdc lfsw03 id 1
            limit-resource vlan minimum 16 maximum 4094
            limit-resource vrf minimum 2 maximum 4096
            limit-resource port-channel minimum 0 maximum 511
            limit-resource m4route-mem minimum 58 maximum 58
            limit-resource m6route-mem minimum 8 maximum 8

          feature nxapi
          cfs eth distribute
          nv overlay evpn
          feature ospf
          feature bgp
          feature interface-vlan
          feature vn-segment-vlan-based
          feature lacp
          feature lldp
          feature bfd
          clock timezone JST 9 0
          feature nv overlay

          no password strength-check
          username admin password 5 $5$DCALLD$97LM57TD1qBqvKxSPC.zrFWkwLb.mcI3oelSIY2ezK6  role network-admin
          username cisco password 5 $5$PLGLCI$KPPOvBPkC9lKtmwVpmhHOPkkAMuMSqfWf2Lj7yVmBX0  role network-admin
          username cisco passphrase  lifetime 99999 warntime 14 gracetime 3
          ssh key rsa 2048
          no ip domain-lookup
          copp profile strict
          snmp-server user admin network-admin auth md5 4976440ADE75ACA80D512BEB0C28C2391689 priv aes-128 174C152CF52BB2BA0C0D5F90515ECB771395 localizedV2key
          snmp-server user cisco network-admin auth md5 53150C1621F12906B9B08951D9C85FB8D557 priv aes-128 01462E3AB6CF0D1A9FEAC459969410F98A55 localizedV2key
          rmon event 1 log trap public description FATAL(1) owner PMON@FATAL
          rmon event 2 log trap public description CRITICAL(2) owner PMON@CRITICAL
          rmon event 3 log trap public description ERROR(3) owner PMON@ERROR
          rmon event 4 log trap public description WARNING(4) owner PMON@WARNING
          rmon event 5 log trap public description INFORMATION(5) owner PMON@INFO

          fabric forwarding anycast-gateway-mac 2020.0000.00aa
          vlan 1,10-11,20,3001-3002
          vlan 10
            name tenant1-server-seg1
            vn-segment 10100
          vlan 11
            name tenant1-server-seg2
            vn-segment 10101
          vlan 20
            name tenant2-server-seg1
            vn-segment 20200
          vlan 3001
            name tenant1-vpc1-l3vni
            vn-segment 19001
          vlan 3002
            name tenant2-vpc1-l3vni
            vn-segment 29001

          ip prefix-list all-v4 seq 10 permit 0.0.0.0/0 ge 1 le 32
          route-map permit-all-v4 permit 100
            match ip address prefix-list all-v4
          vrf context management
            ip name-server 192.168.129.254
            ip route 0.0.0.0/0 192.168.129.254
          vrf context tenant1-vpc1
            vni 19001
            rd auto
            address-family ipv4 unicast


          interface Vlan1

          interface Vlan10
            description tenant1-server-seg1
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan11
            description tenant1-server-seg2
            no shutdown
            vrf member tenant1-vpc1
            ip address 172.16.1.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan20
            description tenant2-server-seg1
            no shutdown
            vrf member tenant2-vpc1
            ip address 172.17.0.254/24
            fabric forwarding mode anycast-gateway

          interface Vlan3001
            no shutdown
            vrf member tenant1-vpc1
            ip forward

          interface Vlan3002
            no shutdown
            vrf member tenant2-vpc1
            ip forward

          interface nve1
            no shutdown
            host-reachability protocol bgp
            advertise virtual-rmac
            source-interface loopback1
            member vni 10100
              ingress-replication protocol bgp
            member vni 10101
              ingress-replication protocol bgp
            member vni 19001 associate-vrf
            member vni 20200
              ingress-replication protocol bgp
            member vni 29001 associate-vrf

          interface Ethernet1/1
            description tenant1-server02 eth0
            switchport mode trunk

          interface Ethernet1/2
            description tenant1-server03 eth0
            switchport mode trunk

          interface Ethernet1/3
            description tenant2-server02 eth0
            switchport mode trunk

          interface Ethernet1/4
            shutdown

          interface Ethernet1/5
            shutdown

          interface Ethernet1/6
            shutdown

          interface Ethernet1/7
            shutdown

          interface Ethernet1/8
            shutdown

          interface Ethernet1/9
            shutdown

          interface Ethernet1/10
            shutdown

          interface Ethernet1/11
            shutdown

          interface Ethernet1/12
            shutdown

          interface Ethernet1/13
            shutdown

          interface Ethernet1/14
            shutdown

          interface Ethernet1/15
            shutdown

          interface Ethernet1/16
            shutdown

          interface Ethernet1/17
            shutdown

          interface Ethernet1/18
            shutdown

          interface Ethernet1/19
            shutdown

          interface Ethernet1/20
            shutdown

          interface Ethernet1/21
            shutdown

          interface Ethernet1/22
            shutdown

          interface Ethernet1/23
            shutdown

          interface Ethernet1/24
            shutdown

          interface Ethernet1/25
            shutdown

          interface Ethernet1/26
            shutdown

          interface Ethernet1/27
            shutdown

          interface Ethernet1/28
            shutdown

          interface Ethernet1/29
            shutdown

          interface Ethernet1/30
            shutdown

          interface Ethernet1/31
            shutdown

          interface Ethernet1/32
            shutdown

          interface Ethernet1/33
            shutdown

          interface Ethernet1/34
            shutdown

          interface Ethernet1/35
            shutdown

          interface Ethernet1/36
            shutdown

          interface Ethernet1/37
            shutdown

          interface Ethernet1/38
            shutdown

          interface Ethernet1/39
            shutdown

          interface Ethernet1/40
            shutdown

          interface Ethernet1/41
            shutdown

          interface Ethernet1/42
            shutdown

          interface Ethernet1/43
            shutdown

          interface Ethernet1/44
            shutdown

          interface Ethernet1/45
            shutdown

          interface Ethernet1/46
            shutdown

          interface Ethernet1/47
            description spsw02 eth1/3
            no switchport
            mtu 9216
            ip address 10.0.4.4/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/48
            description spsw01 eth1/3
            no switchport
            mtu 9216
            ip address 10.0.3.4/31
            ip ospf network point-to-point
            ip router ospf 1 area 0.0.0.0
            no shutdown

          interface Ethernet1/49

          interface Ethernet1/50

          interface Ethernet1/51

          interface Ethernet1/52

          interface Ethernet1/53

          interface Ethernet1/54

          interface Ethernet1/55

          interface Ethernet1/56

          interface Ethernet1/57

          interface Ethernet1/58

          interface Ethernet1/59

          interface Ethernet1/60

          interface Ethernet1/61

          interface Ethernet1/62

          interface Ethernet1/63

          interface Ethernet1/64

          interface mgmt0
            vrf member management
            ip address 192.168.129.53/24

          interface loopback0
            description RouterID Loopback
            ip address 10.0.0.3/32
            ip router ospf 1 area 0.0.0.0

          interface loopback1
            description VTEP Loopback
            ip address 10.0.1.3/32
            ip address 10.0.2.2/32 secondary
            ip router ospf 1 area 0.0.0.0
          icam monitor scale

          line console
            exec-timeout 0
          line vty
            exec-timeout 0
          boot nxos bootflash:/nxos64-cs.10.5.1.F.bin
          router ospf 1
            router-id 10.0.0.3
          router bgp 65001
            router-id 10.0.0.3
            address-family l2vpn evpn
            neighbor 10.0.0.253
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            neighbor 10.0.0.254
              remote-as internal
              update-source loopback0
              address-family l2vpn evpn
                send-community
                send-community extended
            vrf tenant1-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
            vrf tenant2-vpc1
              address-family ipv4 unicast
                redistribute direct route-map permit-all-v4
          evpn
            vni 10100 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 10101 l2
              rd auto
              route-target import auto
              route-target export auto
            vni 20200 l2
              rd auto
              route-target import auto
              route-target export auto

          no logging console
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n14
    image_definition: null
    label: lfsw03
    node_definition: nxosv9000
    parameters: {}
    ram: null
    tags: []
    x: 480
    y: -200
    interfaces:
      - id: i0
        label: Loopback0
        mac_address: null
        type: loopback
      - id: i1
        label: mgmt0
        mac_address: null
        slot: 0
        type: physical
      - id: i2
        label: Ethernet1/1
        mac_address: null
        slot: 1
        type: physical
      - id: i3
        label: Ethernet1/2
        mac_address: null
        slot: 2
        type: physical
      - id: i4
        label: Ethernet1/3
        mac_address: null
        slot: 3
        type: physical
      - id: i5
        label: Ethernet1/4
        mac_address: null
        slot: 4
        type: physical
      - id: i6
        label: Ethernet1/5
        mac_address: null
        slot: 5
        type: physical
      - id: i7
        label: Ethernet1/6
        mac_address: null
        slot: 6
        type: physical
      - id: i8
        label: Ethernet1/7
        mac_address: null
        slot: 7
        type: physical
      - id: i9
        label: Ethernet1/8
        mac_address: null
        slot: 8
        type: physical
      - id: i10
        label: Ethernet1/9
        mac_address: null
        slot: 9
        type: physical
      - id: i11
        label: Ethernet1/10
        mac_address: null
        slot: 10
        type: physical
      - id: i12
        label: Ethernet1/11
        mac_address: null
        slot: 11
        type: physical
      - id: i13
        label: Ethernet1/12
        mac_address: null
        slot: 12
        type: physical
      - id: i14
        label: Ethernet1/13
        mac_address: null
        slot: 13
        type: physical
      - id: i15
        label: Ethernet1/14
        mac_address: null
        slot: 14
        type: physical
      - id: i16
        label: Ethernet1/15
        mac_address: null
        slot: 15
        type: physical
      - id: i17
        label: Ethernet1/16
        mac_address: null
        slot: 16
        type: physical
      - id: i18
        label: Ethernet1/17
        mac_address: null
        slot: 17
        type: physical
      - id: i19
        label: Ethernet1/18
        mac_address: null
        slot: 18
        type: physical
      - id: i20
        label: Ethernet1/19
        mac_address: null
        slot: 19
        type: physical
      - id: i21
        label: Ethernet1/20
        mac_address: null
        slot: 20
        type: physical
      - id: i22
        label: Ethernet1/21
        mac_address: null
        slot: 21
        type: physical
      - id: i23
        label: Ethernet1/22
        mac_address: null
        slot: 22
        type: physical
      - id: i24
        label: Ethernet1/23
        mac_address: null
        slot: 23
        type: physical
      - id: i25
        label: Ethernet1/24
        mac_address: null
        slot: 24
        type: physical
      - id: i26
        label: Ethernet1/25
        mac_address: null
        slot: 25
        type: physical
      - id: i27
        label: Ethernet1/26
        mac_address: null
        slot: 26
        type: physical
      - id: i28
        label: Ethernet1/27
        mac_address: null
        slot: 27
        type: physical
      - id: i29
        label: Ethernet1/28
        mac_address: null
        slot: 28
        type: physical
      - id: i30
        label: Ethernet1/29
        mac_address: null
        slot: 29
        type: physical
      - id: i31
        label: Ethernet1/30
        mac_address: null
        slot: 30
        type: physical
      - id: i32
        label: Ethernet1/31
        mac_address: null
        slot: 31
        type: physical
      - id: i33
        label: Ethernet1/32
        mac_address: null
        slot: 32
        type: physical
      - id: i34
        label: Ethernet1/33
        mac_address: null
        slot: 33
        type: physical
      - id: i35
        label: Ethernet1/34
        mac_address: null
        slot: 34
        type: physical
      - id: i36
        label: Ethernet1/35
        mac_address: null
        slot: 35
        type: physical
      - id: i37
        label: Ethernet1/36
        mac_address: null
        slot: 36
        type: physical
      - id: i38
        label: Ethernet1/37
        mac_address: null
        slot: 37
        type: physical
      - id: i39
        label: Ethernet1/38
        mac_address: null
        slot: 38
        type: physical
      - id: i40
        label: Ethernet1/39
        mac_address: null
        slot: 39
        type: physical
      - id: i41
        label: Ethernet1/40
        mac_address: null
        slot: 40
        type: physical
      - id: i42
        label: Ethernet1/41
        mac_address: null
        slot: 41
        type: physical
      - id: i43
        label: Ethernet1/42
        mac_address: null
        slot: 42
        type: physical
      - id: i44
        label: Ethernet1/43
        mac_address: null
        slot: 43
        type: physical
      - id: i45
        label: Ethernet1/44
        mac_address: null
        slot: 44
        type: physical
      - id: i46
        label: Ethernet1/45
        mac_address: null
        slot: 45
        type: physical
      - id: i47
        label: Ethernet1/46
        mac_address: null
        slot: 46
        type: physical
      - id: i48
        label: Ethernet1/47
        mac_address: null
        slot: 47
        type: physical
      - id: i49
        label: Ethernet1/48
        mac_address: null
        slot: 48
        type: physical
  - boot_disk_size: null
    configuration:
      - name: default
        content: System Bridge
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n15
    image_definition: null
    label: mgmtnw(lfsw03)
    node_definition: external_connector
    parameters: {}
    ram: null
    tags: []
    x: 640
    y: -200
    interfaces:
      - id: i0
        label: port
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: iosxe_config.txt
        content: |-
          # this is a shell script which will be sourced at boot
          hostname tenant1-server02
          # configurable user account
          USERNAME=cisco
          PASSWORD=cisco
          # no password for tc user by default
          TC_PASSWORD=
          modprobe 8021q
          vconfig add eth0 10
          ifconfig eth0.10 up
          ifconfig eth0.10 172.16.0.2 netmask 255.255.255.0 up
          route add -net 0.0.0.0/0 gw 172.16.0.254 dev eth0.10
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n16
    image_definition: null
    label: tenant1-server02
    node_definition: server
    parameters: {}
    ram: null
    tags: []
    x: 320
    y: 0
    interfaces:
      - id: i0
        label: eth0
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: iosxe_config.txt
        content: |-
          # this is a shell script which will be sourced at boot
          hostname tenant1-server03
          # configurable user account
          USERNAME=cisco
          PASSWORD=cisco
          # no password for tc user by default
          TC_PASSWORD=
          modprobe 8021q
          vconfig add eth0 11
          ifconfig eth0.11 up
          ifconfig eth0.11 172.16.1.1 netmask 255.255.255.0 up
          route add -net 0.0.0.0/0 gw 172.16.1.254 dev eth0.11
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n17
    image_definition: null
    label: tenant1-server03
    node_definition: server
    parameters: {}
    ram: null
    tags: []
    x: 480
    y: 0
    interfaces:
      - id: i0
        label: eth0
        mac_address: null
        slot: 0
        type: physical
  - boot_disk_size: null
    configuration:
      - name: iosxe_config.txt
        content: |-
          # this is a shell script which will be sourced at boot
          hostname tenant2-server02
          # configurable user account
          USERNAME=cisco
          PASSWORD=cisco
          # no password for tc user by default
          TC_PASSWORD=
          modprobe 8021q
          vconfig add eth0 20
          ifconfig eth0.20 up
          ifconfig eth0.20 172.17.0.2 netmask 255.255.255.0 up
          route add -net 0.0.0.0/0 gw 172.17.0.254 dev eth0.20
    cpu_limit: null
    cpus: null
    data_volume: null
    hide_links: false
    id: n18
    image_definition: null
    label: tenant2-server02
    node_definition: server
    parameters: {}
    ram: null
    tags: []
    x: 640
    y: 0
    interfaces:
      - id: i0
        label: eth0
        mac_address: null
        slot: 0
        type: physical
links:
  - id: l0
    n1: n0
    n2: n3
    i1: i49
    i2: i2
    conditioning: {}
    label: lfsw01-Ethernet1/48<->spsw01-Ethernet1/1
  - id: l1
    n1: n0
    n2: n1
    i1: i1
    i2: i0
    conditioning: {}
    label: lfsw01-mgmt0<->mgmtnw(lfsw01)-port
  - id: l2
    n1: n2
    n2: n4
    i1: i1
    i2: i0
    conditioning: {}
    label: lfsw03-mgmt0<->mgmtnw(lfsw03)-port
  - id: l3
    n1: n3
    n2: n5
    i1: i1
    i2: i0
    conditioning: {}
    label: spsw01-mgmt0<->mgmtnw(spsw01)-port
  - id: l4
    n1: n6
    n2: n3
    i1: i49
    i2: i3
    conditioning: {}
    label: lfsw02-Ethernet1/48<->spsw01-Ethernet1/2
  - id: l5
    n1: n6
    n2: n7
    i1: i1
    i2: i0
    conditioning: {}
    label: lfsw02-mgmt0<->mgmtnw(lfsw02)-port
  - id: l6
    n1: n9
    n2: n0
    i1: i2
    i2: i48
    conditioning: {}
    label: spsw02-Ethernet1/1<->lfsw01-Ethernet1/47
  - id: l7
    n1: n9
    n2: n6
    i1: i3
    i2: i48
    conditioning: {}
    label: spsw02-Ethernet1/2<->lfsw02-Ethernet1/47
  - id: l8
    n1: n9
    n2: n10
    i1: i1
    i2: i0
    conditioning: {}
    label: spsw02-mgmt0<->mgmtnw(spsw02)-port
  - id: l9
    n1: n11
    n2: n0
    i1: i0
    i2: i2
    conditioning: {}
    label: ubuntu-0-ens2<->lfsw01-Ethernet1/1
  - id: l10
    n1: n11
    n2: n6
    i1: i1
    i2: i2
    conditioning: {}
    label: ubuntu-0-ens3<->lfsw02-Ethernet1/1
  - id: l11
    n1: n12
    n2: n0
    i1: i0
    i2: i3
    conditioning: {}
    label: tenant2-server01-ens2<->lfsw01-Ethernet1/2
  - id: l12
    n1: n12
    n2: n6
    i1: i1
    i2: i3
    conditioning: {}
    label: tenant2-server01-ens3<->lfsw02-Ethernet1/2
  - id: l13
    n1: n13
    n2: n0
    i1: i0
    i2: i4
    conditioning: {}
    label: tenant3-server01-ens2<->lfsw01-Ethernet1/3
  - id: l14
    n1: n13
    n2: n6
    i1: i1
    i2: i4
    conditioning: {}
    label: tenant3-server01-ens3<->lfsw02-Ethernet1/3
  - id: l15
    n1: n8
    n2: n2
    i1: i0
    i2: i2
    conditioning: {}
    label: tenant2-nw-vlan300-port<->bdlf01-Ethernet1/1
  - id: l16
    n1: n14
    n2: n3
    i1: i49
    i2: i4
    conditioning: {}
    label: lfsw03-Ethernet1/48<->spsw01-Ethernet1/3
  - id: l17
    n1: n14
    n2: n9
    i1: i48
    i2: i4
    conditioning: {}
    label: lfsw03-Ethernet1/47<->spsw02-Ethernet1/3
  - id: l18
    n1: n2
    n2: n3
    i1: i49
    i2: i6
    conditioning: {}
    label: bdsw01-Ethernet1/48<->spsw01-Ethernet1/5
  - id: l19
    n1: n15
    n2: n14
    i1: i0
    i2: i1
    conditioning: {}
    label: mgmtnw(lfsw03)-port<->lfsw03-mgmt0
  - id: l20
    n1: n16
    n2: n14
    i1: i0
    i2: i2
    conditioning: {}
    label: tenant1-server02-eth0<->lfsw03-Ethernet1/1
  - id: l21
    n1: n17
    n2: n14
    i1: i0
    i2: i3
    conditioning: {}
    label: tenant1-server03-eth0<->lfsw03-Ethernet1/2
  - id: l22
    n1: n18
    n2: n14
    i1: i0
    i2: i4
    conditioning: {}
    label: tenant1-server03_0-eth0<->lfsw03-Ethernet1/3
  - id: l23
    n1: n2
    n2: n9
    i1: i48
    i2: i6
    conditioning: {}
    label: bdsw01-Ethernet1/47<->spsw02-Ethernet1/5
lab:
  description: ''
  notes: ''
  title: Leaf-Spine-Test3
  version: 0.3.0

Lab 構成図

メモリがこの構成で約 78% となるので、あと NX-OS 9K 1台くらいで厳しそう

シミュレータ内のサーバでの LACP について

サーバの Speed/Duplex の問題で LACP のパケットが送られてこないらしい

サーバの user-data (cloud-init) に下記を設定することで解決できた (参考)

※下記はens2,ens3のインターフェース時の設定追加箇所例 (全体設定は全体YAMLを掲載しているのでそちらを参照)

user-data

bootcmd:
  - |
    if [ ! -e "/etc/systemd/network/10-bond0.link" ]; then
    echo "[Match]
    OriginalName=ens2
    OriginalName=ens3
    [Link]
    Duplex=full
    BitsPerSecond=1000M" | tee /etc/systemd/network/10-bond0.link
    chmod +x /etc/systemd/network/10-bond0.link
    reboot
    fi

動作確認

動作確認として下記コマンドで各 Leaf での状態を確認した

leafコマンド

show nve peers
show nve vni
show bgp l2vpn evpn summary
show bgp l2vpn evpn
show l2route evpn mac all
show l2route evpn mac-ip all
show vpc brief
show ip route vrf all

各 Leaf での表示結果は下記に折りたたみで共有する

　lfsw01 での出力結果　

lfsw01

lfsw01# show nve peers
Interface Peer-IP                                 State LearnType Uptime   Router-Mac       
--------- --------------------------------------  ----- --------- -------- -----------------
nve1      10.0.1.2                                Up    CP        02:00:16 5222.d4f5.1b08   
nve1      10.0.1.3                                Up    CP        01:36:41 527f.320c.1b08   
nve1      10.0.1.5                                Up    CP        01:48:53 n/a              

lfsw01# show nve vni
Codes: CP - Control Plane        DP - Data Plane          
       UC - Unconfigured         SA - Suppress ARP        
       S-ND - Suppress ND        
       SU - Suppress Unknown Unicast 
       Xconn - Crossconnect      
       MS-IR - Multisite Ingress Replication 
       HYB - Hybrid IRB mode
    
Interface VNI      Multicast-group   State Mode Type [BD/VRF]      Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1      10100    UnicastBGP        Up    CP   L2 [100]                
nve1      10101    UnicastBGP        Up    CP   L2 [101]                
nve1      19001    n/a               Up    CP   L3 [tenant1-vpc1]       
nve1      20200    UnicastBGP        Up    CP   L2 [200]                
nve1      29001    n/a               Up    CP   L3 [tenant2-vpc1]       
nve1      30300    UnicastBGP        Up    CP   L2 [1001]               

lfsw01# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.1, local AS number 65001
BGP table version is 441, L2VPN EVPN config peers 2, capable peers 2
47 network entries and 69 paths using 14484 bytes of memory
BGP attribute entries [53/19504], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [6/24]

Neighbor        V    AS    MsgRcvd    MsgSent   TblVer  InQ OutQ Up/Down  State/PfxRcd
10.0.0.253      4 65001        360        122      441    0    0 01:50:38 17        
10.0.0.254      4 65001        372        134      441    0    0 02:03:34 17        

Neighbor        T    AS PfxRcd     Type-2     Type-3     Type-4     Type-5     Type-12   
10.0.0.253      I 65001 17         8          4          0          5          0         
10.0.0.254      I 65001 17         8          4          0          5          0         
lfsw01# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 441, Local Router ID is 10.0.0.1
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.0.0.1:32867    (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5254.0067.2e0c]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>l[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>l[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100      32768 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.1:32868    (L2VNI 10101)
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.1:32967    (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.00ac.0b42]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>l[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[32]:[172.17.0.1]/272
                      10.0.2.1                          100      32768 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.1:33768    (L2VNI 30300)
*>i[2]:[0]:[0]:[48]:[18c2.bf54.7c1f]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[2]:[0]:[0]:[48]:[3240.c812.699b]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[2]:[0]:[0]:[48]:[3e8c.cac2.5d08]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[fcec.da7b.30d6]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
                      10.0.1.5                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.2:4
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.2                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?
*>i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.2                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?

Route Distinguisher: 10.0.0.2:5
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
                      10.0.1.2                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?

Route Distinguisher: 10.0.0.3:4
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.3                 0        100          0 ?
* i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.3                 0        100          0 ?
*>i                   10.0.1.3                 0        100          0 ?

Route Distinguisher: 10.0.0.3:32777
*>i[2]:[0]:[0]:[48]:[5254.0067.2e0c]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
* i                   10.0.1.3                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
* i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.3:32778
* i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.3:32787
* i[2]:[0]:[0]:[48]:[5254.00ac.0b42]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.5:33067
* i[2]:[0]:[0]:[48]:[18c2.bf54.7c1f]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[3240.c812.699b]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[3e8c.cac2.5d08]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[fcec.da7b.30d6]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[3]:[0]:[32]:[10.0.1.5]/88
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i

Route Distinguisher: 10.0.0.1:4    (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?
*>l                   10.0.1.1                 0        100      32768 ?
* i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?
*>l                   10.0.1.1                 0        100      32768 ?

Route Distinguisher: 10.0.0.1:5    (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
                      10.0.1.2                 0        100          0 ?
*>l                   10.0.1.1                 0        100      32768 ?

lfsw01# show l2route evpn mac all

Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan

(PipOrp): Directly connected Orphan to PIP based vPC BGW 
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Prod   Flags              Seq No     Next-Hops                              
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100         5254.0067.2e0c BGP    Rcv                0          10.0.1.3 (Label: 10100)
100         52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
100         ea7e.beff.61a6 Local  L,                 0          Po11
101         5254.005a.4b65 BGP    SplRcv             0          10.0.1.3 (Label: 10101)
101         52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
200         2288.8db1.d09e Local  L,                 0          Po12
200         5254.00ac.0b42 BGP    Rcv                0          10.0.1.3 (Label: 20200)
200         52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
1001        18c2.bf54.7c1f BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        3240.c812.699b BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        3e8c.cac2.5d08 BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
1001        fcec.da7b.30d6 BGP    Rcv                0          10.0.1.5 (Label: 30300)
3001        5222.d4f5.1b08 VXLAN  Rmac,              0          10.0.1.2
3001        527f.320c.1b08 VXLAN  Rmac,              0          10.0.1.3
3001        52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
3002        5222.d4f5.1b08 VXLAN  Rmac,              0          10.0.1.2
3002        52c7.4646.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
lfsw01# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW 
(Pipporp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Host IP                                 Prod   Flags              Seq No     Next-Hops                              
----------- -------------- --------------------------------------- ------ ----------------- ---------- ------------------------------------------------
---------
100         ea7e.beff.61a6 172.16.0.1                              HMM    L,                 0         Local                                  
101         5254.005a.4b65 172.16.1.1                              BGP    --                 0         10.0.1.3 (Label: 10101)
200         2288.8db1.d09e 172.17.0.1                              HMM    L,                 0         Local                                  
lfsw01# show vpc brief
Legend:
                (*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                     : 1   
Peer status                       : peer adjacency formed ok      
vPC keep-alive status             : peer is alive                 
Configuration consistency status  : success 
Per-vlan consistency status       : success                       
Type-2 consistency status         : success 
vPC role                          : primary                       
Number of vPCs configured         : 3   
Peer Gateway                      : Disabled
Dual-active excluded VLANs        : -
Graceful Consistency Check        : Enabled
Auto-recovery status              : Disabled
Delay-restore status              : Timer is off.(timeout = 30s)
Delay-restore SVI status          : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status  : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router    : Disabled
Virtual-peerlink mode             : Enabled

vPC Peer-link status
---------------------------------------------------------------------
id    Port   Status Active vlans    
--    ----   ------ -------------------------------------------------
1     Po1    up     1,100-101,200,1001,3001-3002                                         

vPC status
----------------------------------------------------------------------------
Id    Port          Status Consistency Reason                Active vlans
--    ------------  ------ ----------- ------                ---------------
11    Po11          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  
12    Po12          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  
13    Po13          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  

Please check "show vpc consistency-parameters vpc <vpc-num>" for the 
consistency reason of down vpc and for type-2 consistency reasons for 
any vpc.

lfsw01# show ip route vrf all 
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.0.0.1/32, ubest/mbest: 2/0, attached
    *via 10.0.0.1, Lo0, [0/0], 02:06:17, local
    *via 10.0.0.1, Lo0, [0/0], 02:06:17, direct
10.0.0.2/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 02:04:25, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.0.3/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 01:51:37, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.0.5/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 01:50:02, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.0.253/32, ubest/mbest: 1/0
    *via 10.0.4.1, Eth1/47, [110/41], 01:49:05, ospf-1, intra
10.0.0.254/32, ubest/mbest: 1/0
    *via 10.0.3.1, Eth1/48, [110/41], 02:04:35, ospf-1, intra
10.0.1.1/32, ubest/mbest: 2/0, attached
    *via 10.0.1.1, Lo1, [0/0], 02:01:21, local
    *via 10.0.1.1, Lo1, [0/0], 02:01:21, direct
10.0.1.2/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 02:01:21, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.1.3/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 01:51:37, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.1.5/32, ubest/mbest: 2/0
    *via 10.0.3.1, Eth1/48, [110/81], 01:50:02, ospf-1, intra
    *via 10.0.4.1, Eth1/47, [110/81], 01:49:05, ospf-1, intra
10.0.2.1/32, ubest/mbest: 2/0, attached
    *via 10.0.2.1, Lo1, [0/0], 02:01:21, local
    *via 10.0.2.1, Lo1, [0/0], 02:01:21, direct
10.0.3.0/31, ubest/mbest: 1/0, attached
    *via 10.0.3.0, Eth1/48, [0/0], 02:04:55, direct
10.0.3.0/32, ubest/mbest: 1/0, attached
    *via 10.0.3.0, Eth1/48, [0/0], 02:04:55, local
10.0.3.2/31, ubest/mbest: 1/0
    *via 10.0.3.1, Eth1/48, [110/80], 02:04:35, ospf-1, intra
10.0.3.4/31, ubest/mbest: 1/0
    *via 10.0.3.1, Eth1/48, [110/80], 02:04:35, ospf-1, intra
10.0.3.8/31, ubest/mbest: 1/0
    *via 10.0.3.1, Eth1/48, [110/80], 01:52:52, ospf-1, intra
10.0.4.0/31, ubest/mbest: 1/0, attached
    *via 10.0.4.0, Eth1/47, [0/0], 02:04:55, direct
10.0.4.0/32, ubest/mbest: 1/0, attached
    *via 10.0.4.0, Eth1/47, [0/0], 02:04:55, local
10.0.4.2/31, ubest/mbest: 1/0
    *via 10.0.4.1, Eth1/47, [110/80], 01:49:05, ospf-1, intra
10.0.4.4/31, ubest/mbest: 1/0
    *via 10.0.4.1, Eth1/47, [110/80], 01:49:05, ospf-1, intra
10.0.4.8/31, ubest/mbest: 1/0
    *via 10.0.4.1, Eth1/47, [110/80], 01:49:05, ospf-1, intra

IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

0.0.0.0/0, ubest/mbest: 1/0
    *via 192.168.129.254, [1/0], 01:16:15, static
192.168.129.0/24, ubest/mbest: 1/0, attached
    *via 192.168.129.51, mgmt0, [0/0], 02:06:21, direct
192.168.129.51/32, ubest/mbest: 1/0, attached
    *via 192.168.129.51, mgmt0, [0/0], 02:06:21, local

IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.16.0.0/24, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan100, [0/0], 02:04:10, direct
172.16.0.1/32, ubest/mbest: 1/0, attached
    *via 172.16.0.1, Vlan100, [190/0], 00:33:51, hmm
172.16.0.254/32, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan100, [0/0], 02:04:10, local
172.16.1.0/24, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan101, [0/0], 02:04:10, direct
172.16.1.1/32, ubest/mbest: 1/0
    *via 10.0.1.3%default, [200/0], 01:19:37, bgp-65001, internal, tag 65001, segid: 19001 tunnelid: 0xa000103 encap: VXLAN
 
172.16.1.254/32, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan101, [0/0], 02:04:10, local

IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.17.0.0/24, ubest/mbest: 1/0, attached
    *via 172.17.0.254, Vlan200, [0/0], 02:04:10, direct
172.17.0.1/32, ubest/mbest: 1/0, attached
    *via 172.17.0.1, Vlan200, [190/0], 00:33:51, hmm
172.17.0.254/32, ubest/mbest: 1/0, attached
    *via 172.17.0.254, Vlan200, [0/0], 02:04:10, local

IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

　lfsw02 での出力結果　

lfsw02

lfsw02# show nve peers
Interface Peer-IP                                 State LearnType Uptime   Router-Mac       
--------- --------------------------------------  ----- --------- -------- -----------------
nve1      10.0.1.1                                Up    CP        02:03:56 52c7.4646.1b08   
nve1      10.0.1.3                                Up    CP        01:40:21 527f.320c.1b08   
nve1      10.0.1.5                                Up    CP        01:52:33 n/a              

lfsw02# show nve vni
Codes: CP - Control Plane        DP - Data Plane          
       UC - Unconfigured         SA - Suppress ARP        
       S-ND - Suppress ND        
       SU - Suppress Unknown Unicast 
       Xconn - Crossconnect      
       MS-IR - Multisite Ingress Replication 
       HYB - Hybrid IRB mode
    
Interface VNI      Multicast-group   State Mode Type [BD/VRF]      Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1      10100    UnicastBGP        Up    CP   L2 [100]                
nve1      10101    UnicastBGP        Up    CP   L2 [101]                
nve1      19001    n/a               Up    CP   L3 [tenant1-vpc1]       
nve1      20200    UnicastBGP        Up    CP   L2 [200]                
nve1      29001    n/a               Up    CP   L3 [tenant2-vpc1]       
nve1      30300    UnicastBGP        Up    CP   L2 [1001]               

lfsw02# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.2, local AS number 65001
BGP table version is 417, L2VPN EVPN config peers 2, capable peers 2
47 network entries and 69 paths using 14484 bytes of memory
BGP attribute entries [53/19504], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [6/24]

Neighbor        V    AS    MsgRcvd    MsgSent   TblVer  InQ OutQ Up/Down  State/PfxRcd
10.0.0.253      4 65001        324        126      417    0    0 01:53:19 17        
10.0.0.254      4 65001        336        138      417    0    0 02:06:33 17        

Neighbor        T    AS PfxRcd     Type-2     Type-3     Type-4     Type-5     Type-12   
10.0.0.253      I 65001 17         8          4          0          5          0         
10.0.0.254      I 65001 17         8          4          0          5          0         
lfsw02# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 417, Local Router ID is 10.0.0.2
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.0.0.1:4
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.1                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?
*>i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.1                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?

Route Distinguisher: 10.0.0.1:5
*>i[5]:[0]:[0]:[24]:[172.17.0.0]/224
                      10.0.1.1                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?

Route Distinguisher: 10.0.0.2:32867    (L2VNI 10100)
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.0067.2e0c]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>l[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>l[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100      32768 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.2:32868    (L2VNI 10101)
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.2:32967    (L2VNI 20200)
*>l[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.00ac.0b42]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>l[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[32]:[172.17.0.1]/272
                      10.0.2.1                          100      32768 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.2:33768    (L2VNI 30300)
*>i[2]:[0]:[0]:[48]:[18c2.bf54.7c1f]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[2]:[0]:[0]:[48]:[3240.c812.699b]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[2]:[0]:[0]:[48]:[3e8c.cac2.5d08]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[fcec.da7b.30d6]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.5]/88
                      10.0.1.5                          100          0 i
*>l[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100      32768 i

Route Distinguisher: 10.0.0.3:4
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.3                 0        100          0 ?
* i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.3                 0        100          0 ?
*>i                   10.0.1.3                 0        100          0 ?

Route Distinguisher: 10.0.0.3:32777
*>i[2]:[0]:[0]:[48]:[5254.0067.2e0c]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
* i                   10.0.1.3                          100          0 i
*>i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
* i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.3:32778
* i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.3:32787
* i[2]:[0]:[0]:[48]:[5254.00ac.0b42]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i
* i[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100          0 i
*>i                   10.0.1.3                          100          0 i

Route Distinguisher: 10.0.0.5:33067
* i[2]:[0]:[0]:[48]:[18c2.bf54.7c1f]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[3240.c812.699b]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[3e8c.cac2.5d08]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[2]:[0]:[0]:[48]:[fcec.da7b.30d6]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i
* i[3]:[0]:[32]:[10.0.1.5]/88
                      10.0.1.5                          100          0 i
*>i                   10.0.1.5                          100          0 i

Route Distinguisher: 10.0.0.2:4    (L3VNI 19001)
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100          0 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?
*>l                   10.0.1.2                 0        100      32768 ?
* i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.3                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?
*>l                   10.0.1.2                 0        100      32768 ?

Route Distinguisher: 10.0.0.2:5    (L3VNI 29001)
*>l[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100      32768 i
* i[5]:[0]:[0]:[24]:[172.17.0.0]/224
                      10.0.1.1                 0        100          0 ?
*>l                   10.0.1.2                 0        100      32768 ?

lfsw02# show l2route evpn mac all

Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan

(PipOrp): Directly connected Orphan to PIP based vPC BGW 
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Prod   Flags              Seq No     Next-Hops                              
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
100         5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
100         5254.0067.2e0c BGP    Rcv                0          10.0.1.3 (Label: 10100)
100         ea7e.beff.61a6 Local  L,                 0          Po11
101         5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
101         5254.005a.4b65 BGP    SplRcv             0          10.0.1.3 (Label: 10101)
200         2288.8db1.d09e Local  L,                 0          Po12
200         5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
200         5254.00ac.0b42 BGP    Rcv                0          10.0.1.3 (Label: 20200)
1001        18c2.bf54.7c1f BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        3240.c812.699b BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        3e8c.cac2.5d08 BGP    Rcv                0          10.0.1.5 (Label: 30300)
1001        5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
1001        fcec.da7b.30d6 BGP    Rcv                0          10.0.1.5 (Label: 30300)
3001        5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
3001        527f.320c.1b08 VXLAN  Rmac,              0          10.0.1.3
3001        52c7.4646.1b08 VXLAN  Rmac,              0          10.0.1.1
3002        5222.d4f5.1b08 VXLAN  Stt,Nho,Dum,       0          10.0.2.1
3002        52c7.4646.1b08 VXLAN  Rmac,              0          10.0.1.1
lfsw02# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW 
(Pipporp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Host IP                                 Prod   Flags              Seq No     Next-Hops                              
----------- -------------- --------------------------------------- ------ ----------------- ---------- ------------------------------------------------
---------
100         ea7e.beff.61a6 172.16.0.1                              HMM    L,                 0         Local                                  
101         5254.005a.4b65 172.16.1.1                              BGP    --                 0         10.0.1.3 (Label: 10101)
200         2288.8db1.d09e 172.17.0.1                              HMM    L,                 0         Local                                  
lfsw02# show vpc brief
Legend:
                (*) - local vPC is down, forwarding via vPC peer-link

vPC domain id                     : 1   
Peer status                       : peer adjacency formed ok      
vPC keep-alive status             : peer is alive                 
Configuration consistency status  : success 
Per-vlan consistency status       : success                       
Type-2 consistency status         : success 
vPC role                          : secondary                     
Number of vPCs configured         : 3   
Peer Gateway                      : Disabled
Dual-active excluded VLANs        : -
Graceful Consistency Check        : Enabled
Auto-recovery status              : Disabled
Delay-restore status              : Timer is off.(timeout = 30s)
Delay-restore SVI status          : Timer is off.(timeout = 10s)
Delay-restore Orphan-port status  : Timer is off.(timeout = 0s)
Operational Layer3 Peer-router    : Disabled
Virtual-peerlink mode             : Enabled

vPC Peer-link status
---------------------------------------------------------------------
id    Port   Status Active vlans    
--    ----   ------ -------------------------------------------------
1     Po1    up     1,100-101,200,1001,3001-3002                                         

vPC status
----------------------------------------------------------------------------
Id    Port          Status Consistency Reason                Active vlans
--    ------------  ------ ----------- ------                ---------------
11    Po11          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  
12    Po12          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  
13    Po13          up     success     success               1,100-101,200,1001          
                                                             ,3001-3002                  

Please check "show vpc consistency-parameters vpc <vpc-num>" for the 
consistency reason of down vpc and for type-2 consistency reasons for 
any vpc.

lfsw02# show ip route vrf all
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.0.0.1/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 02:07:57, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:33, ospf-1, intra
10.0.0.2/32, ubest/mbest: 2/0, attached
    *via 10.0.0.2, Lo0, [0/0], 02:09:27, local
    *via 10.0.0.2, Lo0, [0/0], 02:09:27, direct
10.0.0.3/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 01:55:05, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:38, ospf-1, intra
10.0.0.5/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 01:53:30, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:38, ospf-1, intra
10.0.0.253/32, ubest/mbest: 1/0
    *via 10.0.4.3, Eth1/47, [110/41], 01:52:38, ospf-1, intra
10.0.0.254/32, ubest/mbest: 1/0
    *via 10.0.3.3, Eth1/48, [110/41], 02:07:57, ospf-1, intra
10.0.1.1/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 02:04:49, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:33, ospf-1, intra
10.0.1.2/32, ubest/mbest: 2/0, attached
    *via 10.0.1.2, Lo1, [0/0], 02:04:49, local
    *via 10.0.1.2, Lo1, [0/0], 02:04:49, direct
10.0.1.3/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 01:55:05, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:38, ospf-1, intra
10.0.1.5/32, ubest/mbest: 2/0
    *via 10.0.3.3, Eth1/48, [110/81], 01:53:30, ospf-1, intra
    *via 10.0.4.3, Eth1/47, [110/81], 01:52:38, ospf-1, intra
10.0.2.1/32, ubest/mbest: 2/0, attached
    *via 10.0.2.1, Lo1, [0/0], 02:04:49, local
    *via 10.0.2.1, Lo1, [0/0], 02:04:49, direct
10.0.3.0/31, ubest/mbest: 1/0
    *via 10.0.3.3, Eth1/48, [110/80], 02:07:57, ospf-1, intra
10.0.3.2/31, ubest/mbest: 1/0, attached
    *via 10.0.3.2, Eth1/48, [0/0], 02:08:13, direct
10.0.3.2/32, ubest/mbest: 1/0, attached
    *via 10.0.3.2, Eth1/48, [0/0], 02:08:13, local
10.0.3.4/31, ubest/mbest: 1/0
    *via 10.0.3.3, Eth1/48, [110/80], 02:07:57, ospf-1, intra
10.0.3.8/31, ubest/mbest: 1/0
    *via 10.0.3.3, Eth1/48, [110/80], 01:56:20, ospf-1, intra
10.0.4.0/31, ubest/mbest: 1/0
    *via 10.0.4.3, Eth1/47, [110/80], 01:52:38, ospf-1, intra
10.0.4.2/31, ubest/mbest: 1/0, attached
    *via 10.0.4.2, Eth1/47, [0/0], 02:08:13, direct
10.0.4.2/32, ubest/mbest: 1/0, attached
    *via 10.0.4.2, Eth1/47, [0/0], 02:08:13, local
10.0.4.4/31, ubest/mbest: 1/0
    *via 10.0.4.3, Eth1/47, [110/80], 01:52:38, ospf-1, intra
10.0.4.8/31, ubest/mbest: 1/0
    *via 10.0.4.3, Eth1/47, [110/80], 01:52:38, ospf-1, intra

IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

192.168.129.0/24, ubest/mbest: 1/0, attached
    *via 192.168.129.52, mgmt0, [0/0], 02:09:33, direct
192.168.129.52/32, ubest/mbest: 1/0, attached
    *via 192.168.129.52, mgmt0, [0/0], 02:09:33, local

IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.16.0.0/24, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan100, [0/0], 02:07:38, direct
172.16.0.1/32, ubest/mbest: 1/0, attached
    *via 172.16.0.1, Vlan100, [190/0], 00:37:19, hmm
172.16.0.254/32, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan100, [0/0], 02:07:38, local
172.16.1.0/24, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan101, [0/0], 02:07:38, direct
172.16.1.1/32, ubest/mbest: 1/0
    *via 10.0.1.3%default, [200/0], 01:23:06, bgp-65001, internal, tag 65001, segid: 19001 tunnelid: 0xa000103 encap: VXLAN
 
172.16.1.254/32, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan101, [0/0], 02:07:38, local

IP Route Table for VRF "tenant2-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.17.0.0/24, ubest/mbest: 1/0, attached
    *via 172.17.0.254, Vlan200, [0/0], 02:07:38, direct
172.17.0.1/32, ubest/mbest: 1/0, attached
    *via 172.17.0.1, Vlan200, [190/0], 00:37:19, hmm
172.17.0.254/32, ubest/mbest: 1/0, attached
    *via 172.17.0.254, Vlan200, [0/0], 02:07:38, local

IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

　lfsw03 での出力結果　

lfsw03

lfsw03# show nve peers
Interface Peer-IP                                 State LearnType Uptime   Router-Mac       
--------- --------------------------------------  ----- --------- -------- -----------------
nve1      10.0.1.1                                Up    CP        01:56:04 52c7.4646.1b08   
nve1      10.0.1.2                                Up    CP        01:56:02 5222.d4f5.1b08   
nve1      10.0.2.1                                Up    CP        01:56:04 0200.0a00.0201   

lfsw03# show nve vni
Codes: CP - Control Plane        DP - Data Plane          
       UC - Unconfigured         SA - Suppress ARP        
       S-ND - Suppress ND        
       SU - Suppress Unknown Unicast 
       Xconn - Crossconnect      
       MS-IR - Multisite Ingress Replication 
       HYB - Hybrid IRB mode
    
Interface VNI      Multicast-group   State Mode Type [BD/VRF]      Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1      10100    UnicastBGP        Up    CP   L2 [10]                 
nve1      10101    UnicastBGP        Up    CP   L2 [11]                 
nve1      19001    n/a               Up    CP   L3 [tenant1-vpc1]       
nve1      20200    UnicastBGP        Up    CP   L2 [20]                 
nve1      29001    n/a               Down  CP   L3 [--]                 

lfsw03# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.3, local AS number 65001
BGP table version is 545, L2VPN EVPN config peers 2, capable peers 2
51 network entries and 89 paths using 16260 bytes of memory
BGP attribute entries [82/30176], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [4/16]

Neighbor        V    AS    MsgRcvd    MsgSent   TblVer  InQ OutQ Up/Down  State/PfxRcd
10.0.0.253      4 65001        402        138      545    0    0 02:08:49 26        
10.0.0.254      4 65001        390        126      545    0    0 01:56:15 26        

Neighbor        T    AS PfxRcd     Type-2     Type-3     Type-4     Type-5     Type-12   
10.0.0.253      I 65001 26         16         6          0          4          0         
10.0.0.254      I 65001 26         16         6          0          4          0         
lfsw03# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 545, Local Router ID is 10.0.0.3
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.0.0.1:4
* i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.1                 0        100          0 ?
*>i                   10.0.1.1                 0        100          0 ?
* i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.1                 0        100          0 ?
*>i                   10.0.1.1                 0        100          0 ?

Route Distinguisher: 10.0.0.1:32867
* i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.1:32868
* i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.1:32967
* i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[32]:[172.17.0.1]/272
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.2:4
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
* i                   10.0.2.1                          100          0 i
*>i[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.2                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?
*>i[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.2                 0        100          0 ?
* i                   10.0.1.2                 0        100          0 ?

Route Distinguisher: 10.0.0.2:32867
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
* i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
*>i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
* i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.2:32868
* i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.2:32967
* i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
*>i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[32]:[172.17.0.1]/272
                      10.0.2.1                          100          0 i
* i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.3:32777    (L2VNI 10100)
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>l[2]:[0]:[0]:[48]:[5254.0067.2e0c]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100      32768 i
*>i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
*>l[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100      32768 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.3:32778    (L2VNI 10101)
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>l[2]:[0]:[0]:[48]:[5254.005a.4b65]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100      32768 i
*>i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>l[2]:[0]:[0]:[48]:[5254.005a.4b65]:[32]:[172.16.1.1]/272
                      10.0.1.3                          100      32768 i
*>l[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100      32768 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.3:32787    (L2VNI 20200)
* i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>l[2]:[0]:[0]:[48]:[5254.00ac.0b42]:[0]:[0.0.0.0]/216
                      10.0.1.3                          100      32768 i
*>i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i[2]:[0]:[0]:[48]:[2288.8db1.d09e]:[32]:[172.17.0.1]/272
                      10.0.2.1                          100          0 i
* i                   10.0.2.1                          100          0 i
*>l[3]:[0]:[32]:[10.0.1.3]/88
                      10.0.1.3                          100      32768 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.3:4    (L3VNI 19001)
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
* i[2]:[0]:[0]:[48]:[ea7e.beff.61a6]:[32]:[172.16.0.1]/272
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
*>l[5]:[0]:[0]:[24]:[172.16.0.0]/224
                      10.0.1.3                 0        100      32768 ?
* i                   10.0.1.2                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?
*>l[5]:[0]:[0]:[24]:[172.16.1.0]/224
                      10.0.1.3                 0        100      32768 ?
* i                   10.0.1.2                 0        100          0 ?
* i                   10.0.1.1                 0        100          0 ?

lfsw03# show l2route evpn mac all

Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan

(PipOrp): Directly connected Orphan to PIP based vPC BGW 
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Prod   Flags              Seq No     Next-Hops                              
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
10          5254.0067.2e0c Local  L,                 0          Eth1/1
10          ea7e.beff.61a6 BGP    SplRcv             0          10.0.2.1 (Label: 10100)
11          5254.005a.4b65 Local  L,                 0          Eth1/2
20          2288.8db1.d09e BGP    SplRcv             0          10.0.2.1 (Label: 20200)
20          5254.00ac.0b42 Local  L,                 0          Eth1/3
3001        0200.0a00.0201 VXLAN  Rmac,              0          10.0.2.1
3001        5222.d4f5.1b08 VXLAN  Rmac,              0          10.0.1.2
3001        52c7.4646.1b08 VXLAN  Rmac,              0          10.0.1.1
lfsw03# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW 
(Pipporp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Host IP                                 Prod   Flags              Seq No     Next-Hops                              
----------- -------------- --------------------------------------- ------ ----------------- ---------- ------------------------------------------------
---------
10          ea7e.beff.61a6 172.16.0.1                              BGP    --                 0         10.0.2.1 (Label: 10100)
11          5254.005a.4b65 172.16.1.1                              HMM    L,                 0         Local                                  
20          2288.8db1.d09e 172.17.0.1                              BGP    --                 0         10.0.2.1 (Label: 20200)
lfsw03# show vpc brief
                 ^
% Invalid command at '^' marker.
lfsw03# show ip route vrf all
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.0.0.1/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:56:52, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:54:20, ospf-1, intra
10.0.0.2/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:56:52, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:54:25, ospf-1, intra
10.0.0.3/32, ubest/mbest: 2/0, attached
    *via 10.0.0.3, Lo0, [0/0], 02:11:59, local
    *via 10.0.0.3, Lo0, [0/0], 02:11:59, direct
10.0.0.5/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:55:17, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:55:17, ospf-1, intra
10.0.0.253/32, ubest/mbest: 1/0
    *via 10.0.4.5, Eth1/47, [110/41], 02:10:07, ospf-1, intra
10.0.0.254/32, ubest/mbest: 1/0
    *via 10.0.3.5, Eth1/48, [110/41], 01:56:52, ospf-1, intra
10.0.1.1/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:56:52, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:54:20, ospf-1, intra
10.0.1.2/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:56:52, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:54:25, ospf-1, intra
10.0.1.3/32, ubest/mbest: 2/0, attached
    *via 10.0.1.3, Lo1, [0/0], 02:12:05, local
    *via 10.0.1.3, Lo1, [0/0], 02:12:05, direct
10.0.1.5/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:55:17, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:55:17, ospf-1, intra
10.0.2.1/32, ubest/mbest: 2/0
    *via 10.0.3.5, Eth1/48, [110/81], 01:56:52, ospf-1, intra
    *via 10.0.4.5, Eth1/47, [110/81], 01:54:25, ospf-1, intra
10.0.3.0/31, ubest/mbest: 1/0
    *via 10.0.3.5, Eth1/48, [110/80], 01:56:52, ospf-1, intra
10.0.3.2/31, ubest/mbest: 1/0
    *via 10.0.3.5, Eth1/48, [110/80], 01:56:52, ospf-1, intra
10.0.3.4/31, ubest/mbest: 1/0, attached
    *via 10.0.3.4, Eth1/48, [0/0], 02:10:29, direct
10.0.3.4/32, ubest/mbest: 1/0, attached
    *via 10.0.3.4, Eth1/48, [0/0], 02:10:29, local
10.0.3.8/31, ubest/mbest: 1/0
    *via 10.0.3.5, Eth1/48, [110/80], 01:56:52, ospf-1, intra
10.0.4.0/31, ubest/mbest: 1/0
    *via 10.0.4.5, Eth1/47, [110/80], 02:10:07, ospf-1, intra
10.0.4.2/31, ubest/mbest: 1/0
    *via 10.0.4.5, Eth1/47, [110/80], 02:10:07, ospf-1, intra
10.0.4.4/31, ubest/mbest: 1/0, attached
    *via 10.0.4.4, Eth1/47, [0/0], 02:10:29, direct
10.0.4.4/32, ubest/mbest: 1/0, attached
    *via 10.0.4.4, Eth1/47, [0/0], 02:10:29, local
10.0.4.8/31, ubest/mbest: 1/0
    *via 10.0.4.5, Eth1/47, [110/80], 02:10:07, ospf-1, intra

IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

0.0.0.0/0, ubest/mbest: 1/0
    *via 192.168.129.254, [1/0], 02:11:57, static
192.168.129.0/24, ubest/mbest: 1/0, attached
    *via 192.168.129.53, mgmt0, [0/0], 02:11:58, direct
192.168.129.53/32, ubest/mbest: 1/0, attached
    *via 192.168.129.53, mgmt0, [0/0], 02:11:58, local

IP Route Table for VRF "tenant1-vpc1"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.16.0.0/24, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan10, [0/0], 01:25:11, direct
172.16.0.1/32, ubest/mbest: 1/0
    *via 10.0.2.1%default, [200/0], 01:30:41, bgp-65001, internal, tag 65001, segid: 19001 tunnelid: 0xa000201 encap: VXLAN
 
172.16.0.254/32, ubest/mbest: 1/0, attached
    *via 172.16.0.254, Vlan10, [0/0], 01:25:11, local
172.16.1.0/24, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan11, [0/0], 01:25:11, direct
172.16.1.1/32, ubest/mbest: 1/0, attached
    *via 172.16.1.1, Vlan11, [190/0], 00:40:36, hmm
172.16.1.254/32, ubest/mbest: 1/0, attached
    *via 172.16.1.254, Vlan11, [0/0], 01:25:11, local

IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

　bdsw01 での出力結果　

bdsw01

bdsw01# show nve peers
Interface Peer-IP                                 State LearnType Uptime   Router-Mac       
--------- --------------------------------------  ----- --------- -------- -----------------
nve1      10.0.2.1                                Up    CP        01:56:05 n/a              

bdsw01# show nve vni
Codes: CP - Control Plane        DP - Data Plane          
       UC - Unconfigured         SA - Suppress ARP        
       S-ND - Suppress ND        
       SU - Suppress Unknown Unicast 
       Xconn - Crossconnect      
       MS-IR - Multisite Ingress Replication 
       HYB - Hybrid IRB mode
    
Interface VNI      Multicast-group   State Mode Type [BD/VRF]      Flags
--------- -------- ----------------- ----- ---- ------------------ -----
nve1      30300    UnicastBGP        Up    CP   L2 [300]                

bdsw01# show bgp l2vpn evpn summary
BGP summary information for VRF default, address family L2VPN EVPN
BGP router identifier 10.0.0.5, local AS number 65001
BGP table version is 59, L2VPN EVPN config peers 2, capable peers 2
12 network entries and 17 paths using 3696 bytes of memory
BGP attribute entries [14/5152], BGP AS path entries [0/0]
BGP community entries [0/0], BGP clusterlist entries [4/16]

Neighbor        V    AS    MsgRcvd    MsgSent   TblVer  InQ OutQ Up/Down  State/PfxRcd
10.0.0.253      4 65001        329        120       59    0    0 01:56:20 4         
10.0.0.254      4 65001        329        120       59    0    0 01:55:56 4         

Neighbor        T    AS PfxRcd     Type-2     Type-3     Type-4     Type-5     Type-12   
10.0.0.253      I 65001 4          2          2          0          0          0         
10.0.0.254      I 65001 4          2          2          0          0          0         
bdsw01# show bgp l2vpn evpn
BGP routing table information for VRF default, address family L2VPN EVPN
BGP table version is 59, Local Router ID is 10.0.0.5
Status: s-suppressed, x-deleted, S-stale, d-dampened, h-history, *-valid, >-best
Path type: i-internal, e-external, c-confed, l-local, a-aggregate, r-redist, I-injected
Origin codes: i - IGP, e - EGP, ? - incomplete, | - multipath, & - backup, 2 - best2

   Network            Next Hop            Metric     LocPrf     Weight Path
Route Distinguisher: 10.0.0.1:33768
* i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.2:33768
* i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

Route Distinguisher: 10.0.0.5:33067    (L2VNI 30300)
*>l[2]:[0]:[0]:[48]:[18c2.bf54.7c1f]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100      32768 i
*>l[2]:[0]:[0]:[48]:[3240.c812.699b]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100      32768 i
*>l[2]:[0]:[0]:[48]:[3e8c.cac2.5d08]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100      32768 i
*>i[2]:[0]:[0]:[48]:[5222.d4f5.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>i[2]:[0]:[0]:[48]:[52c7.4646.1b08]:[0]:[0.0.0.0]/216
                      10.0.2.1                          100          0 i
*>l[2]:[0]:[0]:[48]:[fcec.da7b.30d6]:[0]:[0.0.0.0]/216
                      10.0.1.5                          100      32768 i
*>l[3]:[0]:[32]:[10.0.1.5]/88
                      10.0.1.5                          100      32768 i
* i[3]:[0]:[32]:[10.0.2.1]/88
                      10.0.2.1                          100          0 i
*>i                   10.0.2.1                          100          0 i

bdsw01# show l2route evpn mac all

Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv (AD):Auto-Delete (D):Del Pending
(S):Stale (C):Clear, (Ps):Peer Sync (O):Re-Originated (Nho):NH-Override
(Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole, (Dum):Dummy
(Pf):Permanently-Frozen, (Orp): Orphan

(PipOrp): Directly connected Orphan to PIP based vPC BGW 
(PipPeerOrp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Prod   Flags              Seq No     Next-Hops                              
----------- -------------- ------ ------------------ ---------- ---------------------------------------------------------
300         18c2.bf54.7c1f Local  L,                 0          Eth1/1
300         3240.c812.699b Local  L,                 0          Eth1/1
300         3e8c.cac2.5d08 Local  L,                 0          Eth1/1
300         fcec.da7b.30d6 Local  L,                 0          Eth1/1
bdsw01# show l2route evpn mac-ip all
Flags -(Rmac):Router MAC (Stt):Static (L):Local (R):Remote 
(Dup):Duplicate (Spl):Split (Rcv):Recv(D):Del Pending (S):Stale (C):Clear
(Ps):Peer Sync (Ro):Re-Originated (Orp):Orphan (Asy):Asymmetric (Gw):Gateway
(Bh):Blackhole
(Piporp): Directly connected Orphan to PIP based vPC BGW 
(Pipporp): Orphan connected to peer of PIP based vPC BGW 
Topology    Mac Address    Host IP                                 Prod   Flags              Seq No     Next-Hops                              
----------- -------------- --------------------------------------- ------ ----------------- ---------- ------------------------------------------------
---------
bdsw01# show vpc brief
                 ^
% Invalid command at '^' marker.
bdsw01# show ip route vrf all
IP Route Table for VRF "default"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

10.0.0.1/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:55:52, ospf-1, intra
10.0.0.2/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:55:57, ospf-1, intra
10.0.0.3/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:56:49, ospf-1, intra
10.0.0.5/32, ubest/mbest: 2/0, attached
    *via 10.0.0.5, Lo0, [0/0], 02:12:37, local
    *via 10.0.0.5, Lo0, [0/0], 02:12:37, direct
10.0.0.253/32, ubest/mbest: 1/0
    *via 10.0.4.9, Eth1/47, [110/41], 01:56:49, ospf-1, intra
10.0.0.254/32, ubest/mbest: 1/0
    *via 10.0.3.9, Eth1/48, [110/41], 01:56:49, ospf-1, intra
10.0.1.1/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:55:52, ospf-1, intra
10.0.1.2/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:55:57, ospf-1, intra
10.0.1.3/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:56:49, ospf-1, intra
10.0.1.5/32, ubest/mbest: 2/0, attached
    *via 10.0.1.5, Lo1, [0/0], 02:12:47, local
    *via 10.0.1.5, Lo1, [0/0], 02:12:47, direct
10.0.2.1/32, ubest/mbest: 2/0
    *via 10.0.3.9, Eth1/48, [110/81], 01:56:49, ospf-1, intra
    *via 10.0.4.9, Eth1/47, [110/81], 01:55:57, ospf-1, intra
10.0.3.0/31, ubest/mbest: 1/0
    *via 10.0.3.9, Eth1/48, [110/80], 01:56:49, ospf-1, intra
10.0.3.2/31, ubest/mbest: 1/0
    *via 10.0.3.9, Eth1/48, [110/80], 01:56:49, ospf-1, intra
10.0.3.4/31, ubest/mbest: 1/0
    *via 10.0.3.9, Eth1/48, [110/80], 01:56:49, ospf-1, intra
10.0.3.8/31, ubest/mbest: 1/0, attached
    *via 10.0.3.8, Eth1/48, [0/0], 02:11:24, direct
10.0.3.8/32, ubest/mbest: 1/0, attached
    *via 10.0.3.8, Eth1/48, [0/0], 02:11:24, local
10.0.4.0/31, ubest/mbest: 1/0
    *via 10.0.4.9, Eth1/47, [110/80], 01:56:49, ospf-1, intra
10.0.4.2/31, ubest/mbest: 1/0
    *via 10.0.4.9, Eth1/47, [110/80], 01:56:49, ospf-1, intra
10.0.4.4/31, ubest/mbest: 1/0
    *via 10.0.4.9, Eth1/47, [110/80], 01:56:49, ospf-1, intra
10.0.4.8/31, ubest/mbest: 1/0, attached
    *via 10.0.4.8, Eth1/47, [0/0], 02:11:24, direct
10.0.4.8/32, ubest/mbest: 1/0, attached
    *via 10.0.4.8, Eth1/47, [0/0], 02:11:24, local

IP Route Table for VRF "management"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

0.0.0.0/0, ubest/mbest: 1/0
    *via 192.168.129.254, [1/0], 02:12:41, static
192.168.129.0/24, ubest/mbest: 1/0, attached
    *via 192.168.129.55, mgmt0, [0/0], 02:12:42, direct
192.168.129.55/32, ubest/mbest: 1/0, attached
    *via 192.168.129.55, mgmt0, [0/0], 02:12:42, local

IP Route Table for VRF "egress-loadbalance-resolution-"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

各サーバから Ping での疎通確認を実施

tenant1-server01 から tenant1 内のサーバへは Ping 返答あり、別 Tenant サーバとは疎通ができないことを確認

tenant2-server01 から tenant2 内のサーバへは Ping 返答あり、別 Tenant サーバとは疎通ができないことを確認

tenant3-server01 から CML の外にある Gateway へのサーバ Ping 応答があること、Gateway を使用した外部へのアクセスが可能なことを確認

CML の外にあるサーバから tenant3 のサーバに SSH 接続をしてログインできることを確認

おわりに

CML を使用して EVPN-VXLAN の構成をまずは試せた

お試しで軽く作った感じなので、詳細設計などを詰めてもう少しちゃんとしたものを作る予定 (誤記や誤りがある可能性ありのため注意)

リソース状況が厳しいが、今後設定ツールお試し(ansible や terraform など) や Cisco 以外のノード連携(参考)などいろいろ確認していく予定 (そのために mgmt0 は外部ネットワークに接続した)

メモリ 96GB (CML への割り当ては 92GB) でこのリソース使用率は自宅ラボでやるには厳しさを感じてならない

参考

EVPN VXLAN

CML Server LACP

vPC

cml-community