概要

GNS3でNexus9000vを使ってEVPN/VXLAN Anycast Gatewayを設定する。

L3VNI とは、VXLAN において prefix の広報を実現するために使用されます。これにより、VXLAN fabric 外の経路情報を広報することや、VXLAN domain 間の routing が可能となります。
Cisco Community | Cisco Nexus シリーズ : VXLAN EVPN L3VNI 基本設定

物理

論理

設定

Leaf01にはL2VNIとして10011と10033、Leaf03にはL2VNIとして10011と10022を持たせて、それぞれにL3VNIとして100500を設定する。

Leaf01 Overlay

Leaf03 Overlay

動作確認

Anycast Gateway

vm01のARPテーブルを見ると、Leaf01/Leaf02でvlan11 SVIに設定したanycast-gateway-macである2020.0000.00aaが見える。

[rocky@vm01 ~]$ ip neigh
172.16.11.254 dev eth1 lladdr 20:20:00:00:00:aa STALE
172.16.11.3 dev eth1 lladdr 52:54:00:e2:32:bb STALE

同じくvm02のARPテーブルを見ると、vlan33 SVIに設定したanycast-gateway-macである2020.0000.00aaが見える。

[rocky@vm02 ~]$ ip neigh
172.16.33.254 dev eth1 lladdr 20:20:00:00:00:aa STALE

同じくvm03でも、anycast-gateway-macである2020.0000.00aaが見える。

[rocky@vm03 ~]$ ip neigh
172.16.11.1 dev eth1 lladdr 52:54:00:74:fc:98 STALE
172.16.11.254 dev eth1 lladdr 20:20:00:00:00:aa STALE

Leafを跨ぐ同一vlan通信（vm01→vm03）

@Leaf01/02
vm03のMACアドレス（5254.00e2.32bb）がMACアドレステーブルに登録されている

leaf01# sh mac address-table interface nve1

   VNI      MAC Address      Type      age     Secure NTFY Ports
---------+-----------------+--------+---------+------+----+------------------
C   11     0cfb.3278.0000   dynamic  0         F      F    nve1(3.3.3.3)
C   11     5254.00e2.32bb   dynamic  0         F      F    nve1(3.3.3.3)
*  500     0c42.0000.1b08   static   -         F      F    nve1(3.3.3.3)

vm03のMACアドレス（5254.00e2.32bb）に関するL2VPN経路

leaf01# show bgp l2vpn evpn 5254.00e2.32bb
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 1.1.1.1:32778    (L2VNI 10011)
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00e2.32bb]:[0]:[0.0.0.0]/216, version 736
Paths: (1 available, best #1)
Flags: (0x000212) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop, in rib
             Imported from 3.3.3.3:32778:[2]:[0]:[0]:[48]:[5254.00e2.32bb]:[0]:[0.0.0.0]/216
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10011
      Extcommunity: RT:65001:10011 ENCAP:8
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00e2.32bb]:[32]:[172.16.11.3]/272, version 37
Paths: (1 available, best #1)
Flags: (0x000212) (high32 00000000) on xmit-list, is in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop, in rib
             Imported from 3.3.3.3:32778:[2]:[0]:[0]:[48]:[5254.00e2.32bb]:[32]:[172.16.11.3]/272
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10011 10500
      Extcommunity: RT:65001:10011 RT:65001:10500 ENCAP:8 Router MAC:0c42.0000.1b08
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer

Route Distinguisher: 3.3.3.3:32778
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00e2.32bb]:[0]:[0.0.0.0]/216, version 735
Paths: (1 available, best #1)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop
             Imported to 1 destination(s)
             Imported paths list: L2-10011
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10011
      Extcommunity: RT:65001:10011 ENCAP:8
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00e2.32bb]:[32]:[172.16.11.3]/272, version 36
Paths: (1 available, best #1)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop
             Imported to 3 destination(s)
             Imported paths list: VRF-001 L3-10500 L2-10011
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10011 10500
      Extcommunity: RT:65001:10011 RT:65001:10500 ENCAP:8 Router MAC:0c42.0000.1b08
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer

Route Distinguisher: 1.1.1.1:3    (L3VNI 10500)
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00e2.32bb]:[32]:[172.16.11.3]/272, version 38
Paths: (1 available, best #1)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop
             Imported from 3.3.3.3:32778:[2]:[0]:[0]:[48]:[5254.00e2.32bb]:[32]:[172.16.11.3]/272
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10011 10500
      Extcommunity: RT:65001:10011 RT:65001:10500 ENCAP:8 Router MAC:0c42.0000.1b08
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer

同一LeafのVLAN間通信（vm01→vm02）

@vm01
default routeを使用して172.16.11.254へ（Leaf01/02 SVI vlan11）

[rocky@vm01 ~]$ ip route
default via 172.16.11.254 dev eth1 proto static metric 100
172.16.11.0/24 dev eth1 proto kernel scope link src 172.16.11.1 metric 100

@Leaf01/02
Leaf01/02のARPテーブルのエントリにvm02の宛先が載っている

leaf01# show ip arp vrf VRF-001

Flags: * - Adjacencies learnt on non-active FHRP router
       + - Adjacencies synced via CFSoE
       # - Adjacencies Throttled for Glean
       CP - Added via L2RIB, Control plane Adjacencies
       PS - Added via L2RIB, Peer Sync
       RO - Re-Originated Peer Sync Entry
       D - Static Adjacencies attached to down interface

IP ARP Table for context VRF-001
Total number of entries: 2
Address         Age       MAC Address     Interface       Flags
172.16.11.1     00:13:03  5254.0074.fc98  Vlan11
172.16.33.2     00:13:09  5254.008c.dcdb  Vlan33          +

Leafを跨ぐvlan間通信（vm01→vm04）

@vm01
default routeを使用して172.16.11.254へ（Leaf01/02 SVI vlan11）

[rocky@vm01 ~]$ ip route
default via 172.16.11.254 dev eth1 proto static metric 100
172.16.11.0/24 dev eth1 proto kernel scope link src 172.16.11.1 metric 100

@Leaf01/02
Leaf01/02のルートテーブルのエントリにvm04の宛先が載っている

leaf01# sh ip route 172.16.22.4 vrf vrf-001
IP Route Table for VRF "VRF-001"
'*' denotes best ucast next-hop
'**' denotes best mcast next-hop
'[x/y]' denotes [preference/metric]
'%<string>' in via output denotes VRF <string>

172.16.22.4/32, ubest/mbest: 1/0
    *via 3.3.3.3%default, [200/0], 1d23h, bgp-65001, internal, tag 65001, segid: 10500 tunnelid: 0x3030303 encap: VXLAN

vm04に関するL2VPN経路

leaf01# show bgp l2vpn evpn 172.16.22.4
BGP routing table information for VRF default, address family L2VPN EVPN
Route Distinguisher: 3.3.3.3:32789
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00a4.fd92]:[32]:[172.16.22.4]/272, version 21
Paths: (1 available, best #1)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop
             Imported to 2 destination(s)
             Imported paths list: VRF-001 L3-10500
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10022 10500
      Extcommunity: RT:65001:10022 RT:65001:10500 ENCAP:8 Router MAC:0c42.0000.1b08
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer

Route Distinguisher: 1.1.1.1:3    (L3VNI 10500)
BGP routing table entry for [2]:[0]:[0]:[48]:[5254.00a4.fd92]:[32]:[172.16.22.4]/272, version 24
Paths: (1 available, best #1)
Flags: (0x000202) (high32 00000000) on xmit-list, is not in l2rib/evpn, is not in HW

  Advertised path-id 1
  Path type: internal, path is valid, is best path, no labeled nexthop
             Imported from 3.3.3.3:32789:[2]:[0]:[0]:[48]:[5254.00a4.fd92]:[32]:[172.16.22.4]/272
  AS-Path: NONE, path sourced internal to AS
    3.3.3.3 (metric 81) from 5.5.5.5 (5.5.5.5)
      Origin IGP, MED not set, localpref 100, weight 0
      Received label 10022 10500
      Extcommunity: RT:65001:10022 RT:65001:10500 ENCAP:8 Router MAC:0c42.0000.1b08
      Originator: 3.3.3.3 Cluster list: 0.0.0.1

  Path-id 1 not advertised to any peer