When this was activated the secondary WAN showed the CARP to be MASTER with the CARP
address. So did the primary.
When we unplugged the primary, traffic did not fall over to backup.
pfSense box 1:
BGP configuration:
ASN: 10753
Holdtime: 90
Fib-update: Yes
Listen on IP: 4.15.227.2
Router IP: 4.15.227.3
CARP Status IP: 10.150.0.10
Networks: 4.15.227.0/25
pfSense box 2:
BGP configuration:
ASN: 10753
Holdtime: 90
Fib-update: Yes
Listen on IP: 4.15.227.2
Router IP: 4.16.216.134
CARP Status IP: 10.150.0.10
Networks: 4.15.227.0/25
I added no neighbors or groups.
Output from Status on pfSense box 1:
OpenBGPD Summary
Neighbor
State/PrfRcvd
AS
MsgRcvd
MsgSent
OutQ Up/Down
OpenBGPD Interfaces
Interface
ovpns3
ovpns4
ovpns2
ovpns1
enc0
lo0
pfsync0
pflog0
igb5
igb4
igb3
Nexthop state
ok
ok
ok
ok
invalid
ok
ok
invalid
ok
ok
ok
Flags
UP
UP
UP
UP
UP
UP
UP
UP
UP
Link state
active
active
active
active
invalid
invalid
invalid
invalid
Ethernet, active, 1000 MBit/s
Ethernet, active, 1000 MBit/s
Ethernet, active, 1000 MBit/s
igb2
igb1
igb0
ok
invalid
ok
UP
Ethernet, active, 1000 MBit/s
Ethernet, invalid, 10 MBit/s
Ethernet, active, 1000 MBit/s
UP
OpenBGPD Routing
flags: * = Valid, > = Selected, I = via IBGP, A = Announced, S = Stale
origin: i = IGP, e = EGP, ? = Incomplete
flags destination
AI*> 4.15.227.0/25
gateway
0.0.0.0
lpref
100
OpenBGPD Forwarding
flags: * = valid, B = BGP, C = Connected, S = Static
N = BGP Nexthop reachable via this route
r = reject route, b = blackhole route
flags prio destination
*S
48 0.0.0.0/0
*C
48 4.15.227.0/25
*C
48 4.15.227.2/32
*C
48 4.15.227.3/32
*C
48 4.15.227.16/32
*C
48 4.15.227.17/32
*C
48 4.15.227.60/32
*C
48 4.15.227.61/32
*C
48 4.15.227.63/32
*C
48 4.15.227.73/32
*C
48 4.15.227.74/32
*C
48 4.15.227.75/32
*C
48 4.15.227.80/32
*C
48 4.15.227.81/32
*C
48 4.15.227.82/32
*C
48 4.15.227.84/32
*C
48 4.15.227.87/32
*C
48 4.15.227.88/32
*C
48 4.15.227.89/32
*C
48 4.15.227.90/32
*C
48 4.15.227.91/32
*C
48 4.15.227.92/32
*C
48 4.15.227.93/32
*C
48 4.15.227.94/32
*C
48 4.15.227.95/32
*C
48 4.15.227.96/32
*C
48 4.15.227.97/32
*C
48 4.15.227.98/32
*C
48 4.15.227.99/32
*C
48 4.15.227.100/32
*C
48 4.15.227.101/32
*C
48 4.15.227.102/32
*C
48 4.15.227.103/32
*C
48 4.15.227.104/32
*C
48 4.15.227.105/32
*C
48 4.15.227.106/32
*C
48 4.15.227.107/32
*C
48 4.15.227.108/32
*C
48 4.15.227.109/32
gateway
4.15.227.1
link#3
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
med aspath origin
0 i
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*S
*C
*C
*S
*S
*S
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*
*
*
*
*
*
48
48
48
48
48
48
48
48
48
48
48
48
0
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
0
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
4.15.227.110/32
link#9
4.15.227.111/32
link#9
4.15.227.112/32
link#9
4.15.227.113/32
link#9
4.15.227.115/32
link#9
4.15.227.116/32
link#9
4.15.227.120/32
link#9
10.20.201.0/24
link#6
10.20.201.1/32
link#9
10.20.201.2/32
link#9
10.150.0.0/24
link#1
10.150.0.10/32
link#9
127.0.0.0/8
link#0
127.0.0.1/32
link#9
172.31.55.1/32
link#9
172.31.55.2/32
link#12
172.31.57.1/32
link#9
172.31.57.2/32
link#13
172.31.58.1/32
link#9
172.31.58.2/32
link#14
192.168.20.0/24
link#5
192.168.20.1/32
link#9
192.168.20.2/32
link#9
192.168.30.0/24
link#4
192.168.30.1/32
link#9
192.168.30.2/32
link#9
192.168.31.0/24
192.168.31.2
192.168.31.1/32
link#9
192.168.31.2/32
link#11
192.168.50.0/24
172.31.58.2
192.168.100.0/24
172.31.55.2
192.168.110.0/24
172.31.57.2
::1/128
link#0
::1/128
link#9
fe80::/64
link#1
fe80::/64
link#3
fe80::/64
link#4
fe80::/64
link#5
fe80::/64
link#6
fe80::/64
link#9
fe80::1/128
link#9
fe80::2a0:d1ff:feea:dee8/64 link#13
fe80::2a0:d1ff:feea:dee8/128 link#9
fe80::2a0:d1ff:feea:dee8/128 link#9
fe80::2a0:d1ff:feea:dee8/128 link#9
fe80::2a0:d1ff:feea:dee8/128 link#9
fe80::2a0:d1ff:feea:dee8/128 link#9
fe80::a236:9fff:fe02:64b8/128 link#9
fe80::a236:9fff:fe02:64b9/128 link#9
fe80::a236:9fff:fe02:64ba/128 link#9
fe80::a236:9fff:fe02:64bb/128 link#9
ff01::/32
fe80::2a0:d1ff:feea:dee8
ff01::/32
fe80::a236:9fff:fe02:64b8
ff01::/32
fe80::a236:9fff:fe02:64b9
ff01::/32
fe80::a236:9fff:fe02:64ba
ff01::/32
fe80::a236:9fff:fe02:64bb
ff01::/32
::1
*
*
*
*
48
48
48
48
ff01::/32
ff01::/32
ff01::/32
ff01::/32
fe80::2a0:d1ff:feea:dee8
fe80::2a0:d1ff:feea:dee8
fe80::2a0:d1ff:feea:dee8
fe80::2a0:d1ff:feea:dee8
OpenBGPD Network
flags: S = Static
flags destination
*S
0 4.15.227.0/25
0.0.0.0
Flags: * = nexthop valid
Nexthop
Route
Prio Gateway
Iface
OpenBGPD IP
flags: * = Valid, > = Selected, I = via IBGP, A = Announced, S = Stale
origin: i = IGP, e = EGP, ? = Incomplete
flags destination
AI*> 4.15.227.0/25
gateway
0.0.0.0
lpref
100
med aspath origin
0 i
Output from Status on pfSense box 2.
OpenBGPD Summary
Neighbor
State/PrfRcvd
AS
MsgRcvd
MsgSent
OutQ Up/Down
OpenBGPD Interfaces
Interface
ovpns3
ovpns4
ovpns2
ovpns1
enc0
lo0
pfsync0
pflog0
igb5
igb4
igb3
igb2
igb1
igb0
Nexthop state
ok
ok
ok
ok
invalid
ok
ok
invalid
ok
ok
ok
ok
invalid
ok
Flags
UP
UP
UP
UP
UP
UP
UP
UP
UP
UP
UP
Link state
active
active
active
active
invalid
invalid
invalid
invalid
Ethernet, active, 1000 MBit/s
Ethernet, active, 1000 MBit/s
Ethernet, active, 1000 MBit/s
Ethernet, active, 100 MBit/s
Ethernet, invalid, 10 MBit/s
Ethernet, active, 1000 MBit/s
OpenBGPD Routing
flags: * = Valid, > = Selected, I = via IBGP, A = Announced, S = Stale
origin: i = IGP, e = EGP, ? = Incomplete
flags destination
AI*> 4.15.227.0/25
gateway
0.0.0.0
lpref
100
med aspath origin
0 i
OpenBGPD Forwarding
Display
of 113 items
Filter expression:
flags: * = valid, B = BGP, C = Connected, S = Static
N = BGP Nexthop reachable via this route
r = reject route, b = blackhole route
flags prio destination
*S
48 0.0.0.0/0
*C
48 4.15.227.0/25
*C
48 4.15.227.2/32
*C
48 4.15.227.4/32
*C
48 4.15.227.16/32
*C
48 4.15.227.17/32
*C
48 4.15.227.60/32
*C
48 4.15.227.61/32
*C
48 4.15.227.63/32
*C
48 4.15.227.73/32
*C
48 4.15.227.74/32
*C
48 4.15.227.75/32
*C
48 4.15.227.80/32
*C
48 4.15.227.81/32
*C
48 4.15.227.82/32
*C
48 4.15.227.84/32
*C
48 4.15.227.87/32
*C
48 4.15.227.88/32
*C
48 4.15.227.89/32
*C
48 4.15.227.90/32
*C
48 4.15.227.91/32
*C
48 4.15.227.92/32
*C
48 4.15.227.93/32
*C
48 4.15.227.94/32
*C
48 4.15.227.95/32
*C
48 4.15.227.96/32
*C
48 4.15.227.97/32
*C
48 4.15.227.98/32
*C
48 4.15.227.99/32
*C
48 4.15.227.100/32
*C
48 4.15.227.101/32
*C
48 4.15.227.102/32
*C
48 4.15.227.103/32
*C
48 4.15.227.104/32
*C
48 4.15.227.105/32
*C
48 4.15.227.106/32
*C
48 4.15.227.107/32
*C
48 4.15.227.108/32
*C
48 4.15.227.109/32
*C
48 4.15.227.110/32
*C
48 4.15.227.111/32
*C
48 4.15.227.112/32
*C
48 4.15.227.113/32
*C
48 4.15.227.115/32
*C
48 4.15.227.116/32
*C
48 4.15.227.120/32
gateway
4.16.216.133
link#3
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
link#9
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*S
*C
*C
*S
*S
*S
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*C
*
*
*
*
*
*
*
*
*
*
*
*
48
48
48
48
48
0
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
0
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
48
4.16.216.132/30
link#3
10.20.201.0/24
link#6
10.20.201.3/32
link#9
10.150.0.0/24
link#1
10.150.0.11/32
link#9
127.0.0.0/8
link#0
127.0.0.1/32
link#9
172.31.55.1/32
link#9
172.31.55.2/32
link#12
172.31.57.1/32
link#9
172.31.57.2/32
link#13
172.31.58.1/32
link#9
172.31.58.2/32
link#14
192.168.20.0/24
link#5
192.168.20.3/32
link#9
192.168.30.0/24
link#4
192.168.30.3/32
link#9
192.168.31.0/24
192.168.31.2
192.168.31.1/32
link#9
192.168.31.2/32
link#11
192.168.50.0/24
172.31.58.2
192.168.100.0/24
172.31.55.2
192.168.110.0/24
172.31.57.2
::1/128
link#0
::1/128
link#9
fe80::/64
link#1
fe80::/64
link#3
fe80::/64
link#4
fe80::/64
link#5
fe80::/64
link#6
fe80::/64
link#9
fe80::1/128
link#9
fe80::2a0:d1ff:fee9:d5f0/64 link#13
fe80::2a0:d1ff:fee9:d5f0/128 link#9
fe80::2a0:d1ff:fee9:d5f0/128 link#9
fe80::2a0:d1ff:fee9:d5f0/128 link#9
fe80::2a0:d1ff:fee9:d5f0/128 link#9
fe80::2a0:d1ff:fee9:d5f0/128 link#9
fe80::a236:9fff:fe04:b234/128 link#9
fe80::a236:9fff:fe04:b235/128 link#9
fe80::a236:9fff:fe04:b236/128 link#9
fe80::a236:9fff:fe04:b237/128 link#9
ff01::/32
fe80::2a0:d1ff:fee9:d5f0
ff01::/32
fe80::a236:9fff:fe04:b234
ff01::/32
fe80::a236:9fff:fe04:b235
ff01::/32
fe80::a236:9fff:fe04:b236
ff01::/32
fe80::a236:9fff:fe04:b237
ff01::/32
::1
ff01::/32
fe80::2a0:d1ff:fee9:d5f0
ff01::/32
fe80::2a0:d1ff:fee9:d5f0
ff01::/32
fe80::2a0:d1ff:fee9:d5f0
ff01::/32
fe80::2a0:d1ff:fee9:d5f0
ff02::/32
fe80::2a0:d1ff:fee9:d5f0
ff02::/32
fe80::a236:9fff:fe04:b234
OpenBGPD Network
flags: S = Static
flags destination
*S
0 4.15.227.0/25
0.0.0.0
Flags: * = nexthop valid
Nexthop
Route
Prio Gateway
Iface
OpenBGPD IP
flags: * = Valid, > = Selected, I = via IBGP, A = Announced, S = Stale
origin: i = IGP, e = EGP, ? = Incomplete
flags destination
AI*> 4.15.227.0/25
gateway
0.0.0.0
lpref
100
med aspath origin
0 i