Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

stale entries not getting removed on ACL table 212 and 242 on RC3 Nitrogen build

Description

Description:

stale entries not getting removed on ACL table 212 and 242 on RC3 Nitrogen build

Steps:

1. Create Network,subnet,port,router and do and basic testing.
2. Remove all network,subnet,port and router and check all stale entries removed.

Result:

Stale entries not removed properly.

Logs:

Devstack Output:

stack@rajarajan-14:~$ neutron net-list

stack@rajarajan-14:~$ neutron subnet-list

stack@rajarajan-14:~$ neutron port-list

stack@rajarajan-14:~$ neutron router-list

stack@rajarajan-14:~$

Observation:

stack@rajarajan-14:~$ sudo ovs-ofctl dump-flows br-int -OOpenflow13
OFPST_FLOW reply (OF1.3) (xid=0x2):
cookie=0x8000001, duration=74237.528s, table=0, n_packets=101273, n_bytes=7434657, priority=5,in_port=1 actions=write_metadata:0x10000000001/0xfffff0000000001,goto_table:36
cookie=0x8000000, duration=74389.606s, table=17, n_packets=12, n_bytes=1020, priority=0,metadata=0x8000000000000000/0xf000000000000000 actions=write_metadata:0x9000000000000000/0xf000000000000000,goto_table:80
cookie=0x6800000, duration=74389.576s, table=18, n_packets=0, n_bytes=0, priority=0 actions=goto_table:38
cookie=0x8220016, duration=74389.534s, table=19, n_packets=0, n_bytes=0, priority=100,arp,arp_op=2 actions=resubmit(,17)
cookie=0x8220015, duration=74389.534s, table=19, n_packets=0, n_bytes=0, priority=100,arp,arp_op=1 actions=resubmit(,17)
cookie=0x1080000, duration=74389.534s, table=19, n_packets=746, n_bytes=88268, priority=0 actions=resubmit(,17)
cookie=0x1030000, duration=74389.534s, table=20, n_packets=0, n_bytes=0, priority=0 actions=goto_table:80
cookie=0x8000004, duration=74389.550s, table=22, n_packets=0, n_bytes=0, priority=0 actions=CONTROLLER:65535
cookie=0x1080000, duration=74389.550s, table=23, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x822002d, duration=74388.912s, table=43, n_packets=0, n_bytes=0, priority=100,arp,arp_op=1 actions=group:5000
cookie=0x822002e, duration=74388.912s, table=43, n_packets=0, n_bytes=0, priority=100,arp,arp_op=2 actions=CONTROLLER:65535,resubmit(,48)
cookie=0x8220000, duration=74389.281s, table=43, n_packets=758, n_bytes=89788, priority=0 actions=goto_table:48
cookie=0x4000000, duration=74389.576s, table=45, n_packets=1604, n_bytes=189220, priority=0 actions=resubmit(,17)
cookie=0x8500000, duration=74389.491s, table=48, n_packets=758, n_bytes=89788, priority=0 actions=resubmit(,49),resubmit(,50)
cookie=0x8050001, duration=74389.333s, table=50, n_packets=0, n_bytes=0, priority=10,reg4=0x1 actions=goto_table:51
cookie=0x8050000, duration=74389.491s, table=50, n_packets=0, n_bytes=0, priority=0 actions=CONTROLLER:65535,learn(table=49,hard_timeout=10,priority=0,cookie=0x8600000,NXM_OF_ETH_SRC[],NXM_NX_REG1[0..19],load:0x1->NXM_NX_REG4[0..7]),goto_table:51
cookie=0x8030000, duration=74389.281s, table=51, n_packets=0, n_bytes=0, priority=15,dl_dst=01:80:c2:00:00:00/ff:ff:ff:ff:ff:f0 actions=drop
cookie=0x8030000, duration=74389.281s, table=51, n_packets=41, n_bytes=7614, priority=0 actions=goto_table:52
cookie=0x6800000, duration=74389.576s, table=60, n_packets=3, n_bytes=226, priority=0 actions=resubmit(,17)
cookie=0x1030000, duration=74389.534s, table=80, n_packets=12, n_bytes=1020, priority=0 actions=resubmit(,17)
cookie=0x8220000, duration=74389.281s, table=81, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x4000001, duration=74389.576s, table=90, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,17)
cookie=0x6900000, duration=74389.281s, table=211, n_packets=0, n_bytes=0, priority=63009,arp actions=drop
cookie=0x6900000, duration=74389.281s, table=211, n_packets=0, n_bytes=0, priority=61009,ip actions=drop
cookie=0x6900000, duration=74389.281s, table=211, n_packets=4, n_bytes=360, priority=61009,ipv6 actions=drop
cookie=0x6900000, duration=74389.606s, table=211, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x6900000, duration=2813.044s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x138b000000/0xffff000000,ipv6_dst=2001:db8:1234:0:f816:3eff:fe7b:e8d actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2812.967s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x138b000000/0xffff000000,ipv6_dst=fe80::f816:3eff:fe7b:e8d actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2806.110s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=2001:db8:1234:0:f816:3eff:fe1d:5c66 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2806.060s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=fe80::f816:3eff:fe1d:5c66 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2805.992s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=fe80::f816:3eff:fe95:ec38 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2805.892s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=2001:db8:5678:0:f816:3eff:fe95:ec38 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2805.801s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=2001:db8:1234:0:f816:3eff:fe1e:5922 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2805.750s, table=212, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_dst=fe80::f816:3eff:fe1e:5922 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=2805.842s, table=212, n_packets=0, n_bytes=0, priority=50,ip,metadata=0x30d48/0xfffffe,nw_dst=10.1.1.11 actions=write_metadata:0x2/0xfffffe,goto_table:213
cookie=0x6900000, duration=74389.606s, table=212, n_packets=5, n_bytes=478, priority=0 actions=goto_table:213
cookie=0x6900000, duration=74389.281s, table=213, n_packets=1530, n_bytes=180540, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,17)
cookie=0x6900000, duration=74389.281s, table=213, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,17)
cookie=0x6900000, duration=74389.606s, table=213, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x8000230, duration=74236.746s, table=220, n_packets=1572, n_bytes=185424, priority=6,reg6=0x100 actions=load:0x90000100->NXM_NX_REG6[],write_metadata:0/0xfffffffffe,goto_table:230
cookie=0x8000007, duration=74236.746s, table=220, n_packets=1572, n_bytes=185424, priority=9,reg6=0x90000100 actions=output:1
cookie=0x8000230, duration=74389.576s, table=230, n_packets=1572, n_bytes=185424, priority=0 actions=resubmit(,220)
cookie=0x8000231, duration=74389.576s, table=231, n_packets=0, n_bytes=0, priority=0 actions=resubmit(,220)
cookie=0x6900000, duration=74389.227s, table=239, n_packets=0, n_bytes=0, priority=62020,ct_state=+trk,ip actions=ct(table=241)
cookie=0x6900000, duration=74389.227s, table=239, n_packets=2, n_bytes=236, priority=62020,ct_state=+trk,ipv6 actions=ct(table=241)
cookie=0x6900000, duration=74389.227s, table=239, n_packets=1585, n_bytes=187182, priority=61010 actions=goto_table:241
cookie=0x6900000, duration=74389.281s, table=241, n_packets=8, n_bytes=2656, priority=61010,ip,dl_dst=ff:ff:ff:ff:ff:ff,nw_dst=255.255.255.255 actions=goto_table:242
cookie=0x6900000, duration=74389.281s, table=241, n_packets=0, n_bytes=0, priority=61005,dl_dst=ff:ff:ff:ff:ff:ff actions=resubmit(,220)
cookie=0x6900000, duration=74389.281s, table=241, n_packets=0, n_bytes=0, priority=0 actions=drop
cookie=0x6900000, duration=74158.836s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x1389000000/0xffff000000,ipv6_src=2001:db8:1234:0:f816:3eff:feb8:69be actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=74158.736s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x1389000000/0xffff000000,ipv6_src=fe80::f816:3eff:feb8:69be actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2813.193s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x138b000000/0xffff000000,ipv6_src=2001:db8:1234:0:f816:3eff:fe7b:e8d actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2813.110s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x138b000000/0xffff000000,ipv6_src=fe80::f816:3eff:fe7b:e8d actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2807.371s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=2001:db8:1234:0:f816:3eff:fe1d:5c66 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2807.151s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=fe80::f816:3eff:fe1d:5c66 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2806.763s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=fe80::f816:3eff:fe95:ec38 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2806.579s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=2001:db8:5678:0:f816:3eff:fe95:ec38 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2806.419s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=2001:db8:1234:0:f816:3eff:fe1e:5922 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2806.361s, table=242, n_packets=0, n_bytes=0, priority=50,ipv6,metadata=0x30d48/0xfffffe,ipv6_src=fe80::f816:3eff:fe1e:5922 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=2806.478s, table=242, n_packets=0, n_bytes=0, priority=50,ip,metadata=0x30d48/0xfffffe,nw_src=10.1.1.11 actions=write_metadata:0x2/0xfffffe,goto_table:243
cookie=0x6900000, duration=74389.281s, table=242, n_packets=8, n_bytes=2656, priority=0 actions=goto_table:243
cookie=0x6900000, duration=74389.281s, table=243, n_packets=1536, n_bytes=181248, priority=62020,ct_state=-new+est-rel-inv+trk actions=resubmit(,220)
cookie=0x6900000, duration=74389.281s, table=243, n_packets=0, n_bytes=0, priority=62020,ct_state=-new-est+rel-inv+trk actions=resubmit(,220)
cookie=0x6900000, duration=74389.281s, table=243, n_packets=8, n_bytes=2656, priority=0 actions=drop

Environment

Operating System: All
Platform: All

Attachments

1
  • 13 Sep 2017, 08:21 AM

Activity

Show:

Former user October 5, 2017 at 12:08 AM

Hi,
I couldn't reproduce the issue described in this bug using the latest stable/nitrogen build. (I cloned the distribution git and did a local build from there)

Could you please try to reproduce the issue with:

1) The latest stable/nitrogen
2) Turn off the DEBUG/TRACE for karaf log. The attached karaf logs are not completed for debugging purpose since too much info from TRACE/DEBUG level causes the log to rotate out the earlier log messages.
3) Capture the flow entries for each step, ie create Network, subnet, port, VMs, router, and the reversed steps. I would like to make sure that the slale flows doesn't belong to the deleted VMs.

Many Thanks,
Vinh

RajaRajan September 13, 2017 at 6:41 PM
Edited

Hi,

This issue is always reproducible. All required dumps and flows was attached with previous logs.

Steps Followed:

neutron net-create mynet1

neutron subnet-create mynet1 2001:db8:1234::/64 --ip-version 6 --ipv6-ra-mode slaac --ipv6-address-mode slaac --name net1-snet2
neutron port-create mynet1 --name myport12
neutron port-create mynet1 --name myport22
nova boot --image cirros-0.3.4-x86_64-uec --flavor myhuge --nic port-id=$(neutron port-list | grep 'myport12' | awk '{print $2}') myhost12 --availability-zone nova:rajarajan-14
nova boot --image cirros-0.3.4-x86_64-uec --flavor myhuge --nic port-id=$(neutron port-list | grep 'myport22' | awk '{print $2}') myhost22 --availability-zone nova:rajarajan-15
neutron router-create R1
neutron router-interface-add R1 net1-snet2

After above steps, validate data path and now cleanup all configuration using below steps.

Delete VM's
Delete Ports
delete interface from router
delete router
delete subnet
delete network
check flows whether all configuration removed.

Answers for your queries below.

1) VM or neutron port details - Steps mentioned above.
2) Any config done on port like AAP (allowed-addr-pair) - No
3) Network and subnet details to which VMs were associated - Steps mentioned above.

TARUN THAKUR September 13, 2017 at 3:47 PM

Information is insufficient.

Please provide below details:
1) VM or neutron port details
2) Any config done on port like AAP (allowed-addr-pair)
3) Network and subnet details to which VMs were associated

RajaRajan September 13, 2017 at 8:21 AM
Edited

Attachment logs.tar.gz has been added with description: Logs attached

Duplicate

Details

Assignee

Reporter

External issue ID

Priority (migrated 2)

High

Components

Affects versions

Priority

Created September 13, 2017 at 8:21 AM
Updated July 3, 2018 at 7:38 PM
Resolved July 3, 2018 at 7:38 PM
Configure