| View previous topic :: View next topic |
| Author |
Message |
alessandro_corbelli83 Super User

Joined: 10 Apr 2008 Posts: 296
|
Posted: Sun May 3, 2009 5:13 am Post subject: Vyatta 4.X BGP Crash |
|
|
Hi all
With no apparent reason, bgp on 4 vyatta boxes is crashing from today.
When I reboot the machine, bgp start as expected, route are imported and after a while (2-3 minutes) it crash.
show ip bgp summary show nothing.
On the log i can't find something useful.
Any idea? |
|
| Back to top |
|
 |
vbilly Forum Newbie

Joined: 12 Aug 2008 Posts: 8
|
Posted: Sun May 3, 2009 5:21 am Post subject: |
|
|
We are having the exact same problem today.
Any ideas? |
|
| Back to top |
|
 |
lancey Active Member

Joined: 18 Jan 2009 Posts: 43
|
Posted: Sun May 3, 2009 5:31 am Post subject: |
|
|
I'm having the exact same problem today, with 5.0. It seems someone has distributed a route over BGP, which makes quagga's BGPd to crash.
The error message about this in the logs is:
| Code: |
May 3 16:17:41 border vyatta-bgpd[6709]: Assertion `len < str_size' failed in file bgp_aspath.c, line 615, function aspath_make_str_count
May 3 16:17:41 border vyatta-bgpd[6709]: Assertion `len < str_size' failed in file bgp_aspath.c, line 615, function aspath_make_str_count
May 3 16:17:41 border vyatta-bgpd[6709]: Backtrace for 14 stack frames:
May 3 16:17:41 border vyatta-bgpd[6709]: Backtrace for 14 stack frames:
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 0] /usr/lib/vyatta-quagga/libzebra.so.0(zlog_backtrace+0x1f) [0xb805a76a]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 0] /usr/lib/vyatta-quagga/libzebra.so.0(zlog_backtrace+0x1f) [0xb805a76a]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 1] /usr/lib/vyatta-quagga/libzebra.so.0(_zlog_assert_failed+0x99) [0xb805a8c7]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 1] /usr/lib/vyatta-quagga/libzebra.so.0(_zlog_assert_failed+0x99) [0xb805a8c7]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 2] /usr/sbin/vyatta-bgpd [0x80978c9]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 2] /usr/sbin/vyatta-bgpd [0x80978c9]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 3] /usr/sbin/vyatta-bgpd [0x8097902]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 3] /usr/sbin/vyatta-bgpd [0x8097902]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 4] /usr/sbin/vyatta-bgpd(aspath_key_make+0x17) [0x8097921]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 4] /usr/sbin/vyatta-bgpd(aspath_key_make+0x17) [0x8097921]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 5] /usr/lib/vyatta-quagga/libzebra.so.0(hash_get+0x1d) [0xb8052218]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 5] /usr/lib/vyatta-quagga/libzebra.so.0(hash_get+0x1d) [0xb8052218]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 6] /usr/sbin/vyatta-bgpd(aspath_parse+0x1a0) [0x8098a96]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 6] /usr/sbin/vyatta-bgpd(aspath_parse+0x1a0) [0x8098a96]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 7] /usr/sbin/vyatta-bgpd(bgp_attr_parse+0x2f3) [0x806a108]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 7] /usr/sbin/vyatta-bgpd(bgp_attr_parse+0x2f3) [0x806a108]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 8] /usr/sbin/vyatta-bgpd [0x807fe97]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 8] /usr/sbin/vyatta-bgpd [0x807fe97]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 9] /usr/sbin/vyatta-bgpd(bgp_read+0x32d) [0x8080e69]
May 3 16:17:41 border vyatta-bgpd[6709]: [bt 9] /usr/sbin/vyatta-bgpd(bgp_read+0x32d) [0x8080e69]
|
I'm now back with our good old (slow) OpenBSD router, and everything works okay.
If anyone comes up with exactly what's going on, please write here. I'm now also digging deeper into this, hope Paul & others from the Quagga dev team are around to help soon.[/code] |
|
| Back to top |
|
 |
HenrikH Forum Newbie

Joined: 16 Mar 2008 Posts: 13
|
Posted: Sun May 3, 2009 5:40 am Post subject: |
|
|
We are experincing the same problem with 2x Vyatta-routers. The output of "show ip bgp summary" and other commands of the same sort yield no output.
Unfortunately, I don't have anything else to add except that I have opened an after-hours support-case about this. |
|
| Back to top |
|
 |
lancey Active Member

Joined: 18 Jan 2009 Posts: 43
|
Posted: Sun May 3, 2009 5:42 am Post subject: |
|
|
| Some guys just confirmed the problem is the same with a standalone quagga 0.99.10 install. |
|
| Back to top |
|
 |
alessandro_corbelli83 Super User

Joined: 10 Apr 2008 Posts: 296
|
Posted: Sun May 3, 2009 5:53 am Post subject: |
|
|
| how can i restart bgp with no reboot and how can i add bgp debugging on every boot? |
|
| Back to top |
|
 |
Rob_T Forum Newbie

Joined: 03 May 2009 Posts: 3
|
|
| Back to top |
|
 |
Rob_T Forum Newbie

Joined: 03 May 2009 Posts: 3
|
|
| Back to top |
|
 |
lancey Active Member

Joined: 18 Jan 2009 Posts: 43
|
Posted: Sun May 3, 2009 6:08 am Post subject: |
|
|
| There is a patch now in quagga's git. |
|
| Back to top |
|
 |
lancey Active Member

Joined: 18 Jan 2009 Posts: 43
|
|
| Back to top |
|
 |
HenrikH Forum Newbie

Joined: 16 Mar 2008 Posts: 13
|
Posted: Sun May 3, 2009 6:37 am Post subject: |
|
|
There is also a Vyatta-provided patch out there: Vyatta Premium support were very quick to supply me with a patch for this that they have developed a couple of days ago. Subscription-customers should have received a mail with information on applying the patch (which is a related to quagga + certain 32-bit ASNs)
As I understand it, behind-the-scenes work is being done to get clearance to release this patch to community-users too. |
|
| Back to top |
|
 |
wdingus Forum Newbie

Joined: 02 Jul 2008 Posts: 7
|
Posted: Sun May 3, 2009 6:44 am Post subject: |
|
|
Community edition or subscription? We have a subscription edition install and got this email alert a few days ago:
Vyatta Security Bulletin VSB-09-001
This is an important security bulletin concerning Vyatta software. Please review carefully and contact Vyatta technical support if you need assistance.
Summary:
Vyatta's BGP process will go down if it receives a route update containing a path with more than four 32-bit AS numbers.
..snip..
We also have another router with community edition Vyatta (doing BGP) and it is experiencing the same described problem as of about 8AM this morning. Any word on a patch for it? |
|
| Back to top |
|
 |
lancey Active Member

Joined: 18 Jan 2009 Posts: 43
|
Posted: Sun May 3, 2009 7:01 am Post subject: |
|
|
The offending path is coming from AS37095:
flags destination gateway lpref med aspath origin
*> 196.200.208.0/20 88.203.200.129 250 0 8717 1299 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i
* 196.200.208.0/20 213.16.53.189 200 0 8866 9050 3356 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i
* 196.200.208.0/20 62.204.150.21 100 0 8717 1299 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i
Rejecting it with a route-map doesn't help, though. BGPd crashes when it receives it, wherever it has to use it or no doesn't make any difference. |
|
| Back to top |
|
 |
Rob_T Forum Newbie

Joined: 03 May 2009 Posts: 3
|
Posted: Sun May 3, 2009 7:07 am Post subject: |
|
|
| You could perhaps ask your upstream(s) to filter that AS from the routes you are being sent using a route map or prefix list or something. Since your router wouldn't see that AS at all, it should resolve the issue. |
|
| Back to top |
|
 |
jfletcher Vyatta Employee

Joined: 26 Feb 2008 Posts: 684
|
Posted: Sun May 3, 2009 7:08 am Post subject: Vyatta 4.X BGP Crash |
|
|
On Sun, May 3, 2009 at 6:13 AM, alessandro_corbelli83
<forum-users@vyatta.com> wrote:
| Quote: | Hi all
With no apparent reason, bgp on 4 vyatta boxes is crashing from today.
When I reboot the machine, bgp start as expected, route are imported and after a while (2-3 minutes) it crash.
show ip bgp summary show nothing.
On the log i can't find something useful.
Any idea?
|
You'll find the corresponding Vyatta bug at
https://bugzilla.vyatta.com/show_bug.cgi?id=4328 .
Best,
Justin |
|
| Back to top |
|
 |
|