Forum SubscriptionsForum Subscriptions   FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
Vyatta 4.X BGP Crash
Goto page 1, 2, 3, 4, 5  Next
 
Post new topic   Reply to topic    Vyatta.org Forum Index -> Users
View previous topic :: View next topic  
Author Message
alessandro_corbelli83
Super User
Super User


Joined: 10 Apr 2008
Posts: 296

PostPosted: Sun May 3, 2009 5:13 am    Post subject: Vyatta 4.X BGP Crash Reply with quote

Hi all
With no apparent reason, bgp on 4 vyatta boxes is crashing from today.
When I reboot the machine, bgp start as expected, route are imported and after a while (2-3 minutes) it crash.

show ip bgp summary show nothing.

On the log i can't find something useful.

Any idea?
Back to top
View user's profile Send private message
vbilly
Forum Newbie
Forum Newbie


Joined: 12 Aug 2008
Posts: 8

PostPosted: Sun May 3, 2009 5:21 am    Post subject: Reply with quote

We are having the exact same problem today.

Any ideas?
Back to top
View user's profile Send private message
lancey
Active Member
Active Member


Joined: 18 Jan 2009
Posts: 43

PostPosted: Sun May 3, 2009 5:31 am    Post subject: Reply with quote

I'm having the exact same problem today, with 5.0. It seems someone has distributed a route over BGP, which makes quagga's BGPd to crash.

The error message about this in the logs is:
Code:

May  3 16:17:41 border vyatta-bgpd[6709]: Assertion `len < str_size' failed in file bgp_aspath.c, line 615, function aspath_make_str_count
May  3 16:17:41 border vyatta-bgpd[6709]: Assertion `len < str_size' failed in file bgp_aspath.c, line 615, function aspath_make_str_count
May  3 16:17:41 border vyatta-bgpd[6709]: Backtrace for 14 stack frames:
May  3 16:17:41 border vyatta-bgpd[6709]: Backtrace for 14 stack frames:
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 0] /usr/lib/vyatta-quagga/libzebra.so.0(zlog_backtrace+0x1f) [0xb805a76a]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 0] /usr/lib/vyatta-quagga/libzebra.so.0(zlog_backtrace+0x1f) [0xb805a76a]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 1] /usr/lib/vyatta-quagga/libzebra.so.0(_zlog_assert_failed+0x99) [0xb805a8c7]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 1] /usr/lib/vyatta-quagga/libzebra.so.0(_zlog_assert_failed+0x99) [0xb805a8c7]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 2] /usr/sbin/vyatta-bgpd [0x80978c9]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 2] /usr/sbin/vyatta-bgpd [0x80978c9]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 3] /usr/sbin/vyatta-bgpd [0x8097902]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 3] /usr/sbin/vyatta-bgpd [0x8097902]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 4] /usr/sbin/vyatta-bgpd(aspath_key_make+0x17) [0x8097921]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 4] /usr/sbin/vyatta-bgpd(aspath_key_make+0x17) [0x8097921]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 5] /usr/lib/vyatta-quagga/libzebra.so.0(hash_get+0x1d) [0xb8052218]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 5] /usr/lib/vyatta-quagga/libzebra.so.0(hash_get+0x1d) [0xb8052218]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 6] /usr/sbin/vyatta-bgpd(aspath_parse+0x1a0) [0x8098a96]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 6] /usr/sbin/vyatta-bgpd(aspath_parse+0x1a0) [0x8098a96]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 7] /usr/sbin/vyatta-bgpd(bgp_attr_parse+0x2f3) [0x806a108]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 7] /usr/sbin/vyatta-bgpd(bgp_attr_parse+0x2f3) [0x806a108]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 8] /usr/sbin/vyatta-bgpd [0x807fe97]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 8] /usr/sbin/vyatta-bgpd [0x807fe97]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 9] /usr/sbin/vyatta-bgpd(bgp_read+0x32d) [0x8080e69]
May  3 16:17:41 border vyatta-bgpd[6709]: [bt 9] /usr/sbin/vyatta-bgpd(bgp_read+0x32d) [0x8080e69]


I'm now back with our good old (slow) OpenBSD router, and everything works okay.

If anyone comes up with exactly what's going on, please write here. I'm now also digging deeper into this, hope Paul & others from the Quagga dev team are around to help soon.[/code]
Back to top
View user's profile Send private message
HenrikH
Forum Newbie
Forum Newbie


Joined: 16 Mar 2008
Posts: 13

PostPosted: Sun May 3, 2009 5:40 am    Post subject: Reply with quote

We are experincing the same problem with 2x Vyatta-routers. The output of "show ip bgp summary" and other commands of the same sort yield no output.

Unfortunately, I don't have anything else to add except that I have opened an after-hours support-case about this.
Back to top
View user's profile Send private message
lancey
Active Member
Active Member


Joined: 18 Jan 2009
Posts: 43

PostPosted: Sun May 3, 2009 5:42 am    Post subject: Reply with quote

Some guys just confirmed the problem is the same with a standalone quagga 0.99.10 install.
Back to top
View user's profile Send private message
alessandro_corbelli83
Super User
Super User


Joined: 10 Apr 2008
Posts: 296

PostPosted: Sun May 3, 2009 5:53 am    Post subject: Reply with quote

how can i restart bgp with no reboot and how can i add bgp debugging on every boot?
Back to top
View user's profile Send private message
Rob_T
Forum Newbie
Forum Newbie


Joined: 03 May 2009
Posts: 3

PostPosted: Sun May 3, 2009 6:04 am    Post subject: Reply with quote

I'm helping a friend troubleshoot some of these issues, and I found these pages which might be relevant:


http://marlow925.blogspot.com/2009/04/quagga-bgp-crash.html
http://article.gmane.org/gmane.network.quagga.user/9956/

both are stating that quagga bgpd crashes when it encounters 32-bit ASN's.
Back to top
View user's profile Send private message
Rob_T
Forum Newbie
Forum Newbie


Joined: 03 May 2009
Posts: 3

PostPosted: Sun May 3, 2009 6:07 am    Post subject: Reply with quote

Just found this as well:

http://www.mail-archive.com/misc@openbsd.org/msg69982.html
Back to top
View user's profile Send private message
lancey
Active Member
Active Member


Joined: 18 Jan 2009
Posts: 43

PostPosted: Sun May 3, 2009 6:08 am    Post subject: Reply with quote

There is a patch now in quagga's git.
Back to top
View user's profile Send private message
lancey
Active Member
Active Member


Joined: 18 Jan 2009
Posts: 43

PostPosted: Sun May 3, 2009 6:34 am    Post subject: Reply with quote

https://www.caputo.com/foss/quagga-0.99.11-BGP-4-byte-ASN-bug-fixes.patch
Back to top
View user's profile Send private message
HenrikH
Forum Newbie
Forum Newbie


Joined: 16 Mar 2008
Posts: 13

PostPosted: Sun May 3, 2009 6:37 am    Post subject: Reply with quote

There is also a Vyatta-provided patch out there: Vyatta Premium support were very quick to supply me with a patch for this that they have developed a couple of days ago. Subscription-customers should have received a mail with information on applying the patch (which is a related to quagga + certain 32-bit ASNs)

As I understand it, behind-the-scenes work is being done to get clearance to release this patch to community-users too.
Back to top
View user's profile Send private message
wdingus
Forum Newbie
Forum Newbie


Joined: 02 Jul 2008
Posts: 7

PostPosted: Sun May 3, 2009 6:44 am    Post subject: Reply with quote

Community edition or subscription? We have a subscription edition install and got this email alert a few days ago:

Vyatta Security Bulletin VSB-09-001

This is an important security bulletin concerning Vyatta software. Please review carefully and contact Vyatta technical support if you need assistance.

Summary:

Vyatta's BGP process will go down if it receives a route update containing a path with more than four 32-bit AS numbers.

..snip..

We also have another router with community edition Vyatta (doing BGP) and it is experiencing the same described problem as of about 8AM this morning. Any word on a patch for it?
Back to top
View user's profile Send private message
lancey
Active Member
Active Member


Joined: 18 Jan 2009
Posts: 43

PostPosted: Sun May 3, 2009 7:01 am    Post subject: Reply with quote

The offending path is coming from AS37095:
flags destination gateway lpref med aspath origin
*> 196.200.208.0/20 88.203.200.129 250 0 8717 1299 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i
* 196.200.208.0/20 213.16.53.189 200 0 8866 9050 3356 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i
* 196.200.208.0/20 62.204.150.21 100 0 8717 1299 3549 24863 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 5.6 37095 i

Rejecting it with a route-map doesn't help, though. BGPd crashes when it receives it, wherever it has to use it or no doesn't make any difference.
Back to top
View user's profile Send private message
Rob_T
Forum Newbie
Forum Newbie


Joined: 03 May 2009
Posts: 3

PostPosted: Sun May 3, 2009 7:07 am    Post subject: Reply with quote

You could perhaps ask your upstream(s) to filter that AS from the routes you are being sent using a route map or prefix list or something. Since your router wouldn't see that AS at all, it should resolve the issue.
Back to top
View user's profile Send private message
jfletcher
Vyatta Employee
Vyatta Employee


Joined: 26 Feb 2008
Posts: 684

PostPosted: Sun May 3, 2009 7:08 am    Post subject: Vyatta 4.X BGP Crash Reply with quote

On Sun, May 3, 2009 at 6:13 AM, alessandro_corbelli83
<forum-users@vyatta.com> wrote:
Quote:
Hi all
With no apparent reason, bgp on 4 vyatta boxes is crashing from today.
When I reboot the machine, bgp start as expected, route are imported and after a while (2-3 minutes) it crash.

show ip bgp summary show nothing.

On the log i can't find something useful.

Any idea?

You'll find the corresponding Vyatta bug at
https://bugzilla.vyatta.com/show_bug.cgi?id=4328 .

Best,
Justin
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    Vyatta.org Forum Index -> Users All times are GMT - 8 Hours
Goto page 1, 2, 3, 4, 5  Next
Page 1 of 5

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum