Forum SubscriptionsForum Subscriptions   FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
Vyatta on Supermicro 6015T/INF?

 
Post new topic   Reply to topic    Vyatta.org Forum Index -> Hardware
View previous topic :: View next topic  

Do you currently use or plan to use Infiniband?
Yes
0%
 0%  [ 0 ]
No
100%
 100%  [ 2 ]
What band?
0%
 0%  [ 0 ]
Total Votes : 2

Author Message
topping
Forum Newbie
Forum Newbie


Joined: 30 Jan 2010
Posts: 3

PostPosted: Sat Jan 30, 2010 11:46 pm    Post subject: Vyatta on Supermicro 6015T/INF? Reply with quote

Hi all,

I was going to go to sleep an hour ago, but found that launching Vyatta under Xen for the first time with no documentation whatsoever woke me up pretty quick! Smile

I have a 6015T/INF, a 1U twin that has dual Xeon 5400 motherboards with a Mellanox Infiniband connector on it. I can see how I would use the two ethernet ports with Vyatta and PCI capturing, but not sure how I could route over the IPoIB, which is currently using the OpenFabrics Enterprise Distribution software that comes with CentOS 5.4.

Getting Vyatta to speak IPoIB couldn't be that difficult, but I assume it's not there yet. Is there a way for Vyatta to use an interface virtually? In that mode, the dom0 would boot and bring up the ib0 interface, then I could route over it through a virtual encapsulation of the interface.

Apologies if I'm overthinking the problem here...

Cheers, Brian
Back to top
View user's profile Send private message
topping
Forum Newbie
Forum Newbie


Joined: 30 Jan 2010
Posts: 3

PostPosted: Sun Jun 6, 2010 2:29 pm    Post subject: Re: Vyatta on Supermicro 6015T/INF? Reply with quote

topping wrote:
...


Looks like this post got a lot of views! Last week, I went out and ordered additional hardware to try this on, another 6015T/INF, arrives tomorrow. I thought very long and hard about buying a couple of 2811's instead, but in the end, I still needed to buy a spare power supply for my current 6015, which is the core of my stack and would be a disaster if it dropped out. So this kills a few birds, even if it's a bit more expensive.

My plan is to set up CentOS 5.5 on a USB 16GB USB stick on each half of the new box, then put Vyatta Community as a Xen client on each. Having experimented previously with this, I expect it will go smoothly, then on to capturing the ethernet interfaces.

Anything other readers can think I should watch out for?

If that works, I'll start experimenting with making some additional clients on the box, hopefully using iSCSI over IPoIB. Then I'll move one of the routers to each box for diversity. One step at a time tho...
Back to top
View user's profile Send private message
topping
Forum Newbie
Forum Newbie


Joined: 30 Jan 2010
Posts: 3

PostPosted: Mon Jun 21, 2010 7:10 am    Post subject: Update Reply with quote

So in the process of getting Vyatta installed on this new machine, I decided to check out XenServer and am very happy that I did. It solves a lot of issues for me and I'm very much looking forward to using it. Ironically, I checked it out because Vyatta has a distribution for it.

I now have Vyatta front-ending my network, and the results are spectacular. Kudos to the Vyatta team for an effortless install with the Vyatta template.

The only thing that has suffered here is the support for Infiniband. I ended up solving that last night by rebuilding the Mellanox OFED distribution, the results of that are here: http://forums.citrix.com/thread.jspa?messageID=1470298.

Hopefully at this point, I can create an IPoIB interface and start routing over it. More as I get it.

Cheers, Brian
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    Vyatta.org Forum Index -> Hardware All times are GMT - 8 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum