With Infiniband be could gain more speed for data transfer between 2 nodes. There are a lot of ways to use Infiniband. In this particular case we will use it for TCP/IP connection. It’s not the fastest method for data transfer but it’s just a start. We could user iSCSI over Infiniband as well. We will work with QLE7342 Card on Debian Jessie.
- First we will configure some kernel options on grub. We just need to modify this line in /etc/default/grub
- GRUB_CMDLINE_LINUX_DEFAULT=”quiet options ib_qib singleport=1 krcvqs=2″
- (Here you could find the configuration for your processor)
- We update grub’s configuration:
- And reboot the server.
- Once again on our server, we have to install the Infiniband tools and some dependencies:
- apt-get install -y build-essential infiniband-diags opensm
- Next we need to add the modules to /etc/modules:
# Protocol modules
# Common modules
# IP over IB
- And you need to add them for first time:
- modprobe rdma_ucm
- modprobe ib_umad
- modprobe ib_uverbs
- modprobe ib_ipoib
- With this card I had a problem that leave the card as “Disable” and no leds on. To fix that we have to enable it running this command:
- ibportstate -D 0 1 enable
- Now we have to configure the Network interface. Add to the /etc/network/interfaces the block for the card:
iface ib0 inet static
- We up the card:
- ifup ib0
- And we are ready to use IPoIB.
I know my strengths and weaknesses. I'm a quick learner, I know how to work with small and big teams. I'm hard worker, proactive and I achieve everything I propose.
Latest posts by Pablo Javier Furnari (see all)
- Install Nagios Core 4.3.2 in Debian Stretch Part 1 - July 25, 2017
- Install Adagios from Source on Debian Jessie - July 19, 2017
- High Availability Storage with DRBD + Heartbeat + NFS on Debian 8 - September 13, 2016