Mellanox

RHEL7

Run

yum install numactl

cd /root
cp /usr/downloads/MLNX_OFED_LINUX-2.4-1.0.4-rhel7.1-x86_64.iso .
mkdir tmp
mount -o loop MLNX_OFED_LINUX-2.4-1.0.4-rhel7.1-x86_64.iso tmp
cd tmp
./mlnxofedinstall

Run command

/sbin/connectx_port_config --show

to display port settings, change it with

/sbin/connectx_port_config 

setting all ports to 'eth'.

Configure new 'eth' port as desired (left port seems p6p2 now ...). Use for example text interface to NetworkManager called 'nmtui'. Set 'Manual', IP address with mask (like 129.57.167.41/24) and gateway (like 129.57.167.99) only, ignore the rest. Reboot machine, unplug copper ethernet when starts booting, it should come back using fiber.

RHEL6

Run

yum install numactl

cd /root
cp /usr/downloads/MLNX_OFED_LINUX-3.1-1.0.3-rhel6.7-x86_64.iso .
mkdir tmp
mount -o loop MLNX_OFED_LINUX-3.1-1.0.3-rhel6.7-x86_64.iso tmp
cd tmp
./mlnxofedinstall

Run command

/sbin/connectx_port_config --show

to display port settings, change it with

/sbin/connectx_port_config 

setting all ports to 'eth'.

After it installed, run /usr/bin/system-config-network and setup p6p1 device as manual network with appropriate settings. Shutdown computer, unplug copper cable and start computer, 10G fiber link should become default one.