Hi all,
according to my last experience with FCoE, I’d like to share a step by step guide on how to check everything before configuring FCoE on ESXi and how to find if it works correctly.
First of all you need to note down your FCoE adapter model and check firmware and driver version supported my the esxi version you are running. Follow this link: https://www.vmware.com/resources/compatibility/search.php?deviceCategory=io
Exsample:
you have a Qlogic
to obtain the driver type that the Host Bus Adapter is currently using run this command:
# esxcfg-scsidevs -a
The uotput should similar to this:
vmhba43 bnx2fc link-up fcoe.2000f4e9d49fcbd1:2001f4e9d49fcbd1 (0:5:0.0) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Adapter
vmhba44 bnx2fc link-down fcoe.2000f4e9d49fcbd3:2001f4e9d49fcbd3 (0:5:0.1) Broadcom Corporation QLogic 57810 10 Gigabit Ethernet Adapter
Pay attention if the link is up, down or in n/a stata and before going on investigate.
To check the driver version run this command:
# vmkload_mod -s HBADriver |grep Version
vmkload_mod -s bnx2fc | grep Version
Version: Version 1.712.10.v55.2, Build: 1331820, Interface: 9.2 Built on: Nov 24 2014
To check the firmware versione run this command:
vmkchdev -l |grep vmnic4
0000:05:00.0 14e4:168e 14e4:1006 vmkernel vmnic4
Determine which interfaces are FCoE capable by running this command:
# esxcli fcoe nic list
Verify that the interface is activated by one of these steps:
# esxcli fcoe adapter list
Check even the firmware version. Not all driver version are supported with a certain firmware version.
If you wanna add them manually from ssh just run thees commands:
esxcli fcoe nic list
esxcli fcoe nic enable -n vmnicX
esxcli fcoe nic discover -n vmnicX
esxcli fcoe adapter list
NETWORK CONFIG:
I cannot copy and paste all the configuration so I’ll write exerpts of configurations.
Port configuration:
interface TenGigabitEthernet 0/14
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
fcoe-map FabB_CM
dcb-map SAN_DCB_MAP
no shutdown
Check if fcoe-map is in Oper-State UP
#show fcoe-map brief
Fabric-Name Fabric-Id Vlan-Id FC-MAP FCF-Priority Config-State Oper-State
Fabric1 1003 1003 0efc02 128 ACTIVE UP
Fabric2 1004 1004 0efc03 128 ACTIVE UP
Check sessions
show fip-snooping sessions
Enode MAC Enode Intf FCF MAC FCF Intf VLAN FCoE MAC FC-ID Port WWPN Port WWNN
------------------ ----------- -------- ------ -------- ---------------- -------- ---------------------- ------------------------
00:90:fa:ca:34:85 Te 0/14 f8:bc:12:27:4e:e4 Fc 0/1 1003 0e:fc:02:01:18:04 01:18:04 10:00:00:90:fa:ca:34:85 20:00:00:90:fa:ca:34:85
Follow this vmware KB: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2034702
And this KB: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1027206