Nutanix CE nested on VMware ESXi 6.5 - VLAN Tagging

Figure 1 - Nutanix Open vSwitch

Configure VLAN tags on br0 on every AHV host in the cluster. Repeat this config on all hosts using vSphere Console by logging in as root. 

  

ovs-vsctl set port br0 tag=10 

ovs-vsctl list port br0 

Configure VLAN tags for the CVM on every CVM in the Nutanix cluster. Repeat on all hosts. SSH from host using nutanix account. 

ssh nutanix@192.168.5.2 

nutanix@CVM$ change_cvm_vlan 10 

Update DNS server setting on all nested hosts.

vi /etc/resolv.conf 

Install open-vm-tools package on nested host 

yum install –y open-vm-tools 

For better network performance and less dropped packets in nested environment, install esxi mac learning dvfilter as mentioned by William Lam - virtuallyGhetto. Check out his blog for more info on dvfilter.

esxcli software vib install -v http://download3.vmware.com/software/vmw-tools/esxi-mac-learning-dvfilter/vmware-esx-dvfilter-maclearn-1.0.vib -f 

Confirm the install. No reboot required. 

/sbin/summarize-dvfilter 

For the dvFilter to work, you will need to add two Advanced Virtual Machine Settings to each of your Nested AHV VMs. This setting is on a per vNIC basis, which means you will need to add N-entries if you have N-vNICs on your Nested AHV VM. 

ethernet0.filter4.name

dvfilter-maclearn

ethernet0.filter4.onFailure

failOpen