What do you care? Promiscious mode is set on the interface by the software in the VM when needed. You're simply configuring the vSwitch to ALLOW it. Besides, there's nothing else on the vSwitch to abuse it.
Unless you're afraid someone is going to hack into VMWare and install something? I submit at that point you have larger problems.
Just set the vSwitch to only have 2 ports.