Sooo.... turns out fixing the association via cli on the ESXi host with esxcfg-vswitch and putting back the NICs in the same order, resolved the issue entirely. We were trying to get rid of the copper management cable and go to all 10Gig.
I will update this post here soon with more information and screenshots to help any future users with this issue.