If you are sure other VM's wont migrate to the host then you can shutdown.
But I would personally prefer to put the host in Maintenance Mode and shutdown, So that once you complete your activity you can perform the health check of your ESXi host and then Exit Maintenance Mode