View cache is stored per siteaccess. So it will be cached properly with same VarDir for all siteaccess as long as ViewCaching is enabled.
When all siteaccess using same database then VarDir MUST be same for all siteaccess public and non-public (admin). Other way you will run in troubles like you mention above (uploaded files are stored in wrong VarDir).