The HSE has been repeatedly accused of letting the former psychiatric hospital, which has been closed since 2013, go to “wrack and ruin”