Concerns have been raised over the bonfire, which is on a site which contains asbestos and is close to an electricity substation.