A remove walls button would be great for building small areas, just like the remove roofs button, it can remove things placed onto it too.

I imagine this feature to be very helpful to many builders.