A building needs maintenance to stay safe and in good repair, therefore you should never stop building a building.
If you stop building a building, the building becomes an unbuilding as it slowly and gradually unbuilds itself. After reaching a critical state of unbuilding, the unbuilding collapses and is now an unbuilt pile of rubble.
Keep building your buildings!