While this probably does not indicate every building will be enterable at all times I think it is likely that when you are needed to enter a building you may well be able to go into any number of them while making your way to your target, for example climbing between two windows to get into the building you need to be in.