And it is hereby declared, that every person inhabiting or occupying any house or other building or improvement, or lot within the said town, shall be liable to the payment of the tax thereof unless the same shall have been returned by some other inhabitant.