The extraction of the three-dimensional shape information is accomplished by the user applying deformation, rotation, translation and other transformations to a plurality of simple shape primitives (rectangular parallelepiped, and so on) and fitting them onto an object in a two-dimensional image.