An apparatus for handling sheets of paper, comprising:port means through which sheets of paper are put into and taken out of said apparatus; accommodating means for accommodating the sheets of paper into and to be taken out of said apparatus; single counting means common to both said port means and accommodating means and including a receiving portion temporarily storing a stack of sheets of paper