generally we use " should have" to express appology eg: sorry, i should have give him his money. and shouldn't have for criticizing things eg: normally, i shouldn't have do that