The Mariner had shot the Albatross for no reason. The others blamed him for their predicament as all the problems they faced, occurred after the shooting of the Albatross. Hence, they hung it around his neck. It was a constant reminder of the sin that he had committed.