The momentum is transferred to the metal. At the microscopic level, atoms absorb the photon and its momentum is transferred mainly to the nucleus and electrons. The excited electron is emitted. Conservation of momentum needs to be accounted for the momentum transferred to the nucleus and electrons.