Consider moving the mass at the middle by a small amount h to the right. Then the forces on it are: GMm/(R - h)2 to the right and GMm/(R - h)2 to the left. The first is larger than the second. Hence the net force will also be towards the right. Hence the equilibrium is unstable.