When a stone is moving around a circular path, its velocity acts tangent to the circle. When the string breaks, the centripetal force will not act. Due to inertia, the stone continues to move along the tangent to circular path, and flies off tangentially to the circular path.