A piece of chalk has extremely narrow capillaries. As it is immersed in water, water rises due to capillary action. The air present in the capillaries in the chalk is forced out by the rising water. As a result bubbles are emitted from the chalk in all the directions.