Once in a while you get a glass of water, and it looks cloudy.
Maybe milky is a better term. After a few seconds it miraculously clears up! The cloudiness is due to tiny air bubbles in the water. Like any bubbles, the air rises to the top of the water and goes into the air. This clears up the water. The water in the pipes coming into your house might be under a bit of pressure, and gases (the air), which are dissolved in the pressurized water, will come out as the water flows into your glass, where it is under normal atmospheric pressure.