Over Under

I understand erosion and all that, but what I can't get is how these rocks get piled up on top of one another with tunnels and windows and such. It seems to me to be very unlikely that any of these formations could be the simple result of erosion.