We went to the
Caves at Blue Mountain this weekend and it was quite fun. The kids were able to traverse the rocks and stairs without too much trouble. As their site says you have to wear hiking or running shoes and go on a dry day or you will be slippin and sliddin all over the rocks. The whole experience takes about 2 hours which included a view from a suspension bridge but we enjoyed the rocks and caves more.

We followed it with a side trip to the villages at Blue Mountain. They've done a really nice job making it look like a European ski town.
