One of the best perks of building a cave house is that Mother Nature has already done half the work for you. Seek out natural caves in your Minecraft world, and don't be afraid to build within them.