If you're going by dolmus, you'll need to get another dolmus to Fethiye first. Get off at the end of the line & ask someone to point you in the direction of the Kaya village dolmus. Whichever way you choose to go, if you're going to explore the village it's mainly rough walking, but more than worth it