Try contacting Boonchu Pier for a private long tail boat to take you there. Very good service and very affordable way to avoid a big crowded boat. We did a full island tour with them, but I am sure they would be available to just take and drop you off at Koh Panyi for a visit as long as you want to stay there. It is worth lunch and about an hour or two to walk around. Fantastic food with very generous portions and great service. Yes, the full island hopping tour does go out to all the touristy places but I would still consider it, and the private long tail boat was great for a couple reasons: 1. It is just you and your friends/family 2. Overall it is cheaper than what I was seeing for the speedboat tours. 3. You can leave at whatever time you want, since you don't have to wait for other people. We left at 6 AM, and really avoided most of the crowds everywhere we went, including James Bond Island Boonchu Pier's number is 093-795-6748. We booked our tour through Alex Taxi Phuket-they have a great website and are really good about emailing. You could send him an email and ask about arranging something specifically to your liking or choose the full day island hopping tour. Included hotel pick up and drop off through Alex. Probably your hotel could contact the pier too if you want and inquire, might be easier that way. Hope this helps. Good luck!

Village is very, very small - no more just 10 min worth of time. The rest is "the shopping street" and restaurants... Do not expect much to see.

As I mentioned already in the previous answer - not much to see. Tiny village with lots and lots of shopping. Thus mosque is very nice.