I know many visitors from abroad visit Kyoto while traveling in Japan. If you want an experience at a Sento, public bath house in Japan, you"ll find "The Sento: Japanese Public Bathhouses in Kyoto" is handy.
The site is managed by students of College of Policy Science, Ritsumeikan University. It provides all info you may need including maps, manners, and history. Please note Sentos usually supply heated tap or well water, not necessarily onsen. Some of the Sentos in the site are named "Onsen", but actually none of them supply hot springs.