It looks like the time is coming soon when my H10 20gb needs a new battery. The only source that I could locate was Ipods 99:
Super Extended Life Battery for The iRiver H110
I paid something like 21$ including postage for a new battery (Cameron Sino) for my H340 from an Ebay seller, shipped from Hong Kong to Switzerland. Now Ipods 99 want 55 $ for the H10 battery, 29.95 for the battery and 25 $ (!) for shipping it to Switzerland which I think is a complete rip-off!
Does anybody know of a cheaper source? I've tried searching on Ebay a couple of times, but to no avail.