Well, it's up to you isn't it.
You can get slightly cheaper isolators, e.g.
http://www.impulse-corp.co.uk/display_product.asp?id=479
I'm sure there are more but there's little point posting them all.
And if you screw up with a normal one (assuming you aren't fiddling with high voltages) you'll probably just pop your adaptor.
I use USB PIC prgrammers. One is a standalone and the other is on an eval board. I have made numerous 'mistakes' on the eval board resulting in the USB shutting down temporarily. (Including popping several PICs due to careless wiring but don't tell anyone) . No harm to PC thankfully. The on-board current limiting did it's job, however I don't suppose for one moment it was designed for people to connect 24V up to it.
Nothing is indestructible except Captain Scarlet. So if you do something REALLY stupid then the buck stops with you.
And like hippy says, and I have said it at least a zillion times, get a QUALITY (=expensive) Bench PSU with variable current setting.
For prototyping at the early stages I would NOT use the USB supply for my circuit.
A lot of this depends on your experience/skill/knowledge/care/patience.
I have yet to hear of anyone damaging the USB or Serial interfaces on their PCs. Maybe they have and are just too embarrassed to confess.