You're a rogue, dammit. Stuff your conscience in a sack & behave like a rogue. Take anything from anyone & revel in the pleasure thereof. You're not expected to justify taking stuff. That's why you get pickpocket. Otherwise, make a paladin & then you can be a pureheart.