And if you really wish to follow Lore... look up the Unkempt Druids faction. Last time I saw them was a quest in West Karana, involving a NPC druid from Surefall Glade who became a farmer in WK, forget her name...
I agree with you that on first blush this just seem wrong. But if you go back to the in-balance/nature side of a druid it makes sense that druids could use almost any item. The concept of ying-yang of the world if you will. Druids are not evil but at the same time I do see them as been in the same world as a paladin or a cleric.