If memory serves me well, Japanese monks (not sure what kind, probably shinto) were known for carrying well hidden and seemingly innocent weapons- such as a monk with a staff, but a staff that could open up to make a spear/halberd, and such.  So, I feel that clerics and such, even if peaceful would have no problem having small and discreet such as the armoured fan.  Unless, of course, they belonged to a peaceful order-and were particularly zealous!