Can dried paint rub off onto your skin from friction, and then be absorbed into the skin?

Ok, this is going to sound incredibly stupid, but it has been bothering me alot. I was handeling a painte wooden sword and my hands were a bit damp from sweating a little bit. I noticed that the paint on the part were my hands were had become smeared. I have a fear of the toxins of paint, such as neurotoxins and such and I've somehow come to belive that the paint has rubbed off of the sword and into the skin on my hands. Is this possible and if so, is it harmful in any way? Any help would be greatly appreciated.
Can dried paint rub off onto your skin from friction, and then be absorbed into the skin?
First of all there is no toxic way paint can seap into the skin as most types of paint are safe. In case you are worried you should visit a doctor to alleviate your fears, but it just sounds like a friction burn or possibly allergic reaction to the paint, as I would imagine as anyone would do. Its common to scrub off the paint as hard as one could to get it off and this would cause the smearing. You could also check if it was a lead based paint, but this is unlikely as it is now illegal to use or sell it. Best thing to do though is to visit the doctor.