Distaff

Noun: Distaff originally meant a spindle or stick onto which flax or other material is wound in preparation for spinning. It current meaning is as an adjective defining the female side of a family or anything female.

Example: “He is my Uncle on the distaff side.”

Caution the word is bordering on archaic and may be offensive to some.