I definitely think that's true. At one point, it was more of a suspicion (if also backed by twin study data)
I once talked to a childless nurse who spoke glowlingly about her nurse friend that adopted two children, both from a different addict prostitute, one going to prison. the other dying.
When I pried a little about if she still had good contact with her, it turned out that she had broken contact with her foster son after he pushed her down the stairs in anger, and her foster daughter was at least doing well, if dealing with mild addictive tendencies.
She immediately started saying both must be because of the drug use while in utero. I guess my questions weren't as subtle as I had thought.