I never worried about shrinkage and such, and as mentioned elsewhere I tried a bunch of variations from the tightness of the joint, to doing textured surface . None lasted more than a few minutes of movement.
Ultimately, the only thing that worked for me was to install a grub screw in the socket, that could be tightened against the ball.