when subjected to a horizontal force perpendicular to that motion,
will move in a circle?

In a sideslip, lift is perpendicular to the longitudinal axis of the
aircaft, not the direction of motion.