You can refuse a visual approach, and be cleared for the IAP if you so
desire. However, in this case it seems you were able to accept the
visual approach, but you would have needed to maneuver for the
approach. The good news here is that when you're cleared for a visual,
you are permitted to do whatever you need to do to make a landing.
There was nothing requiring you to go straight in, not circle, etc.

Lynne