I think it is mostly a time commitment issue. Going soaring is an all day long affair. I don't see a way around that unless you slip in late morning and skip out right after landing. Not that there are any soaring pilots that would do such a thing. Even such abhorrent behavior still would take up a good portion of the day, if such behavior existed.