Dani
I have had similar experiences at our airport along the CA coast at
KHAF. If the winds are from the east they create rotors off of the
coastal range. On the ground they are barely perceptible and show up
only as "variable" in direction but once above 300'AGL you get your
tucas kicked until above the ridge line or approx 2000'. But it is a
battle in the pattern as it will take full aileron deflection and some
top rudder to keep upright, add to this negative Gs from the
turbulence and it can really rattle your passengers. Thankfully
things stay calm close to the ground...