FSDO or DPE can issue a Student Pilot certificate for students learning in aircraft that do not require a medical evaluation.
Gliders, Balloon, and I think Light Sport airplane. It will state, limited to glider or balloon.

An AME is required for the Class 3 medical evaluation and can issue the student certificate with medical certificate.
T