There is thread locking compound available at your local auto parts
store. "Locktite"
Made for just such a situation. Holds strong but allows for removal.