Seems the visibility of Location section can be changed by the config in the experience builder, then we can only do is either override the css or you replace your own custom component (you provide the functions to change email addr or change password) with the standard one on User Settings page

For CSS overrides(this works for me in my partner portal, you may check the html elements from browser console to accurately target it):

fieldset[class="row dropdownvisibility locationSection"] { display: none; } 

Seems the visibility of Location section cant be changed by the config in the experience builder, then we can only do is either override the css or you replace with your own custom component (you provide the functions to change email addr or change password) on User Settings page

For CSS overrides(this works for me in my partner portal, you may check the html elements from browser console to accurately target it):

fieldset[class="row dropdownvisibility locationSection"] { display: none; }