Unfortunately you can't view to see the button to add them unless the other user has allowed public access.... :'(

Which means to add friends both of you have to switch to public access temporarily, add each other, then switch back to no public access.