Secondly, I notice offline payment option can not be used to buy membership. (May I didnt get the configuration right)

Check my 1st screen, I have enable Offline payment options for users to buy membership

Below is my User screen trying to make purchase, He can not find checkout with Offline payment.