In short, no, BitBuffet will not reveal to the buyer your physical address. However, depending on PayPal's settings, they may have access to that sort of information on the invoice.

It would be wise to double check with PayPal to ensure that your information is not revealed.