You can think of the wallet as a house. Your public key is your address to your house, and the private key is, well, the keys to your house. Things you buy (NFT, tokens etc.) are then stored inside your house which you can move around using your private key.