In cryptography, the fundamental difference between a public key and a private key lies in their usage and accessibility. The public key is shared openly and used for encrypting data, while the private key is kept confidential and used for decrypting it. This asymmetric encryption system ensures secure communication over insecure channels, allowing users to share information safely without needing to exchange private keys, thereby enhancing security.