I'm pretty sure that encryption is done only with the recipient's public key. You want to use your own private key to save a copy in your 'sent' folder, though. Evolution wants the sender's public key but that is AFAIK just a quirk that is specific to Evolution.
Great show!! I would like more people to get into gpg signing and encrypting messages.