Certificate for the public key
The certificate is not encrypted.  It contains signatures (basically hashes) that are encrypted with the private key.  The public key can decrypt that and the hash can be verified.  In SSL/TLS there is a signature that the client supplies via private key to prove they are the owner, and the CA has signed it the cert with their private key, which can be verified using a CA cert you mark as explicitly trusted.