The authors propose a Floquet qubit that is the superconducting circuit analog of a mechanical Kapitza pendulum. Under periodic driving, the bit and phase flip rates of the emerging qubit states are exponentially suppressed with respect to the ratio of the effective Josephson energy to charging energy. A cooling scheme to protect the system against charge noise is also proposed.