The exact closed-form expressions for symbol error probability and outage probability of randomized distributed space-time codes (RDSTC) under Rayleigh fading are derived. The diversity gain derived in the literature uses the Chernoff bound which may not be achievable in general. Utilizing the exact expression, the achievable diversity gain of RDSTCs is validated. The closed-form expressions are verified by Monte-Carlo simulations.