Approximate symmetries and conservation laws for deterministic and stochastic differential equations with a small parameter are discussed in detail. Determining equations for infinitesimal approximate symmetries of Ito and Stratanovich dynamical systems are derived. It is shown how to derive conserved quantities for stochastic dynamical systems using their approximate symmetries without recourse to Noether's theorem