Data stream mining is a research area that has grown enormously in recent years. The main challenge is extracting knowledge in real-time from a possibly unbounded data stream. Clustering, a process in which groupings within the data are identified, is a valuable technique to extract and identify underlying structures of the data. An open question in stream clustering is how to evaluate the proposed algorithms. In this survey, we review the literature in the domain to identify common methodologies, datasets, and evaluation measures, used to evaluate the algorithms. We provide a short summary of the stream clustering algorithms in the literature, but our primary focus lies in the survey of cluster validation relevant to the evaluation of data stream clustering algorithms. We begin our literature review with the inception of clustering incrementally, namely with the introduction of the balanced iterative reducing and clustering using hierarchies (BIRCH) algorithm. We identify that the evaluation methodologies primarily focus on performance, and that aspects such as cluster quality are rarely considered. Performance has been the focal point of all evaluations, both in terms of computational performance and accuracy, since the inception of clustering data streams. We also identify that issues in the conventional clustering domain are present in the data stream clustering. However, minor additions to the evaluation methods can improve both the applicability and usefulness of the algorithms.