Videos play a very important role in today’s communication and entertainment world. Many services are being developed based on the concept of video like video streaming, video calling etc. The increase in demand for such services made the service providers evince interest in investigating, monitoring and maintaining the quality that they provide for such services. Also it is a crucial point that a bad quality video will degrade the Quality of Experience felt by the user. In order to improve Quality of Experience, video quality evaluation is necessary. For this purpose many tools to evaluate the quality of a video have been designed. In this thesis EvalVid is evaluated, which is an open source video quality evaluation tool. We have evaluated a set of videos using this tool to compare the performance of quality evaluation metrics like Peak Signal to Noise Ratio and Structural Similarity Index Metric. Affirmation of the results is done using Matlab, by calculating PSNR and SSIM for the same set of videos which have been used in EvalVid. These two tools calculate the metrics in two different ways, which is revealed by the observed differences in the results. A set of particular observations allow further conclusion that EvalVid is less credible than Matlab for evaluating quality of videos.