In recent years, the mobile Internet has increased dramatically with the development of 3G and 4G technologies. Especially the usage of mobile broadband internet on the devices like cellular mobiles, Tablets and Laptops has skyrocketed. Among the multimedia applications video streaming is the most popular mobile application. But, making these services available to users in a cost effective way without compromising quality is a big challenge. The development of Long Term Evolution (LTE) technology in the mobile world made this task achievable. The features of LTE technology provide effective services in multimedia applications with high data rates and low latency. In this paper, we study and analyze the Quality of Experience (QoE) at the end user for Video on Demand (VoD) over the LTE network. To achieve this, we streamed High Definition (HD) videos based on H.264/AVC and these videos are delivered from source to destination using Transport Control Protocol (TCP) and User Datagram Protocol (UDP). Specifically, our study is about QoE evaluation in terms of delay variation, packet loss metrics and provides performance evaluation to characterize the impact of transport layer protocol in video streaming over radio networks like LTE. In order to know the performance of video streaming over LTE network, we also evaluate the LTE performance in terms of one-way delay, packet loss and inter packet delay for the generated UDP and TCP packets.