If your video file in FLV format you can convert them into WebM or MP4 and use HTML5 video tag to play video
Details about <video> tag format could be found here:
http://www.w3schools.com/html/html5_video.asp
And you can use free ffmpeg utility to convert all your video files in a batch. Here is example command line to convert flv into mp4:
ffmpeg -i input.flv -qscale 0 -ar 22050 -vcodec libx264 output.mp4