Video technologies have had a huge impact on sports. Most professional sports events are captured in video, are broadcast and are consumed by many. Video is also becoming a sensor used to measure and analyze athletic performances, overall games, and commonly used as an aide for judging calls made on the field. In this talk about, I will discuss some of the specific advances made in sports video analysis. Computer vision techniques are now used widely in sports analysis to extract data, insights, and inferences of much value. I will highlight some challenges as more and more of such data is becoming available, especially with growing pervasiveness of cameras. I will discuss how some foundational work in computer vision can be brought to bear on this growing problem of sports video analysis and showcase a few recent examples of our work on tracking, registration, and summarization.