Ball detection datasets comprises three diffrent publicly available datasets for soccer, basketball, and volleyball sports. These datasets consist of approximately 34000 frames. They are labeled manually, frame by frame, for the purpose of academic studies in ball detection by the members of Image Processing Laboratory (IPL) of Sharif University of Technology. Ball coordinates in each frame are available in csv format. For more information please contact kasaei[at]sharif[dot]edu.