Ayub Khan was born into a family of hereditary musicians who have carried with them a rich knowledge of traditional tabla repertoire. He was trained under his father Ustad Reheman Khan, the tabla maestro. During his training with his father, Ayub Khan received the knowledge of the four main tabla gharanas, namely Delhi, Ajarada, Farukhabad, and Lucknow, that he works to preserve today. Ustad Reheman Khan received the knowledge of these gharanas from his gurus, namely his father Chowdury Ajmeri Khan, a disciple of Ustad Nunhei Khan of the Delhi gharana, Ustad Masit Khan of the Farukhabad

gharana,Ustad Azim Khan, father of the great Ustad Nizamuddin Khan, and the legendary Khalifa Ghulam Hussain Khan, master of the two Purab styles of tabla, Farukhabad and Lucknow, and representative of the repertoire of Ustad Munir Khan. It is the tabla repertoire of these great Ustads, including Ustad Jamal Khan (Hyderabad Sindh, Pakistan), Ustad Reheman Khan's elder brother, that Ayub Khan possesses and preserves.

Since his first tour of the US in 1997, he has performed at many prestigious venues, including: The Lincoln Center, the American Museum of Natural History, Hunter College, and New York University.. Presently he is associated with Naad-Niket, Center for Propagation of Indian Music, in India. He is here in the US performing with Raj Arts Management, and closely affilliated with the Kalavant Center for Music and Dance.