Holy Guruji was born on 11 September 1923 and received Sannyas initiation in 1942. He lived at Sri Mahaprabhuji's side for more than 20 years, faithfully recording his Bhajans (spiritual songs) and Satsangs (lectures) throughout that time.

Paramhans Swami Madhavanandaji belonged to the Puri order of the Dasnami Sampradaya founded and established by Sri Adi Shankaracharya (788-820). He was a follower of the Saivas tradition and Advaita philosophy.

Holy Guruji attained the state of Realisation through pure devotion and service to his Master. His meditation and prayer meant spiritual help for the whole world. "Enter the kingdom of the Lord through the gate of sacrifice" is his encouragement to all seekers.

Paramhans Swami Madhavanandaji travelled extensively throughout India and the world, tirelessly spreading the message of Sat Sanatan Dharma and Yoga according to the teachings of his Master Bhagwan Sri Deep Narayan Mahaprabhuji. He called for universal brotherhood and service to mankind without prejudice or discrimination of nationality, status, or religion. He preached about love, understanding, and tolerance for all, which is concisely captured in his message “One in All, All in One.”

As an accomplished singer, he often expressed these teachings in the form of bhajans. Holy Guruji wrote hundreds of songs and authored books in Hindi and Gujarati.

In the book "Lila Amrit" he has written down the story of Sri Devpuriji's and Sri Mahaprabhuji's miraculous lives. He established several ashrams in Rajasthan and Gujarat.

Holy Guruji entered into Mahasamadhi on October 31st in 2003.