The ancestors of the family migrated from Chittorgarh, the home of the Sisodia rulers, during the period of Rana Sanga due to the internal strife, and established their own kingdom at Rampura in the central provinces of India. From there they conquered Bhanpura and Ajabgarh pargana (now Bhangarh and Ajabgarh), a deserted town in Alwar district. It was conquered by Maharaj Madho Singhji, brother of Maharaja Man Singhji I of Amber in the 16th century. The Chandrawats were left with the thikana of Sankotra for their maintenance. Sankotra Fort, Sankotra Haveli was built in the 17th Century when Jaipur town was founded and was granted to the Sankotra Family in 1768, since then its has been the official residance of the family.