The construction of the UNESCO World Heritage site of Khajuraho Group of Monuments is primarily attributed to the Chandela rulers.