Ashes to her throne

Some dude with memory loss, village done burned to the ground and can’t stop seeing this silver haired girl. He embarks on a journey to defeat the demon king but has to face a bunch of obstacles blah blah blah and gets a harem.