Prince Andrew is “desperate to cling to power” despite a major step back from the public eye, according to a royal expert.