Some 77% of Britons think taxpayers should not help pay for Pope Benedict XVI's visit to Scotland and England, a survey suggests.