A "shocking" makeshift homeless shelter made from cardboard boxes has been removed by the borough council after it was erected on Wednesday.