Living in poverty is a costly business and doing simple things can cause a significant financial burden.