How to remove various dissolved solids and chlorine cheaply?

I am not really understanding what you want. You have already answered your own question. What you need is a reverse osmosis system.