The white chalky substance on the walls is called efflorescence. As water seeps in, minerals from the sediment, concrete, and mortar are deposited on the inside of the wall. It's easy to clean and not normally harmful but it's a sign that something should be done.