Black and white

As is usual with ideas I come up with, I'm sure this has been thought of, investigated and then dumped, but...

If black absorbs heat and white reflects it, why don't our houses change colour with the seasons?

A black house in winter would absorb more heat, and a while one reflect it in the summer. Right?

As I say, I'm sure this won't work for very sensible reasons but I'm surprised I've not heard of it either way before.