In 1814 the British burned it town because Americans had torched Toronto. The building was a gray Virginia freestone. It was painted white to hide the shame of the Americans and to cover up the fire damage done by the British.
It wasn't officially called the White House until Toddy Roosevelt began printing it's image on the executive mansion stationery in 1901.
God Save the Queen.