It also greatly helps if you actually look at landmarks. For example, yes, 1600 Penn. Ave is the address of the White House. But that map gave you Lafayette Square across the street.
There's the actual white house, inbetween the Treasury Dept and the OEOB.