Honestly, I had expected to be able to see the inside of this building, but it didn't seem to accept visitors. In fact, it doesn't seem to flaunt itself as a tourist attraction at all. Also, while his childhood home is in Old Town Alexandria, the area the house is in is just off a major thoroughfare north of some subsidized housing and not particularly frequented. It's a pretty ordinary-looking brick 1800s house; nothing ornate about the front whatsoever. One can see the garden in the back yard from the street; someone seems to have made an effort to keep the bushes manicured.
For those very interested in Robert E. Lee, it might be interesting to see his relatively humble home. Some of the surrounding houses are also pretty.