I keep trying to like the Freer and Sackler galleries--still to no avail. If you love Asian art, these galleries may be wonderful, but to me, they are the antithesis of what a gallery should be. As someone who enjoys exploring galleries and learning about culture, I dislike the long, dark hallways filled with metal and porcelain objects. In addition, I constantly wish they would interject a little more energy into the museum by providing something different, perhaps an entertaining video that puts the art into a cultural context.
In particular, I would recommend that families skip the museum - I saw few children while I toured, and I would imagine most children would hope for more interaction. Further, many of the exhibits, which are high and inset, might be difficult for young children to see.
One good thing, however, is that the museum does play some great free movies. Check out www.asia.si.edu for more information.