It is 6 miles south of Washington , D.C. . It is by the Potomac River . Located along the Western bank of the Potomac River , Alexandria is approximately 6 miles ( 9.6 kilometers ) south of downtown Washington , D.C.