In 1792 the Maryland 3rd Congressional District was moved to include Montgomery County, Maryland and the eastern half of Frederick County, Maryland. The population was about 33,000. However, the western portion of what is today Carroll County, Maryland was at this point in Frederick County, and the western half of the District of Columbia was in Montgomery County. This latter fact explains why the district lost population even though it in theory did not experience redistricting after the 1800 census. With the population of Georgetown, D. C. no longer in the district, its 1800 population was about 31,000. At this point the 3rd was Maryland's least populous district, barely having half the population of the Baltimore City and County 5th district, which in 1800 had just above 59,000 inhabitants.
The boundaries remained the same after the 1810, 1820 and 1830 censuses. While in 1820 the district had about 36,000 inhabitants its population had risen to 53,622 in 1830. With the formation of Carroll County in the 1830s as well as Maryland falling from 8 to 6 congressional seats, the boundaries of the 3rd Congressional District were drastically redrawn. The only area that remained in the 3rd Congressional District was the part of Carroll County that had been in Frederick County. The 3rd also included Baltimore County and the western half of the city of Baltimore. Its new population was 69,923, 24.5% of whom were black.
In 1853 the 3rd district was redrawn again. The new district consisted of Baltimore County except for the northern and western parts of the county and about the eastern third of the City of Baltimore. The district now had a population of 95,729. In the redistricting following the 1860 census, Maryland was reduced to five congressional districts. The 3rd was moved so that it contained the part of Baltimore that had not been in the 3rd before 1863. It now had a population of 130,040. In 1873 the 3rd district was moved again, to be the east side of Baltimore. It now had a population of 120,978.