Whitmore headed the Royal Engineers detachment on Malta as its Colonel Commandant between 1811 and 1829. There he became a great friend of the governor Sir Thomas Maitland and designed the military hospital at the Villa Bighi in conjunction with Vice Admiral Sir Pulteney Malcolm. When Sir Thomas Maitland was high commissioner of the Ionian Islands, he designed the Palace of St. Michael and St. George in Corfu City. He later became a major general and was lieutenant-governor of the Woolwich Academy between 1840 and 1846.
Whitmore married Cordelia Ainslie (1780 – 19 December 1857) on 16 January 1798. Their second daughter Cordelia Winifreda married Captain Montagu Stopford, RN, on 25 August 1827. Their grandson, Sir George Stoddart Whitmore (1829–1903), was born on Malta to Lieutenant (later Major) George St Vincent Whitmore RE and to the chief justice of Malta, Sir John Stoddart's, daughter. He later became an army officer and police officer in New Zealand.
- The Peerage, Baronetage, And Knightage, Of Great Britain And Ireland For ... Including All the Titled Classes. Whittaker And Company. 1855. p. 552.
- Ellul, Michael (2010). "Malta Limestone goes to Europe: Use of Malta Stone outside Malta". In Joseph F. Grima (ed.). 60th anniversary of the Malta Historical Society: a commemoration. Zabbar: Veritas Press. pp. 371–406. ISBN 978-99932-0-942-3. OCLC 779340904. Archived from the original on 25 March 2019.
- The Annual Peerage of the British Empire. Saunders and Otley. 1829. p. 196.