Robert Ker, 3rd Earl of Roxburghe

Ker was the eldest son of four sons born to William Ker, 2nd Earl of Roxburghe and the Honourable Jane Ker, who were first cousins. Among his younger brothers were William Ker, who served as Sheriff of Tweeddale,[1] and John Ker, who later took the surname Bellenden and became 2nd Lord Bellenden of Broughton (after inheriting from their first cousin twice removed, William Bellenden, 1st Lord Bellenden, the son of Sir James Bellenden of Broughton, and Margaret Ker).[2] His only sister, Lady Jean Ker, was married to Colin Lindsay, 3rd Earl of Balcarres, a prominent supporter of James II of England.[3]

Ker's paternal grandparents were John Drummond, 2nd Earl of Perth, and Lady Jean Ker (the eldest daughter of Robert Ker, 1st Earl of Roxburghe).[4] His father's eldest brother was James Drummond, 3rd Earl of Perth.[5] His cousin, James Drummond, 4th Earl of Perth, was created the Duke of Perth in the Jacobite Peerage in 1701.[6] His maternal grandparents were Hon. Harry Ker and Lady Margaret Hay (the only daughter of William Hay, 10th Earl of Erroll and Lady Anne Lyon, daughter of Patrick Lyon, 1st Earl of Kinghorne). After his grandfather died, his grandmother remarried to John Kennedy, 6th Earl of Cassilis.[1]

Upon his father's death in 1675, the 17-year-old Ker inherited the titles and estates as the 3rd Earl of Roxburghe.[7] In 1680, Ker served as Privy Councillor. In 1681, he served as Sheriff Principal of Selkirk, also serving as Sheriff of Roxburgheshire and Baillie of the Regality of Melrose.[1]

On 10 October 1675, Roxburghe was married to Lady Margaret Hay, eldest daughter of John Hay, 1st Marquess of Tweeddale and Lady Jean Scott, the second daughter of Walter Scott, 1st Earl of Buccleuch.[1] Together, they were the parents of:[1]

• Robert Ker, 4th Earl of Roxburghe (c. 1677–1696), who died unmarried.
• John Ker, 5th Earl of Roxburghe (c. 1680–1741), who married Lady Mary Savile, widow of William Savile, 2nd Marquess of Halifax and only child of Daniel Finch, 7th Earl of Winchilsea.[lower-alpha 1]
• The Hon. William Ker (d. 1741), who fought on the Continent under the Duke of Marlborough and was present at the Battle of Sheriffmuir. He served as Groom of the Bedchamber to the Prince of Wales in 1714 and was a Member of Parliament for Berwick and Dysart Burghs.[9]

Roxburghe died on 6 May 1682 when HMS Gloucester ran aground on a sandbank off the Norfolk coast. He was succeeded in his titles by his eldest son, Robert. When Robert died unmarried 14 years later, the title passed to his second son, John, who was created Lord Ker of Cessford and Cavertoun, Viscount of Broxmouth, Earl of Kelso, Marquess of Bowmont and Cessford, and the 1st Duke of Roxburghe on 25 April 1707.[10]