1855 the vacant block was owned by A Gill.
1868 house built for leather merchant Michaelis Hallenstein. His company of Michaelis, Hallenstein was operated with his brother his brother Isaac, who lived at Woonsocket down the hill, and uncle Moritz Michaelis, who lived at Linden in Acland Street in the same period.
Rate books show that the property next door was owned and occupied by Kate Hart, reportedly his mother-in-law (though her name was Isabella Hart). By 1876 it was occupied by Bryan O'Loghlen and called Manhattan, and ads from 1868 for servants for Manhatten Villa show that Isabella, whose family was from New York, named the house. It has been said that the two properties were designed to complement each other. That house was later called Chelmsford, and also still exists behind an interwar brick front.
In 1874 the Hallenstein sold the contents of the house prior to a return trip to Europe, and in 1875 Phillip Hayman, a wholesale jeweller, was the new occupant. In 1877 he commissioned the fence and gates, with the new name of the house - Pyrmont - in raised lettering, and died the next year.
By 1880, John Tanner had bought the property and leased it to Flora Timms, who lived there until 1886. Subsequent owners included George McGillvray who lived there in 1890, and James Pearson of Toorak who leased the house to the music salesman George Clark Allan in 1900.
In 1915 flats and single rooms at Pyrmont began to be advertised.
A photo taken in 1966 identifies it as a boarding house, later becoming a rooming house. It was aquired in 2005 by Housing First, and redeveloped into 35 self contained apartments.