Arsenal dropped points for just the second time this season in a frustrating 1-1 draw for the Gunners at Southampton as Aston Villa responded to the sacking of Steven Gerrard with a 4-0 thumping of Brentford.
Mikel Arteta's side went in front through Granit Xhaka's first-half strike at St Mary's.
But Armstrong levelled after the interval as Arsenal paid the price for failing to convert several chances to increase their advantage.
It was a rare slip from the Gunners, who had won nine of their 10 previous league games this season, with their only defeat coming at Manchester United.
The end of Arsenal's eight-game winning run in all competitions leaves them two points clear of second-placed Manchester City with both having played 11 games.
While Arteta will be frustrated that Arsenal squandered the lead given to them by Swiss midfielder Xhaka, it is a tribute to his team's unexpected rise this season that failing to take maximum points ranks as a disappointment.
Arsenal have already proved they are a force to be reckoned with as they chase a first title since 2004 and they started in vibrant mood on the south coast.
Bukayo Saka's cross was inches away from Gabriel Magalhaes before Gabriel Martinelli caused havoc in the Southampton defence with a direct run that ended with Xhaka's powerful drive repelled by Gavin Bazunu.
Xhaka turned provider moments later when he teed up Martin Odegaard for a low strike that whistled wide from the edge of the area.
Arsenal were in complete control and Xhaka delivered the goal their pressure merited in the 11th minute.
It was a smooth move as Saka's backheel sent Ben White away down the right flank and his cross reached Xhaka, who crashed a blistering strike into the roof of the net from 12 yards.
Arsenal had never lost when Xhaka scored, a sequence stretching to 17 games.
Gabriel Jesus was inches away from doubling Arsenal's lead when he shot into the side-netting from Odegaard's pass.
Bazunu left Jesus frustrated again just before half-time as the Brazilian reached Odegaard's lofted pass for a volley that the Saints keeper blocked at point-blank range.
Mohamed Elyounoussi's last-ditch tackle stopped Jesus in his tracks after the Arsenal striker sprinted clear on goal.
But, for all their territorial dominance, Arteta's team couldn't land the knockout blow an they were hit with a sucker punch in the 65th minute.
Elyounoussi slipped a clever reverse pass through the heart of the Arsenal defence and Armstrong timed his run perfectly to slot a composed finish past Aaron Ramsdale.
With Southampton suddenly in the ascendancy, Joe Aribo tested Ramsdale with a low shot and Romain Perraud swivelled to drill wide.
Odegaard thought he had won it in the 79th minute when the Dane smashed home from Kieran Tierney's cross but the goal was disallowed because the ball had run out of play.
Leeds into bottom three
Former Liverpool captain Gerrard was the fall guy for Villa winning just two of their opening 11 league games with a 3-0 defeat at Fulham on Thursday the final straw.
Caretaker manager Aaron Danks did not shy away from big decisions as captain John McGinn was dropped to the bench and got an immediate reaction.
Leon Bailey fired Villa in front after just two minutes before the Jamaican teed up Danny Ings to make it 2-0.
Ings then added a third inside 14 minutes from the penalty spot before Ollie Watkins rounded off the scoring in the second half.
Wolves are not enjoying the same success under their caretaker boss Steve Davis as Leicester moved out of the relegation zone with a 4-0 win at Molineux.
Youri Tielemans' stunning strike that dipped into the top corner got the Foxes off to a flying start before Harvey Barnes' cool finish doubled the lead for Brendan Rodgers' men.
James Maddison and Jamie Vardy sealed Leicester's first away win against a side still in the Premier League for a year in the second half.