Lady Gaga was in the house for the surprise Rolling Stones concert Thursday night (Oct. 19) at Racket in New York City to celebrate the release of the new album, Hackney Diamonds.

The Stones played material from the new record with Gaga joining the band for the song, “Sweet Sounds of Heaven.” Gaga appears on the track along with Stevie Wonder on the album.

Other celebrities at the show included: Chris Rock, Jimmy Fallon, Daniel Craig and his Oscar winning actress wife Rachel Weisz, Elvis Costello, Mary Kate Olsen, Diana Krall, Trevor Noah, and producer Tony Visconti, who posted that he left the show early because it was getting too late and the DJ was too loud.

The Stones performed “Shattered,” “Angry,” “Whole Wide World,” “Tumbling Dice,” “Bite My Head Off,” “Jumpin’ Jack Flash,” and their shared track with Gaga. 

Hackney Diamonds is out today.