Stone Temple Pilots kicked off their first tour with new frontman Jeff Gutt at The Canyon in Santa Clarita, CA on Friday night. The singer—a former X Factor contestant—joined the band late last year following the death of vocalist Chester Bennington, who had himself replaced founding vocalist Scott Weiland after he parted ways with STP in 2013 (Weiland also died of a drug overdose in 2015).

While many fans were interested to see how Gutt meshed with the band in a live setting, the night’s big treat was a surprise appearance by famed actor and Hollywood Vampires guitarist Johnny Depp. The three-time Academy Award-nominee joined Stone Temple Pilots for an encore that included their 1992 debut single “Sex Type Thing” and a rendition of MC5’s proto-punk classic “Kick Out The Jams” that featured an additional sit in from MC5’s own Wayne Kramer.

Stone Temple Pilots’ first full show with Gutt also offered the band a chance to dive into some of its more recent material like the new Gutt-led single “Meadows” and a debut rendition of “Roll Me Under,” a track from the band’s forthcoming self-titled album. However the concert primarily stuck to the classic Stone Temple Pilots catalog, even showcasing mid-career rarities like “Regeneration” and “Glide”.

Stone Temple Pilots with Johnny Depp – “Sex Type Thing”

[Video: james cedro]

Stone Temple Pilots with Johnny Depp & Wayne Kramer – “Kick Out The Jams”

[Video: J Simsta]