"Kiss" is renowned for its sparse instrumentation, featuring mainly a drum machine, finger snaps, and a pulsating bass line. Prince deliberately stripped down the arrangement to highlight the infectious groove and his falsetto vocals. This minimalist approach was a departure from his earlier work, showcasing Prince's versatility as an artist and his ability to experiment with different musical styles.