Just for a Thrill is the twenty-fourth studio album, produced by Ronnie, Jerry Sharell and Rob Galbraith. It was released in 2004 under Image Records, his first for the label. The album consisted of fourteen recordings of pop and jazz standards.
The record peaked at number 11 on Top Jazz Albums, Milsap’s first appearance on the chart. Allmusic gave the album four stars, commenting that “Milsap’s voice is in great shape.” The review cited the tracks, “Bewitched, Bothered and Bewildered,” “Haunted Heart,” “Ev’ry Time We Say Goodbye,” “In the Wee Small Hours of the Morning,” and “Since I Fell for You” as being “complemented” by Milsap’s “vocals and piano.”