Bittersweet began in mid-2004 with 2 members who had the same musical interests. Both played in an Ipoh band before, and got to know each other well during that time. Herri and Zabil occasionally met to hangout and eventually decided to try their hand at writing music together. Both heavily influenced by British music, the two decided to put their heads together and record an EP, just for fun.
After the recording was completed Herri and Zabil distributed the material for feedback, which was mainly positive. When Zabil joined the Malaysian teaching force he had to quit the band, which left Bittersweet with only one of its founding members. Determined not to abandon what they started, Herri set about forming a complete line-up, particularly considering they'd been invited by Pet Projects to perform at Couple's EP launch. He enlisted Dinie as their bassist first of all, before adding Hafiez (guitarist) to the line-up, Pijie as Bittersweet's vocalist with Emai ..boards. Bittersweet finished recording their 2nd EP (Night and Morning Tales) on November 2004. They?ve been invited for shows at PISA Penang on January 2005. The feedback of the 2nd EP and the shows at Penang which were more massive than before. Bittersweet have been invited for plenty of shows after that in KL and Penang.