Like anything rewarding, building a fan base is no different. If listener numbers are all a DJ cares about, then that DJ might not be doing the right thing (Not saying this is you, just in general). I remember when I started the first station in the MKProductions family of stations, MIXX 94.1 back in 1997. I would sit around in my free time DJing pretty much every second of it. I would have about 1 listener the whole time. I made sure never to get discouraged. I kept on DJing, and working on the station very much each and every day.
I really do enjoy your show, from what I cought of it last night, it was awesome. If you're thinking about stopping, you may want to give it a little bit longer before you make a big decesion like that. Plug your show other places than just Tranceaddict. There are hundreds of forums over the internet that have to do with trance, DJing, etc.
Just my insight.
-Mark
P.S. I was looking at the numbers last night before and after your show. Right as your show started, the number of listeners was 9 times greater than before you started.