The glow comes from glow sticks. The color comes from different colored syrups. If you don't have the different color syrups, I bet you can just buy those long ice pops (the kind you can get 25 for $3 in WalMart) and just shave them down to get different color ices. This would even be a fun idea for Halloween.
To get the complete how-to visit here.