If you can see their stream, they're live! Otherwise, a purple box indicates the streamer is offline. It's just like if you're looking at your followers list on Twitch!

Note: You need to refresh to see if someone has gone live.
(4/30: Welcome Utai_Mitsumo!)