That's right! Remove the drain stop (or even work around it if yours doesn't easily come off), then use the skinny end to grab the clumps of hair (and slimy stuff) and pull it out.
See? Yuck. But it works great. Be sure to dispose of the gross stuff in either the toilet or trash can - don't just wash it down the shower drain (again, I speak from experience).