After climbing for about a month, I'd say yes... it definitely helps.
When I first started, I used a chalk ball. They're great because they keep the chalk contained and don't make too much mess. The only downside is that I always found myself having to squeeze the ball two or three times before I had enough coverage on my hands.
I've recently switched over to powdered chalk, and for me it's been a much better experience. It gives your hands a really good coating, feels incredibly soft, and most importantly, gives you that extra bit of grip when you're holding onto the wall.
I'd also recommend getting yourself a chalk bag that clips around your waist. If your hands start getting sweaty halfway through a climb, you can simply dip your hand into the bag and top up your chalk before carrying on.
I'm still fairly new to climbing, so I'm sure my opinions will change as I gain more experience. But for now, powdered chalk gets my vote.
The next stage is using liquid chalk!