Even beginners can benefit from climbing shoes, this is especially true for outdoor rock climbing, where climbing shoes can be considered a necessity.
Some indoor climbing gyms also require all climbers to climb in climbing shoes, even beginners and first-timers, so climbing shoes would be a must in that situation.
To make a point about climbing shoes and getting used to them – it's better to start earlier than later. Climbing shoes are very different from your everyday shoes. They are tight and uncomfortable, at least in the beginning until you get used to them. That's why it's better to just get it out of the way and start wearing them. The sooner you get used to them, the better.