Change professions until you are bigger. You won't be able to kill barbs for a long time. Hunting is better to start for the extra sparks drops. Fishing and Farming are easier if you are looking for buff supplies.

Thought of another way that might work for you Fenron, If you start the fight, a bigger player can help you. It'll cost them a BC sphere, but they will get Valor for it, so if you have a big friend that doesn't mind spending the silver you can kill the barbs together. You might not keep the mine long, barbs and other players can take them from you, but it's another way to get it done.