When you say "small handful" the answer is going to be manually. Doing this through BAT would require you to export the phone with all details, make the modifications in Excel, and then re-import the phone, overwriting the existing configuration. If you're talking dozens or hundreds, then BAT makes more sense. Messing around with a gigantic, and I mean hundreds of columns, CSV file just to tweak the Line Text Label of a few speed dials/BLFs isn't worth it IMO.
Please remember to rate helpful responses and identify helpful or correct answers.