In the PDF they say the battery gets updated along with the Phantom update itself. But what if you are on the latest version, but purchase a second battery? Can you update that one?
No updates have been released for batteries yet. The easiest way to update additional batteries is to always keep the firmware in the root of your memory card. If the firmware is found, it'll be installed on additional batteries as you use them.