Many auto parts stores will test your battery for free. Worth it to rule in or out the battery as the cause.
A simple test is just turn on the headlights. If they're dim, the battery isn't putting out the juice, or you've got bad/corroded/loose battery cables.