'98 gmc sierra c1500 4.3L starts but won't continue running?

I've recently replaced heater hose connector and intake manifold gasket due
to coolant leaks. Prior to that it would turn over but not start. That fix was a
new cap and rotor after having changed coil, ign, module, and spark plugs.
It's been running fine for a week and I knew the battery had been getting
weak. This morning it started fine but I noticed lights were dim and volt meter
was way low.
I turned around after a mile down the road and took the wifes car to work.
Got a new battery installed and started immediately but dies right away.
Does this each time I try it...