Is the lithium supplement something to take for a short while and then discontinue? Or should I keep taking it forever? Would this be something to try, see what happens, and then evaluate?

If lithium improves your mental health, you should just keep taking it. It usually works pretty quickly for people. So you could take it consistently until the bottle is done. If symptoms improve over that time, you just keep taking it.