First, figure out if you need the extra money, or want the extra money. There's a big difference between need and want.

If you need the extra money, then the decision is made. Get a higher paying job and suffer what you have to for it.

If you merely want the extra money, then you need to make the decision at a bit deeper level.

One point to keep in mind in any decision like this, is that stress (easily caused by an unpleasant job) is expensive. It can do amazing things to boost your medical expenses, just for one thing. And an unpleasant work environment can easily spill over into your personal life.

But, regardless, the first calculation is need/want on the extra money. You'll need to budget, plan, and do the math.