I used to have chronic pain in my lower back. I got really good at 'popping' it like the OP described and in other ways. Always it only gave relief for a few minutes. Finally I found out about doing back bridges. I've heard negative things about it, and you do need to be careful and work your way in to it slowly, but it has really worked for me. Cured my sore back, and now whenever I stress my back and start feeling a twinge down there, I do bridges for a couple of days and it clears right up.
To do it, you lay on your back, bend your knees to draw your feet up as far as is comfortable. Then you reverse your hands and place your palms on the floor to each side of your head- your fingers should point towards your shoulders. Then you gently push up and arch your back, pointing your hips toward the celing. Only go as far as is comfortable, and only hold it as long as is comfortable. This isn't about "no pain, no gain"- if it hurts very much at all, you're going to far. Do 3-4 of these morning and evening, slowly increasing the arch in your back and the length of time of the stretch until you're pain free.
Again, it's not for everyone, but it sure has worked miracles for me.