First, get a copy (digital) of any E body factory service manual, you can download one from mymopar.com.
The short answer to your question is "yes" the window much be removed from the regulator inside the door. You will need to remove the door whisker and the rubber pieces that the front and back of the window slides through at the front and back of the door (where the hinge and latch is). You will need this space to get the window out of the door.
Once you get the window off the regulator, you then have to carefully ease it out of the door. Once out of the door you can turn back to the regulator, there are lots of bolts there and while you "might" not have to remove everything I recommend that you do so that you can fix all the crap that is wrong the first time.
Once everything in unbolted you should be able to remove all of the components.
I cannot stress enough to take many many pictures, before anything is removed and as you remove things. Putting it all back together is a whole other issue but you NEED to follow the FSM exactly, there are no shortcuts and easy way to do it and adjust it.
Good luck