Door panel won't go back on correctly...

I tried putting my door panel on after trying ot fix my windows, and the top part, won't slip down back into place. and the tweeter really gets in the way, so i took it off,a dn now i can't put it back on, unless i takea my door panel off, GOD! how do you put the door panel on correctly again?