removing the center console

ok i wanted to remove the center console (if I didnt get the terminology rite. it is the section where the arm rest is) to change my carpet...I unscrew the four screws...but somehow I cant seem to yank the thing off...I dont want to pull it out any harder because I am afraid I might break it. It's there any other screw from it that i'm missing?