If you have a go-wing spoiler, then no, you don't need to remove the brackets from inside the trunk. There is a big Allen head bolt on each side. Take that off, then it will allow you to tilt the spoiler forward to take off the brackets from each side.
Mike