I'd definitely stay in the centre of Reykjavik as you can just get bus trips everywhere else of note. Definitely do the northern lights if you can (not always visible you have to be lucky), blue lagoon and much as you can. We were only on a small break but there was loads we didn't do like go see natural geysers and go whale watching etc. Really want to go again asap.