There are banks and cash machines at the airport and all over the city and they are in service 24/7. The nearest bank is at Borgartún 19. You can also use credit cards almost everywhere in Iceland with no minimum charge.
We do not recommend buying Icelandic currency in your home country, you might get a very bad exchange rate since the Icelandic Krona is such a small currency.