Statistics New Zealand provides many free sources of statistical data.
Census (1996 - 2013)
figureNZ - a trust which cumulates NZ statistics from any sources
19th century statistical publications (Online)
Statistics of New Zealand for the Crown Colony Period, 1840 -1852
Statistics of the Colony of New Zealand, 1873-1906
Statistics of the Dominion of New Zealand 1907-1920