Ideally an insurance policy should provide cover which suits your needs at a price you can afford. However, you should avoid buying insurance based on cost alone as you could be disappointed when you want to claim - either with the cover or the service the insurance company can provide.
As a general rule you should:
Identify the type of cover you want, the level of cover you require (sum insured/area based), any special requirements you may have (e.g. special cover for collections, etc.) and what you can afford to pay for that cover. The cover provided by different policies considerably. If you know what cover you require you can save a lot of time and effort if you look only at policies which equal or better your requirements.
Replacement, area based policies allow for fluctuations and increases in the cost of building materials over time. If you already have insurance but want to review it's adequacy, ask your insurer about the level of your existing cover and details of any revised policies or discounts.
It is also sensible to review the levels of excess that will apply to any claims you might make. Often you can afford wider cover by taking advantage of discounts such as those available if you pay more of the loss yourself (this is called a voluntary excess).
Always ensure you are receiving quotes on a "like for like" basis.
If you are quoted a premium substantially cheaper than what you are paying now or than you have been quoted elsewhere, it is possible that you will not be receiving the same cover. For example, some companies use sum insured that is 'inclusive of GST' while others are 'exclusive of GST'.
Ensure that you are comfortable with the financial strength of the company that underwrites your policy.