a slight variation on the theme worked well for me for anything down to around 20 degrees and brisk winds.
I have one of the zip-up microfleece shooting sweaters with a wind-proof lining that I wear with some combination of a silk or poly turtleneck and/or thin light weight silk/cashmere, cotton/cashmere sweater (Can be picked up at a discount chain like TJ Maxx, etc real cheap). with decent gloves (I usually use the regular/winter stretch shooting jobbers) and a warm hat I can go around all day in nearly any weather between 20-60 degrees.
Minor adjustments like using a regular weight crew neck all cashmere sweater can also extend that comfortably to lower temps or damp/raw weather.
Without the wind-proof outer sweater I can comfortably go around in mild winds or warm sun in the 40s-upper 60s.
I haven't used the wool wind-proof shooting sweaters but have used the heavier barbour type which can be very nice in the cold but a too much if it warms up a bit.
I mentioned the lightweight cashmere/blend instead of wool since it is warmer and more comfortable in lighter weights and seems to adapt better to a wider range of temps. You can find it fairly cheap alone or in blends. It actualy holds up pretty well as an underlayer. Of course, you can always strip off the outer layers and go out do dinner later.
FWIW.
