When does a posted speed limit need to be obeyed, when you pass the sign or when you first see it?

Some places have signs advising of an upcoming change, which gives time to slow down, for instance. But my husband insists that as soon as you see a sign announcing a higher rate, it’s OK to speed up right away.