Personally, I use cruise control to maintain my speed most of the time, which makes this easier.
You do what you have to do regardless. I like to simply let off the gas and coast down to speed limit but often times that's not possible so I brake those times.
As my dad said when teaching my mom to drive, slow up. She would hit the brakes and he would yell " I said slow up not slow down"! By that he meant to let up on the accelerator pedal.
Constantly stepping on the brakes to maintain speed is the true sign of an amateur .
Let go
depends on presence of police