If you want to stay in plane with your putting stroke, the secret is to think about your shoulders initiating the movement as if they are the engine making the stroke. This will prevent you from trying to initiate your stroke by using your hands or arms to take the putter back, which can result in an out of plane swing path.
To be sure you are putting in plane, use The Frog Stick.