Pure Translation isn't an Accurate Motion Model

I just figured I'd give it a try. This problem would have been very easy if was. In the following images, shadowy white parts are bad

Affine (the best so far) image subtraction

Pure Translation image subtraction

Sum of square differences increased 50%