If you are using a rigid body, then freeze the rotation and position under the rigid body constraints. This worked for me.