if you are using the Rigidbody then freeze the rotation and position in rigidbody constrains this thing worked for me