This is years old, but in case it's relevant to anyone else, and since I didn't actually see the solution anywhere, I'll add it.
I believe, for this OP, all he needed to do was configure binfmts, simply by running:
update-binfmts --enable qemu-arm After running this, chroot into the arm filesystem would have been possible.