• I have checked that this issue has not already been reported.

• I have confirmed this bug exists on the latest version of pandas.

• (optional) I have confirmed this bug exists on the master branch of pandas.

Note: Please read this guide detailing how to provide the necessary information for us to reproduce your bug.

Code Sample, a copy-pastable example

DataFrame(["foo", "bar", "baz"]).astype(bytes)

As discussed in #39484 we do not want to get numpy string dtypes here. This should have dtype object