Following @jreback #24415 (comment), we should deprecate the box argument in to_datetime and to_timedelta and only return pandas data structures. There already exists options to convert to numpy data structures via .values or to_datetime64/to_timedelta64