Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
ca83d5e
ENH: improve performance of df.to_csv GH3054
Mar 15, 2013
d46fa22
ENH: to_csv using masking to simplify dtype processing
jreback Mar 15, 2013
7c67776
ENH: more perf tweaks in df.to_csv
Mar 16, 2013
9349681
PERF: cythonized parts of to_csv for increased perf
jreback Mar 15, 2013
10857b0
PERF: more cython tweaks
jreback Mar 16, 2013
6d4e0bb
PERF: cythonize improved python version
Mar 16, 2013
7ac83eb
PERF: cythonized parts of to_csv for increased perf
jreback Mar 15, 2013
d78f4f6
PERF: more speedups
jreback Mar 16, 2013
55adfb7
ENH: add chunksize parameter to DataFrame.to_csv to enable constant m…
jreback Mar 16, 2013
dcc45a7
CLN: move repeated cast out of loop
Mar 16, 2013
5a7c28d
CLN: make guard more defensive
Mar 16, 2013
ba62066
REF: add com._ndarray_to_native_types
jreback Mar 16, 2013
6c6f6cf
REF: apply native type conv to ix, cols before write_csv
Mar 16, 2013
51793db
PERF: added frame_to_csv2 vbench, revised frame_to_csv_mixed
jreback Mar 16, 2013
bb7d1da
TST: test for to_csv on failing vbench
jreback Mar 17, 2013
71cb70d
ENH: refactor series from dict to list, eliminate one level of indire…
jreback Mar 17, 2013
7dc5f92
ENH: replace variable lookup by constant .
Mar 17, 2013
66e38f9
ENH: make chunks process constant element count
jreback Mar 17, 2013
20d3247
PERF: avoid iteritems->iloc panelty for data conversion, use blocks
Mar 17, 2013
67ca8ae
TST: test for to_csv on failing vbench
jreback Mar 17, 2013
0995208
CLN: csv refactor
jreback Mar 17, 2013
7776128
ENH: add (undocumented) legacy kwd to df.to_csv, just in case
Mar 18, 2013
0e42e46
TST: fail early on duplicate columns
jreback Mar 18, 2013
616347c
CLN: preallocate data array only once
Mar 19, 2013
87a391e
TST: test the hell out of the new df.to_csv()
Mar 19, 2013
22f258f
BUG: MultiIndex to_native_types did not obey slicer
Mar 19, 2013
4d9a3d3
DOC: update what's new, RELEASE.rst
Mar 19, 2013
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
REF: add com._ndarray_to_native_types
  • Loading branch information
jreback authored and y-p committed Mar 16, 2013
commit ba620668ef46c245dbd1e557ab7faa2d8eef3edc
21 changes: 21 additions & 0 deletions pandas/core/common.py
Original file line number Diff line number Diff line change
Expand Up @@ -101,6 +101,27 @@ def _isnull_old(obj):

_isnull = _isnull_new

# float format is a bit of out of place here,
# but we'd like to reuse the mask.
def _ndarray_to_native_types(v,na_rep='',float_format=None):
mask = isnull(v)
imask = -mask

if v.dtype == 'datetime64[ns]' or v.dtype == 'timedelta64[ns]':
values = np.empty(len(v),dtype=object)
values[mask] = 'NaT'

if v.dtype == 'datetime64[ns]':
values[imask] = np.array([ val._repr_base for val in v[imask] ],dtype=object)
elif v.dtype == 'timedelta64[ns]':
values[imask] = np.array([ lib.repr_timedelta64(val) for val in v[imask] ],dtype=object)
else:
values = np.array(v.values,dtype=object)
values[mask] = na_rep
if issubclass(v.dtype.type,np.floating):
if float_format:
values[imask] = np.array([ float_format % val for val in v[imask] ])
return values.tolist()

def _use_inf_as_null(key):
'''Option change callback for null/inf behaviour
Expand Down