Skip to content

BUG: Fix groupby observed=True when aggregating a column #24412

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Dec 31, 2018
Merged

BUG: Fix groupby observed=True when aggregating a column #24412

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
debb02a
GH23970 Added test-case that causes bug 23970
Koustav-Samaddar Dec 24, 2018
f450dc2
GH 23970 Fixed source of the bug
Koustav-Samaddar Dec 24, 2018
3b50900
GH23970 Added relevant docstring to whatsnew
Koustav-Samaddar Dec 24, 2018
e6e9894
Made requested change to docstring
Koustav-Samaddar Dec 24, 2018
5181639
Made requested changes to tests
Koustav-Samaddar Dec 24, 2018
4c68d41
Fixed typo from incomplete find/replace
Koustav-Samaddar Dec 25, 2018
77cf3c6
Fixed pep8 violation
Koustav-Samaddar Dec 25, 2018
572d9c3
Fixed pep's E128 violation
Koustav-Samaddar Dec 25, 2018
8793995
Fixed another possible pep violation
Koustav-Samaddar Dec 25, 2018
b75bc7b
Fixed whatsnew entryto meet in the middle
Koustav-Samaddar Dec 26, 2018
ef48de6
Merge branch 'master' into bug-23970
Koustav-Samaddar Dec 26, 2018
d87e159
Test has been modified to have parameterised as_index
Koustav-Samaddar Dec 28, 2018
b01d809
Fixed pep8 issues in test file
Koustav-Samaddar Dec 28, 2018
7a6898f
Made recommended change to whatsnew
Koustav-Samaddar Dec 28, 2018
d584327
Merged for git pull
Koustav-Samaddar Dec 28, 2018
3e9178a
Changed test to use assert_equal
Koustav-Samaddar Dec 31, 2018
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Made requested change to docstring
  • Loading branch information
@Koustav-Samaddar
Koustav-Samaddar committed Dec 24, 2018
commit e6e989444637dfd69be538f1200619e9aac4ef74
2 changes: 1 addition & 1 deletion doc/source/whatsnew/v0.24.0.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1560,7 +1560,7 @@ Groupby/Resample/Rolling
- Bug in :meth:`pandas.core.groupby.GroupBy.rank` with ``method='dense'`` and ``pct=True`` when a group has only one member would raise a ``ZeroDivisionError`` (:issue:`23666`).
- Calling :meth:`pandas.core.groupby.GroupBy.rank` with empty groups and ``pct=True`` was raising a ``ZeroDivisionError`` (:issue:`22519`)
- Bug in :meth:`DataFrame.resample` when resampling ``NaT`` in ``TimeDeltaIndex`` (:issue:`13223`).
- Bug in :meth:`DataFrameGroupBy._gotitem` where `observed` parameter was not passed properly, causing subsequent function calls that rely on `observed` to misbehave if called with ``observed=True`` (:issue:`23970`)
- Bug in :meth:`DataFrame.groupby` did not work correctly with ``observed=True`` when aggregating a specified column (:issue:`23970`)
Copy link
Contributor

@jreback jreback Dec 26, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is when its a categorical column; also this is only for as_index=False, right?
Copy link
Contributor Author

@Koustav-Samaddar Koustav-Samaddar Dec 26, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any operation over a selected column was effectively ignoring the observed parameter that was being passed to it. With as_index=True the observed value isn't used so the code behaves as expected.

Reshaping
^^^^^^^^^
Expand Down