Skip to content

chore: consolidate PyarrowVersions helpers #1679

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 16 commits into from
Oct 18, 2023
Merged

chore: consolidate PyarrowVersions helpers #1679

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
96aa245
chore: consolidate pyarrow helpers
Linchin Oct 9, 2023
cc9918d
complete refactor
Linchin Oct 9, 2023
9804f3f
Merge branch 'main' into pyarrow
Linchin Oct 9, 2023
4e54c0f
consolidate pyarrow version checking usage
Linchin Oct 9, 2023
ae5a434
add unit tests
Linchin Oct 9, 2023
fb9aa5f
Merge branch 'googleapis:main' into pyarrow
Linchin Oct 9, 2023
76b5cd0
fix unit_noextras testing error
Linchin Oct 9, 2023
d0f8e42
fix tests
Linchin Oct 10, 2023
4c3adef
Merge branch 'main' into pyarrow
Linchin Oct 11, 2023
6e8d8a5
Merge branch 'main' into pyarrow
Linchin Oct 13, 2023
465e378
address comments
Linchin Oct 14, 2023
ab266a7
fix tests
Linchin Oct 16, 2023
1903dae
coverage
Linchin Oct 16, 2023
b6cec08
accept suggestion
Linchin Oct 17, 2023
0b827e0
accept suggestion
Linchin Oct 17, 2023
c1b8d0d
address comments
Linchin Oct 17, 2023
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
coverage
  • Loading branch information
@Linchin
Linchin committed Oct 16, 2023
commit 1903dae12d4fc02f3d10ed5117cf43be901b7a9b
2 changes: 0 additions & 2 deletions google/cloud/bigquery/_pyarrow_helpers.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,6 @@ def pyarrow_timestamp():
"STRING": pyarrow.string,
"TIME": pyarrow_time,
"TIMESTAMP": pyarrow_timestamp,
"BIGNUMERIC": pyarrow_bignumeric,
}

_ARROW_SCALAR_IDS_TO_BQ = {
Expand All @@ -94,7 +93,6 @@ def pyarrow_timestamp():
pyarrow.string().id: "STRING", # also alias for pyarrow.utf8()
# The exact scale and precision don't matter, see below.
pyarrow.decimal128(38, scale=9).id: "NUMERIC",
pyarrow.decimal256(76, scale=38).id: "BIGNUMERIC",
}

# Adds bignumeric support only if pyarrow version >= 3.0.0
Expand Down