deps: Add support for Python 3.13 for everything but remote functions

[arwas11]

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

• Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
• Ensure the tests and linter pass
• Code coverage does not decrease (if any source code was changed)
• Appropriate docs were updated (if necessary)

Fixes #393138101 🦕

[tswast]

Re: unit-3.13 failures,

ERROR scripts/test_publish_api_coverage.py::test_api_coverage_produces_expected_schema - NameError: name 'sklearn' is not defined ERROR scripts/test_publish_api_coverage.py::test_api_coverage_produces_missing_parameters - NameError: name 'sklearn' is not defined 

Let's skip these tests if scikit-learn is not installed. You can use the pytest.importorskip("sklearn") function.

[tswast]

Getting "400 Runtime 'python313' is not supported." on remote functions tests. Let's skip those tests on Python 3.13 for now.

Edit: See supported runtime: https://cloud.google.com/functions/docs/runtime-support#python

[tswast]

e2e failures:

FAILED tests/system/small/test_series.py::test_series_bool_bool_operators_scalar[False-other_scalar2-and] FAILED tests/system/small/test_series.py::test_series_bool_bool_operators_scalar[False-other_scalar2-or] FAILED tests/system/small/test_series.py::test_series_bool_bool_operators_scalar[False-other_scalar2-xor] FAILED tests/system/small/test_remote_function.py::test_remote_function_application_repr FAILED tests/system/small/test_remote_function.py::test_remote_function_direct_no_session_param FAILED tests/system/small/test_remote_function.py::test_df_apply_axis_1 - goo... FAILED tests/system/small/test_remote_function.py::test_remote_function_direct_no_session_param_location_specified FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_applied_after_filter[apply] FAILED tests/system/small/test_remote_function.py::test_df_apply_axis_1_ordering FAILED tests/system/small/test_remote_function.py::test_remote_function_direct_no_session_param_location_project_specified FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_applied_after_filter[map] FAILED tests/system/small/test_remote_function.py::test_df_apply_axis_1_multiindex FAILED tests/system/small/test_remote_function.py::test_remote_function_direct_session_param FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_applied_after_filter[mask] FAILED tests/system/small/test_remote_function.py::test_df_apply_axis_1_unsupported_dtype FAILED tests/system/small/test_remote_function.py::test_remote_function_via_session_default FAILED tests/system/small/test_remote_function.py::test_remote_function_binary_applied_after_filter FAILED tests/system/small/test_remote_function.py::test_remote_function_via_session_with_overrides FAILED tests/system/small/test_remote_function.py::test_remote_function_nary_applied_after_filter FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_partial_ordering_mode_assign[apply] FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_partial_ordering_mode_assign[map] FAILED tests/system/small/test_remote_function.py::test_remote_function_unary_partial_ordering_mode_assign[mask] FAILED tests/system/small/test_remote_function.py::test_dataframe_applymap - ... FAILED tests/system/small/test_remote_function.py::test_remote_function_binary_partial_ordering_mode_assign FAILED tests/system/small/test_remote_function.py::test_dataframe_applymap_explicit_filter FAILED tests/system/small/test_remote_function.py::test_remote_function_nary_partial_ordering_mode_assign FAILED tests/system/small/test_remote_function.py::test_dataframe_applymap_na_ignore FAILED tests/system/small/test_remote_function.py::test_series_map_bytes - go... FAILED tests/system/small/test_remote_function.py::test_skip_bq_connection_check FAILED tests/system/small/test_remote_function.py::test_read_gbq_function_like_original 30 failed, 2484 passed, 8 skipped, 42 xfailed, 2 xpassed, 713 warnings, 23 retried in 2864.77s (0:47:44) nox > Command py.test --quiet -n=20 --timeout=900 --durations=20 --junitxml=system_noextras_3.13_sponge_log.xml tests/system/small failed with exit code 1 nox > Session system_noextras failed. 

Need to update system_noextras to use Python 3.12, too.

[tswast]

doctest failed a package installation step. I'll retry the job.

[tswast]

notebook failure notebooks/remote_functions/remote_function_vertex_claude_model.ipynb not related.

[tswast]

e2e tests are passing!

notebook failure actually does look related this time:

FAILED notebooks/remote_functions/remote_function_vertex_claude_model.ipynb::remote_function_vertex_claude_model.ipynb - InvalidArgument: 400 Runtime 'python313' is not supported. Supported runtimes 

Some options:

It may be worth adding a check for Python 3.13 at the top of these notebooks:

Failed: getting_started/getting_started_bq_dataframes.ipynb Failed: location/regionalized.ipynb_asia-southeast1 Failed: location/regionalized.ipynb_eu Failed: location/regionalized.ipynb_europe-west4 Failed: location/regionalized.ipynb_southamerica-west1 Failed: location/regionalized.ipynb_us-central1 Failed: location/regionalized.ipynb_us Failed: remote_functions/remote_function.ipynb Failed: remote_functions/remote_function_usecases.ipynb Failed: remote_functions/remote_function_vertex_claude_model.ipynb 

If it is Python 3.13, then exit early with sys.exit(0). We can have a comment saying that Python 3.13 is not yet a supported runtime and to watch https://cloud.google.com/functions/docs/runtime-support#python for support for remote functions.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB