How to set pandas or duckdb backend in ibis memtable?

Question

I have a function like this:

import ibis def my_function(df): t = ibis.memtable(df) t = t.mutate(ibis._['a'] + 1) return to.to_arrow()

My question is - if I pass it a pandas dataframe, then which backend is t going to use to do its calculations? The pandas one, or the duckdb one (which the docs say is the default)?

Also:

how do I force it to use the pandas backend?
how do I force it to use the duckdb backend?

Note that my_function needs to receive a dataframe as input, I can't change that. But inside my_function, I'd like to use Ibis.

You are correct that you can set the backend to use with set_backend -- note that without that, DuckDB is the default backend. In terms of needing to receive a dataframe as input, all of our backends can use Pandas DataFrame as an input format, you don't need to use the pandas backend for this (and in fact, we recommend using DuckDB, it will be faster) — Gil Forsyth
– Gil Forsyth, Commented Sep 17, 2024 at 17:34

ignoring_gravity · Accepted Answer · 2024-06-17 17:42:39Z

2

I think I found it, you can explicitly set

ibis.set_backend('pandas')

or

ibis.set_backend('duckdb')

answered Jun 17, 2024 at 17:42

ignoring_gravity

11.1k7 gold badges45 silver badges99 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to set pandas or duckdb backend in ibis memtable?

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related