Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: support Ibis tables (dataframes) #215

Open
lostmygithubaccount opened this issue Jan 12, 2024 · 4 comments · May be fixed by #217
Open

feat: support Ibis tables (dataframes) #215

lostmygithubaccount opened this issue Jan 12, 2024 · 4 comments · May be fixed by #217

Comments

@lostmygithubaccount
Copy link

Ibis is a portable Python dataframe library, initially created by the same creator of pandas. Today, it's a well-maintained project that supports 20+ backends including pandas, Polars, Dask, Snowflake, Spark, Oracle, BigQuery, etc.

Ibis tables (dataframes) have to_pandas() and to_pyarrow()/to_pyarrow_batches() methods, so you could already use it with itables, but it'd be good to have more official support and documentation

motivation for this request is that I want to switch over our Ibis analytics dashboard from a Streamlit app to a Quarto dashboard, and perhaps put it directly on the Ibis website
@mwouts
Copy link
Owner

mwouts commented Jan 12, 2024

Hi, thanks for suggesting this! That's very interesting, and yes I would be very happy to provide support for Ibis. Quick questions for you:

  • Would you like to see the column type displayed? Currently we don't show it, but it would make sense to add an option to show it for Ibis and Polars
  • Are the columns always a list? I mean, there is no complex/nested columns? No index neither?

@mwouts mwouts linked a pull request Jan 12, 2024 that will close this issue
Draft
@lostmygithubaccount
Copy link
Author

Would you like to see the column type displayed? Currently we don't show it, but it would make sense to add an option to show it for Ibis and Polars

I think that would make sense, it's easy to get the data type. Ibis has its own type system that maps to all the backends

Are the columns always a list? I mean, there is no complex/nested columns? No index neither?

Ibis does not itself maintain an index, but some of the backends it support does (perhaps only pandas and Dask?)

there are nested datatypes if the backend supports it

@mwouts
Copy link
Owner

mwouts commented Feb 10, 2024

To make this happen I would need some hints on the associated PR #217. Thanks!

@lostmygithubaccount
Copy link
Author

I'll ask the team to take a look!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add support for Ibis mwouts/itables
2 participants
@mwouts @lostmygithubaccount