Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PostgreSQL support #299

Open
chinmayshah99 opened this issue Sep 16, 2020 · 0 comments
Open

Add PostgreSQL support #299

chinmayshah99 opened this issue Sep 16, 2020 · 0 comments
Labels
Status: Available 👋 Available for assignment, who wants it? Type: Discussion 🔈 When further discussion and debate is required Type: Epic 🤙 Describes a large amount of functionality that will likely be broken down into smaller issues

Comments

@chinmayshah99
Copy link
Member

Description

Right now, to load data into pydp, the way to use load it manually using pandas or some other method and then apply DP operations by passing it to a list.
A good way to use is to enable postgres support within DP so you don't have a scope of opening up a list.

In google's repo, they have added a postgres extesnsion. While this works in the DB, in the code, it becomes bit difficult to use.

What we could do is build support on top of the psycopg2 module, thus the SQL operations would be DP compliant.

Breakdown

What can be done is we disable Sum, Count operation from psycopg2 and define our custom functions so in no-case shall privacy be violated.

Who else?

We might need research team support for SQL queries but doesn't seem likely for statistical functions.

@chinmayshah99 chinmayshah99 added Type: Epic 🤙 Describes a large amount of functionality that will likely be broken down into smaller issues Status: Available 👋 Available for assignment, who wants it? Type: Discussion 🔈 When further discussion and debate is required labels Sep 16, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: Available 👋 Available for assignment, who wants it? Type: Discussion 🔈 When further discussion and debate is required Type: Epic 🤙 Describes a large amount of functionality that will likely be broken down into smaller issues
Projects
None yet
Development

No branches or pull requests

1 participant