Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Standard library of custom BigQuery functions #27

Open
rviscomi opened this issue Jul 18, 2022 · 1 comment
Open

Standard library of custom BigQuery functions #27

rviscomi opened this issue Jul 18, 2022 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@rviscomi
Copy link
Member

BigQuery supports dataset-level custom functions that are publicly reusable. This can be a useful way to abstract away boilerplate SQL needed for common routines. Here's an example of a query that generates custom functions for CWV analysis. We could also write functions for other HA-centric use cases like URL manipulation, HTTP header parsing, etc.

We can maintain the functions in GH for source control as SQL files, which also lets the community submit improvements to existing custom functions or submit their own custom function ideas if they're generally useful.

A nice-to-have is a CI process that runs unit tests on the functions and executes their SQL to update them on BigQuery.

@rviscomi rviscomi added the enhancement New feature or request label Jul 18, 2022
@rviscomi rviscomi self-assigned this Jul 18, 2022
@max-ostapenko
Copy link
Contributor

Definitely a MUST after the legacy cleanup.

@max-ostapenko max-ostapenko self-assigned this Sep 30, 2024
@max-ostapenko max-ostapenko transferred this issue from HTTPArchive/data-pipeline Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants