Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deltalake #1256

Merged
merged 162 commits into from
Sep 23, 2024
Merged

Deltalake #1256

merged 162 commits into from
Sep 23, 2024

Conversation

ghislainfourny
Copy link
Member

No description provided.

dloughlin added 30 commits May 28, 2023 16:53
Create tests for delta-file function
179dfbc
Create tests for delta-file function with transform
d049873
Implement delta-file function
d5f8f00
Add delta as output option
95d135f
Add delta as output option
85c7342
Add delta to configs
75d6c3f
Create test data for delta
e907de3
Create test to check non-delta-file values and non copied values are …
29177c5 
…immutable
Create error for attempt to modify immutable values
a6e9503
Make default mutability level -1
38c01f2
Adjust error semantics to check for mutability level of -1
a17d345
Adjust test to new immutable modify error semantics
c083e9a
Add delta file to alter
24cdb58
Create tests for semantics of updating delta files directly
32e5e01
Add mutabilityLevel getters and setters to itemType hierarchy
27281a6
Implement setting of mutabilityLevel for dataframes with itemtypes
f95d301
Apple spotless
9f5b847
Remove err debug
85fd7d3
Remove json keyword from updating exprs
0434570
Fix copy classnotfound exception when using repl
ca0bdd5
Add this. to solve unqualified acceses
0fb6e57
Add updating functions lexing
72ae3a2
Update functiondecl visit to incorporate isUpdating and isExternal bo…
3eb57d7 
…oleans
Update FunctionSignature to include isUpdating flag for StaticContext…
cc5112c 
…Visitor
Implement ExpressionClassificationVisitor visits for InlineFunctions …
681d30c 
…and FunctionCalls along with the errors
Create simple tests for updating functions
dcdfe63
Extend function iterators to account for updating functions and imple…
772727c 
…ment getPUL methods
Reorganise visitor list to ensure function calls are set to updating …
7a0ebd9 
…before type inference
Make isUpdating non transient to ensure it retains after deppCopy
6d10219
Include isUpdating to function signatures in InferTypeVisitor
9f80e1d
Ghislain Fourny and others added 28 commits July 31, 2024 16:53
Make new arrays mutable.
57c0e2f
Fix test.
a87ed88
Fix test.
ff247cf
Fix syntax.
4b51c0d
Fix test.
3eb58a9
Allow updating without % and define default annotations namespace.
8d324c9
Remove an prefix and make default.
58c6c0d
Fix 3 tests.
afb8696
Spotless.
9750f37
Update metadata.
90e0702
Fix test.
55c60f5
Fix test.
b07be2d
Fix test.
3ad52a2
Add delta tests.
ca9bc04
Fix delta tests.
c3cb597
Fix tests.
22b98b3
Fix column name to rowID.
684dd96
Revert column names.
dcd15fe
Run delta tests.
e70d2f9
Fix test.
41053cc
@David-C-L
extend SequenceOfItems with functions to apply PUL and determine if m…
24ffb46 
…aterialisation is possible
@David-C-L
add command line arg for updates and adjust execution flow
0da26c1
@David-C-L
adjust tests containing update tests with cli parameter and SeqOfItem…
7912579 
…s api
@David-C-L
add isSequential and isUpdating methods to program and StatementsWith…
ea53993 
…OptionalExpr iterators
@David-C-L
allow treat exprs to be updating
b02e732
@ghislainfourny
Merge pull request #1260 from David-C-L/deltalake-scripting-updates
7ee88c3 
Deltalake scripting updates
@David-C-L
run mvn spotless
4fc8cc6
@ghislainfourny
Merge pull request #1261 from David-C-L/deltalake-scripting-updates
3520ad7 
Delta Lake/Scripting changes: run mvn spotless
@ghislainfourny ghislainfourny merged commit ae77e46 into master Sep 23, 2024
4 checks passed
@ghislainfourny ghislainfourny deleted the deltalake branch September 23, 2024 11:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ghislainfourny @David-C-L