Skip to content
This repository has been archived by the owner on Jan 26, 2022. It is now read-only.

New step "Neo4j Dimension Graph Lookup/Update" #80

Open
wants to merge 3 commits into
base: master
Choose a base branch
from

Conversation

zukaitang
Copy link

Based on the neo4j-output project, I created a new trans-step named "Dimension Graph Lookup/Update”. Except for the underlying database, this step is similar with the kettle plugin “Dimension Lookup/Update”. Two demo samples under the example directory are created to illustrate the update and lookup functionality respectively.
The different version of a dimension node are connected by a relationship which has a user-defined label name. Different from the original “Dimension Loopup/Update” step, the surrogate keys of a dimension are represented by the dimension node id, which can also be returned with a user-defined name. On the whole, the GUI of this new step is almost the same with the “dimension lookup/update” step.
I hope this work could be merged with the neo4j-output project. Some isssues need future work:

  • Currently, the cache function is not supported.
  • Currently, the batch operation is also not supported.
  • I would develop this step to support the type-3 slowly changing dimensions, which can be well supported in Neo4j.

@mattcasters
Copy link
Collaborator

This is pretty cool stuff zukaitang. I'll have a look at this later this week.
I might move the examples to neo4j-examples/kettle-plugin-examples/ if you don't mind.

@zukaitang
Copy link
Author

Of course it should be moved to the examples project. :-)

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants