-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
PPS List #74
Labels
admin panel
Panel la
enhancement
New feature or request
help wanted
Extra attention is needed
not really a issue
Projects
Comments
seadog007
added
enhancement
New feature or request
help wanted
Extra attention is needed
admin panel
Panel la
labels
Oct 12, 2019
seadog007
added a commit
that referenced
this issue
Oct 12, 2019
#76 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
admin panel
Panel la
enhancement
New feature or request
help wanted
Extra attention is needed
not really a issue
Filter (Validator): Filter out a record
Processor (Remover): Doing something to the record
Stage 1 (Line Filter/Processor)
Question Mark Filter (question-mark.s1.js)
If there is a question mark in the line, which means something missing in the line, remove that line.
CSV Comma Remover
Parsing CSV for helping stage converter.
TSV Tab Remover
Parsing TSV for helping stage converter.
Space Remover
Remove all kind of wired space, highly change appear between name where which is only 2 chinese character.
Stage 2 ([name, id] Filter/Processor)
10 Digit ID to 6 digit (10d26d.s2.js)
Coverter 10 digit id to last 6 digit for hashing.
A123456789 Filter (dummy-id.s2.js)
Too many testing data using this....
Name English Filter (name-english-filter.s2.js)
If there is English character in the name, then filter it out.
ID Validator (id-validate.s2.js)
Check if ID is vaild.
Unifier
Unify the data, be sure the data will not repeat.
Stage Converter
Stage 1 to Stage 2 Converter (s1-to-s2.js)
Convert line to [name, id]
Stage 2 to Final
By hashing the
name + id
form stage 2The text was updated successfully, but these errors were encountered: