Releases: nkester/modSim
Fixed iterator issue
minor hot fix
Fix failing when NULL is passed to fillQuery function. Applied fix by wrapping function call in tryCatch statement.
Mongo Iterators
Refactored the code to use MongoDB iterators so one record is pulled at a time from MongoDB, re-structured, and written to PostreSQL. This makes the process much faster and it is less resource intensive as data is not stored in memory. Also did significant improvements to documentation, including references within each function to where its parent RMarkdown file resides and the name of the file that stores it. Finally, added some additional improvement to the data prep and graphing functions.
The iterators reflect a completely new way of doing the translation and thus warranted a new minor version change.
Included Graphing
This is a functioning release that includes functions to create the PostgreSQL database, perform ETL for all required tables from MongoDB to PostgreSQL, and initial aggregation and graphing functions based on resulting PostgreSQL Materialized Views.
This runs slow and performs greedy queries from MongoDB meaning it pulls in large volumes of data and performs un-nesting and manipulation in R. The next minor version will perform these actions in MongoDB.
Initial ETL Functions
This is the initial working package with all required extract, transform, load (ETL) functions.