Project Meeting 2023.12.12

Agenda

• Data Type Optimization Update (WSP)
• Upcoming Meeting Agendas

Action Items

• Sijia to create GitHub issues for the Vehicle Fuel Type runtime and School Escorting RAM usage issues identified.
• David H and Jeff N, coordinating with Joe C, will investigate these issues and report back to the Consortium in late January.
• Joe C to coordinate with bench contractors on any outstanding items left on Phase 8 tasks.
• Bench contractors should send Ellen estimates of where they expect to end up, for invoicing, at the end of the year.

Meeting Notes

Data Type Optimization Update (WSP)

• Latest performance profiling test were conducted for the MTC model, with 100% sample, with Sharrow, and then using the Develop Branch vs the Data Type Optimization branch. Results showed some outlying performance issues for two submodels.
  • Vehicle fuel type took significantly longer to run, almost as much time as all models combined.
  • School escorting consumed significantly more RAM than other components.
• It is unclear why these two models have outlier performance profiles.
  • David Hensle and Jeff Newman have some theories and will investigate and report back to the group, tentatively scheduled for late January.
  • Joe C would like to understand what is so different about these models than the rest, so that we can anticipate other design elements/model structures that may have similar problems in the future, to find solutions that would prevent this from happening again.
  • Sijia will look into any additional tests that might provide more insights.
• Moving forward, it's important to consider performance requirements/impacts of new components developed under the Consortium.
• To wrap up this task:
  • Sijia is working on the PR but it is failing some tests. It looks like the update reference pipeline zips need to reflect the new data types.
  • Sijia has been moving string comparisons out of the UECs so that it doesn’t fail tests with sharrow. Jeff suspects that consistently fixing the order of the categorical values might resolve the errors Sijia is seeing, but needs to be investigated and confirmed. Sijia to open a new GitHub Issue for these fixes that she is making on the fly.

Upcoming Meeting Agendas and Other Admin Items

• All remaining meetings in December will be cancelled, except for one last meeting on December 21 to close out all Phase 8 tasks.
• Bench contractors should send Ellen estimates of where they expect to end up, for invoicing, at the end of the year.