Weekly Sync - 12 December 2023

[github-actions[bot]]

Please add agenda items below and give your weekly update in a comment. Thank you!

Agenda

[beniaminmunteanu]

Telemetry last week:
Started working on what was discussed on last week's tech team weakly:

Progress (infra):
Our own Otel collector as a hosted Gateway instead of local sidecar container of rafiki:

• Created ECS Fargate Telemetry Cluster
• Created Telemetry ECS Service -> It keeps a minimum of 2 custom ADOT Collector ECS Tasks up
• Created a layer 4 load balancer in front of the ECS tasks.
• Rafiki instrumented instances can now send data to the ECS Telemetry Service and the downstream for prometheus+grafana is linked to it.
• Telemetry service in Rafiki can now send data to multiple OTEL collectors, defined in env. variable
• Asset code no longer sent in metrics
• Rafiki network insights dashboard promql is updated to work without asset code on all panels

TBD on infra:
the OTLP GRPC protocol is in plain for now, had issues on the TLS handshake when involving the l4 Load balancer
The communication needs to be moved under TLS in the future ^^
Should have a certificate on the telemetry service.
Note:
Since LB is L4, it is not a TLS terminator, which means the handshake would happen between Rafiki --> ADOT collector ECS task, not with the LB.

Started working on:

• Use 3rd party Rates API to convert cross-currency amounts to the base telemetry currency.

[Tymmmy]

• Had to catch up on all emails, messages
• Handle all org documents for November for Testnet project
• Handle all stories-PRs that were put aside in order to concentrate on the Summit
• Meetings meetings

[rico191013]

• Merged PRs for awilix container issue, some unit testings
• Created PR for transaction controller unit tests
• Working on remaining unit testing issues

[BlairCurrey]

• merged payment liquidity resolvers PR
• working on updating admin ui to use these resolvers which is the final step in deprecating event liquidity

[njlie]

• Worked on updating OP SDK to support polling in AS; found & fixed some other bugs along the way that kept it from importing correctly in Rafiki
• Continuing work on adding polling to the AS