Skip to content

Releases: Flowminder/FlowKit

1.27.0

17 Jun 08:03
@Thingus Thingus
1.27.0
c7ef0a9
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
1.27.0 Latest
Latest

Changelog

All notable changes to FlowKit will be documented in this file.

The format is based on Keep a Changelog.

1.27.0

Added

  • Added FlowDB table infrastructure.invalid_cell_info for recording cell information that could not be included in infrastructure.cell_info (including cells with null or duplicate cell IDs). #6626
  • The file name of FlowDB's automatically generated at init config file can now be specified by setting the AUTO_CONFIG_FILE_NAME environment variable. By default this is postgresql.configurator.conf.

Changed

  • FlowDB now triggers an ANALYZE on newly created cache tables to generate statistics rather than waiting for autovacuum
  • FlowDB now produces JSON formatted logs by default. Set FLOWDB_LOG_DEST=csvlog for the old default behaviour.
  • The logging destination of FlowDB can now be configured at init by setting the FLOWDB_LOG_DEST environment variable, valid options are stderr, csvlog, and jsonlog.
  • The location inside the container of FlowDB's automatically generated config file has changed to /flowdb_autoconf/$AUTO_CONFIG_FILE_NAME.

What's Changed

Full Changelog: 1.26.0...1.27.0

Contributors

greenape, jc-harrison, and dependabot
Assets 2

1.26.0

10 Jun 15:24
@greenape greenape
1.26.0
bd99a72
Compare
Choose a tag to compare
1.26.0

Changed

  • FlowDB now enables partitionwise aggregation planning by default
  • FlowDB now uses a default fillfactor of 100 for cache table indexes

Fixed

  • Queries that have multiple of the same subquery with different parameters no longer cause duplicate scopes in tokens. #6580
  • FlowETL QA checks count_imeis, count_imsis, max_msisdns_per_imei and max_msisdns_per_imsi now only count non-null IMEIs/IMSIs. #6619

What's Changed

Read more

Contributors

greenape, Thingus, and 2 other contributors
Assets 2

1.25.0

24 Apr 12:16
@jc-harrison jc-harrison
1.25.0
03ed8a7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
1.25.0

Fixed

  • FlowETL get_qa_checks no longer attempts to create duplicate tasks for QA checks defined in the DAG folder. #6494

Removed

  • Removed flowpyter-task from the FlowETL Docker image. For a Docker image with flowpyter-task included, see flowminder/flowbot.
Assets 2

1.24.0

03 Apr 13:42
@greenape greenape
1.24.0
09a98be
Compare
Choose a tag to compare
1.24.0

Added

  • Test and synthetic data generators now perform QA checks on the generated data. #6467
  • Added new /qa endpoint to FlowAPI and FlowClient, which supports getting the results of QA checks run by FlowETL #2704
  • Added new available_qa_checks property to flowmachine Connection objects #2704
  • Added new get_qa_checks method to flowmachine Connection objects #2704

Fixed

  • Test QA check IDs are now of the same format as those produced by FlowETL. #6472
  • FlowAuth now runs migrations correctly on startup. #6480

What's Changed

Full Changelog: 1.23.0...1.24.0

Contributors

greenape, Thingus, and dependabot
Assets 2

1.23.0

18 Mar 15:14
@greenape greenape
1.23.0
fb3478b
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
1.23.0

Changed

  • MostFrequentLocation now breaks ties based on the last used location, instead of by arbitrary Postgres sort order. #6268

  • Users no longer have write access to the public schema in FlowDB following a change introduced in PostgreSQL 15

  • FlowDB is now built on PostgreSQL 16, debian bullseye

    Warning

    You may need to update your docker version to use newer releases of FlowDB. You will also need to create a fresh database and reimport data if you are upgrading from a previous FlowDB release.

What's Changed

Full Changelog: 1.22.0...1.23.0

Contributors

greenape and dependabot
Assets 2

1.22.0

29 Feb 11:44
@greenape greenape
1.22.0
37d4bf8
Compare
Choose a tag to compare
1.22.0

Added

  • FlowETL sensor NRowsPresentSensor which checks for a specified minimum number of rows.

Changed

  • ForeignStagingTableOperator will now error if the underlying file cannot be read or the command returns an error. #5763
  • Flowmachine now requires SQLAlchemy >= 2.0.0 #6066

What's Changed

Full Changelog: 1.21.1...1.22.0

Contributors

greenape and dependabot
Assets 2

1.21.1

06 Feb 09:07
@greenape greenape
1.21.1
85235c8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
1.21.1

Changed

  • Upgraded Python dependencies

What's Changed

Full Changelog: 1.21.0...1.21.1

Contributors

jc-harrison and dependabot
Assets 2

1.21.0

17 Jan 15:17
@greenape greenape
1.21.0
c8120d8
Compare
Choose a tag to compare
1.21.0

Added

  • Added new FlowDB tables infrastructure.cell_info and infrastructure.cells_table_versions to keep track of changes to the cell info over time (note: the new tables have not yet replaced infrastructure.cells as the source of cell information for FlowKit queries). #6184

What's Changed

Full Changelog: 1.20.0...1.21.0

Contributors

jc-harrison and dependabot
Assets 2

1.20.0

23 Nov 09:45
@greenape greenape
1.20.0
7a00a2d
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
1.20.0

Changed

  • Updated flowpyter-task to 1.1.0

Removed

  • Removed AutoFlow. #6394

What's Changed

Full Changelog: 1.19.1...1.20.0

Contributors

greenape, jc-harrison, and dependabot
Assets 2

1.19.1

10 Nov 09:24
@Thingus Thingus
1.19.1
4d652e4
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
1.19.1

Added

  • flowpyter-task now included in the flowetl image

What's Changed

Full Changelog: 1.19.0...1.19.1

Contributors

Thingus, jc-harrison, and dependabot
Assets 2