[Deta Base] returns empty for query on the large data

[nghiepdev]

Hi,

It is likely that the Deta Base query is no longer accurate when the data is large enough.

Screen.Recording.2022-12-26.at.23.48.57.mov

[etrotta]

Quoting the documentation:

Up to 1 MB of data is retrieved before filtering with the query. Thus, in some cases you might get an empty list of items but still the last key evaluated in the response.

To apply the query through all the items in your base, you have to call fetch until last is empty.

when you query for a key, it can find it directly
when you query with a filter for a field like the 'secret', it has to iterate though the entire thing