listEntities is not retrieving the data from azure storage tables - intermittently.

[vishaldupati62]

• Package Name: @azure/data-tables
• Package Version: 13.2.2
• Operating system: Linux
• [ x ] nodejs
  • version: 18 LTS
• browser
  • name/version:
• [ x ] typescript
  • version: 4.3.0
• Is the bug related to documentation in
  • README.md
  • source code documentation
  • SDK API docs on https://learn.microsoft.com

Describe the bug
A clear and concise description of what the bug is.

Using "listEntity" with "byPage" is omitting data thats present in azure storage tables and can be found in Azure Portal UI.
This is happening intermittently as we see some small amount of data is being read and getting processed.

Filter thats being passed to list entities method:

odata`a eq '${a}' and b eq '${b}' and Timestamp lt datetime'${processingTime}'`

There are about 2 million entities in the table.
We are using Azure Functions with runtime version 4.

To Reproduce
Steps to reproduce the behavior:
1.

Expected behavior
Nodejs SDK should retrieve the entities from azure storage table accurately while using timestamp in the query.

Screenshots

Application Code
Note: listEntity is just a wrapper in our applicate code for the actual method 'listEntities'

Image that shows data in azure tables while the same query run through nodejs SDK giving empty array or empty response.

Additional context
Add any other context about the problem here.

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @klaaslanghout.

[gnandyala123]

Adding an other issue reported here for visibility https://learn.microsoft.com/en-us/answers/questions/1855175/azure-table-storage-query-with-timestamp-filter-re

[jeremymeng]

It is known that sometimes the service returns pages with an empty list of items, but with a continuation token to get the next page. Users just need to continue to fetch next page until there's no page left.