Hacker News

rustyconover
Paging Through a Parquet File in DuckDB: File_row_number or Offset? rusty.today

RobinL4 hours ago

There's also a pseudocolumn called rowid that's worth knowing about for similar purposes but on duckdb tables:

https://duckdb.org/docs/lts/sql/statements/select#:~:text=Ro...

matharmin4 hours ago

I'd assume it's common knowledge that you cannot paginate using OFFSET + LIMIT unless you use ORDER BY on an unique set of columns, no matter what database you're using. The only exception is when the database provides an explicit order guarantee without the ORDER BY, such as the case with `preserve_insertion_order = true` here.

sroussey4 hours ago

Even then, that does not work if new records are being inserted.

hn-front (c) 2024 voximity
source