Trino, DuckDB, Apache Iceberg integration?

Feature Requests
1

Hi Community,

I’m in the world of data & data engineering. This is the (here to stay) trends & technologies I see. Just sharing this with you as it would be great to have such components in the roadmap:

  • DuckDB (OLAP open source). While SQLite is a good option for OLTP, DuckDB is good for OLAP, fast, standalone, no pre-requisites, with multiple client interfaces (javascript, python, …)

  • Apache Iceberg (Open Table Format). A new way to store/retrieve data. Multiple engines (Spark, Snowflake, Databricks, Dremio, Trino, …) can already read/write Iceberg tables

Also, Trino now offers a js-trino-client : Trino | 63: Querying with JS
Having a Trino node would allow n8n to access many sources and execute very complex SQL.

All the components above would add great potential to n8n & data engineering world

my2c,

Stéphane

2

It looks like your topic is missing some important information. Could you provide the following if applicable.

  • n8n version:
  • Database (default: SQLite):
  • n8n EXECUTIONS_PROCESS setting (default: own, main):
  • Running n8n via (Docker, npm, n8n cloud, desktop app):
  • Operating system:
3

Hi @hsteph

Thanks very much for your contribution :slight_smile:

Let me move your post to the feature requests so that users can vote on it! :pray:

1 Like
4

Why DuckDB ?

5

1000079001
1000079001864×1002 220 KB

@ria @bartv