I need to batch create rows, 50,000 rows at once. I tried to combine create rows with transactions api in n8n, but I can only import 10,000 rows at most. Is there any way I can increase this limit, by setting enviroment variables or in settings?
You’re running into n8n’s hard execution + payload limits that’s why you can’t push more than ~10,000 rows in a single operation. It’s not something you can increase with an environment variable; the workflow just becomes too heavy for one transaction. I can help you set this up properly by batching the inserts (e.g., 5k per chunk) and automating the loop so it still runs as one process without timing out. Quick question: where are you inserting the 50,000 rows (Airtable, Notion, DB, etc.)? That affects the best batching method.
<@1367298667920228386> Thanks for replying, I use a webhook trigger to accept a excel file with 50000 rows in it, I use loop over items with the batch size of 100(the max amount we can create in one operation), then I stage each loop into one transaction, then I got this error: Transaction already has 100 operations, adding 1 would exceed the maximum of 100
The error comes from the DB/transactions API itself each transaction is limited to 100 operations, so even if n8n loops correctly, the backend will reject anything above that. That’s why the 10k+ batches always fail. I can help you fix this by restructuring the workflow so each batch is processed safely without hitting the transaction limit, while still keeping the whole upload automated. If you want, feel free to message me and I’ll walk you through the setup or help you build it properly.
Recommended threads
- local (self-hosted) sites issues
setup: - `composer run installer:dev` issues - Getting error when visiting the site ```Synchronous function execution timed out. Use asynchronous execution in...
- I'm getting an error on the console "j?....
On my self hosted instance version 1.8.1 the console is giving me this error when trying to view the rows for a table I recently created. My application is read...
- local build `composer installer:dev` iss...
setup - dev container (default linux universal) WSL (test with gh codespace too) - php 8.5.7 - all extensions installed - `composer install` fine - `composer...