Ive got 80k rows to import into appwrite, migrating from supabase

How do I import? Using the migration tool built in doesnt work and I have no idea why really. is there a better way than looping through 80k records and just adding them to the table? I tried data-migrator by tannermeade and the flutter app fails to build. someone else has a similar issue and they opened the issue in september of 2023 and got no response.

TL;DR

Developers migrating from Supabase to Appwrite are having issues importing 80k rows, with the Appwrite log only showing processing status. They are not sure how to check for errors or fix issues with the migration tool. One suggestion is to check for recent fixes for Supabase migrations. Another option is to explore alternatives like looping through records or using different migration tools.

What error are you getting with the migration tool?

I think it got some fixes for supabase migrations recently

i dont really know how to check to be honest

can you tell me how to?

its been like 5 hours

and indexes is still processing

and in logs

it just shows the number of errors and stuff

i dont see any errors in the workers-migrations service

What do you have in logs?

Do you can send me your project ID?

nothing particularly useful

TypeScript

{
  "$id": "66d518112de4830d38df",
  "$createdAt": "2024-09-02T01:42:41.188+00:00",
  "$updatedAt": "2024-09-02T04:00:03.415+00:00",
  "status": "processing",
  "stage": "migrating",
  "source": "Supabase",
  "resources": [
    "user",
    "database",
    "collection",
    "attribute",
    "index",
    "document"
  ],
  "statusCounters": {
    "user": {
      "pending": 365,
      "success": 0,
      "error": 100,
      "skip": 0,
      "processing": 0,
      "warning": 0
    },
    "database": {
      "pending": 0,
      "success": 0,
      "error": 1,
      "skip": 0,
      "processing": 0,
      "warning": 0
    },
    "collection": {
      "pending": 0,
      "success": 0,
      "error": 12,
      "skip": 0,
      "processing": 0,
      "warning": 1
    },
    "attribute": {
      "pending": 0,
      "success": 0,
      "error": 95,
      "skip": 0,
      "processing": 0,
      "warning": 0
    },
    "index": {
      "pending": 16,
      "success": 0,
      "error": 0,
      "skip": 0,
      "processing": 0,
      "warning": 0
    },
    "document": {
      "pending": 0,
      "success": 0,
      "error": 20240,
      "skip": 0,
      "processing": 0,
      "warning": 0
    }
  },
  "resourceData": [],
  "errors": []
}```