[SOLVED] Appwrite self-hosted to self-hosted migration stuck on pending

I just set up my self-hosted from scratch similar to how it is in the cloud. Seemed better and my set up isn’t complex. Also didn’t need the data as I’m still developing.

It’s still stuck in pending and it’s been days. No way I know to mark it as failed.

Huh, thats not ideal. Hopefully someone from appwrite team can provide some insights

No it isn’t. Just how I solved it. My point in the end is, the process has stopped. Restart it, don’t wait as it’s been days for me. Almost a week.

Ah ok. Understood. The status I guess will be stuck in pending then. That would really bother my OCD :)..

lol same for me. I never visit that page again

You mean from cloud? Or self-hosted to self-hosted?

Self to self .. Long story here

https://discord.com/channels/564160730845151244/1186081774216941668

anything in the docker logs for the migration worker?

Ah memory allocation error :/ server has 4 gigs. Oddly the server monitoring service shows memory never went over 60% utilization

weeeirrrddd. do you have a really big document?

do you have an error service configured?

Nothing out of the ordinary, just regular records..

PHP has a max memory of like 150MB or something...so something was loaded into memory that was 500MB, causing the worker to crash

500 mb ?? That is weird, I dint think the entire database would be 500 mb

Any way I can reboot or restart the service to have it complete and ensure everything is moved over ? As far as I have been able to check all the data has moved over ..

well the whole DB shouldn't be loaded into memory anyways

were there a lot of errors in the migration?

No errors at all.. Looking at the console everything went smoothly, ~500k documents moved over. Then it just got stuck with no feedback that it had crashed ..

Does the migration assistant migrate document in small batches at a time or collections ? I mean if a collection has 400k documents will be load them all to memory and try to commit transaction style ?

batches

Well I guess we need a if(batch size > 125 mb) in the migration worker 😋 .. But to close the loop on the migration since from what I can tell I have things moved over should I run it again or leave it at pending since I know its crashed so won't interfere will the functioning of appwrite

you can just leave it

Cool. Really appreciate all the time you spend helping the community. Its absolutely invaluable and I am greatful

[SOLVED] Appwrite self-hosted to self-hosted migration stuck on pending

well im not sure if that's the problem...beacuse you said every document was migrated...maybe the final report was too big?