Functions: HTTP 500 internal error

I’m seeing a lot of HTTP internal server errors across all my functions the past 48 hours.

can u share execution logs?

For the failed executions, all I get is the failed status - there’s no logs or error logs, my Worker sending the POST request just receives a HTTP 500 server error, e.g.:

⚠️ fetch-general-news trigger failed (HTTP 500)
{"message":"Server Error","code":500,"type":"general_unknown","version":"1.9.0"}

The issue seems to have resolved itself for now but I had dozens of these failures across all of my functions over the Easter weekend, and I do see this happen intermittently at other times.

My Project ID: 665485b900171e75786c

I spoke too soon - seeing these errors again. Any ideas @Chirag Aggarwal?

@user this is getting quite disruptive now - I’m seeing lots of these errors with the move to 1.9.0, and it had been working flawlessly beforehand.

This can be the cause of one million things, how do you expect to get help without sharing any logs or your code? Just tagging people to stop their day and come and help is not very efficient

also if you want quick support, instead of tagging core members you can pay for premium support and also support the software you're using for free

Are you serious? I pay for Pro, the service is supposed to be ‘generally available’ and I get constant errors. As far as I’m aware Pro is supposed to include Support and I’ve not had a response from your team for 3 days. Furthermore you asked me to tag you the first time I mentioned this issue in the Cloud channel, but I didn’t bother you in the end because i temporarily resolved the cron issue by switching away from an Appwrite-controlled cron to a Workers POST trigger instead. But that’s now experiencing issues too.

I’ve already mentioned I’m getting a response error from some POST requests so it’s clearly an internal server error on the Appwrite Cloud side.

But here is the POST request anyway:

// Called by Cloudflare Worker cron trigger (every x minutes depending on the function)

const response = await fetch(https://cloud.appwrite.io/v1/functions/${functionId}/executions, {
method: 'POST',
headers: {
'Content-Type': 'application/json',
'X-Appwrite-Project': '<PROJECT_ID>',
'X-Appwrite-Key': '<APPWRITE_API_KEY>',
'X-Appwrite-Response-Format': '1.0.0',
},
body: JSON.stringify({
async: true,
}),
});

It’s an intermittent issue - it had been working well for a few weeks, but the last two weekends I’ve had lots of errors.

What’s your ticket ID?

I’ve not been given one.

What’s your project id?

665485b900171e75786c

There is no ticket on this account. Is this issue related to your cloud account or self hosted? You mentioned it started when you moved to 1.9, so not really sure how is this relevant to cloud

No, I only raised the issue in discord and was asked to open a support thread.

I have a cloud account. The error response referred to 1.9.0 so I presumed this was related to the issue - thought it might be helpful to mention. Previously error responses referred to version 1.8.1.

I’ll be on my laptop in a few and take a look to see if I get anything from our logs and the account info.

@user I got engineering looking into your issue. I'll share more when they find something.

In the meanwhile, I do notice all of your functions are using the minimum spec, the default functions spec are very humble to allow Appwrite devs to save gb-hours costs, but usually it's very recommended to increase the default spec.

Pro teams can upgrade to up to 4 cpu cores, and 4GB of RAM. We can also offer higher options under our custom plans.

I would also recommend to add some logs at the very start of the function and around any code block that may be communicating with any 3rd party APIs to measure the response times and see what might be breaking.

hi @user i have also noticed this 500 status code in my function requests, it seems its not able to connect to the internet in the function as requests to APIs and urls fail with `ClientException with SocketException: failed host lookup: ... (OS Error: name or service not known, errno = -2)

i also get this error which is basically same thing:

Error: Exception: Invalid or expired token.
Unhandled error: Exception: Invalid or expired token.``` 


Note that this happens like twice in every 10 request.

and only happening on post requests. Appwrite seems to have become unstable this past few weeks and my applications and users have been paying the price for that 😶

1. Please open a separate issue. Your error is different from the one above and does not appear to be the same underlying problem.

2. Your error seems to come from the Appwrite API and may point to an authentication issue when calling Appwrite, rather than a Functions issue itself. That said, a 500 error often indicates something going wrong inside the function, not necessarily in Appwrite specifically. Either way, feel free to share the details and we’ll be happy to take a look and see how we can help.

3. Overall, uptime has not materially changed over the past few months, and it has not worsened. We did have an unfortunate week with three incidents, and all of them are being investigated and handled with urgency. We have also communicated about them here as transparently as possible. We appreciate everyone who has taken the time to report issues, and the core team is doing its best to respond to everyone as quickly as possible.

i have opened a new thread for this issue.

I’m still seeing intermittent issues on this and when I check the logs I see a lot of function executions that appear to still be running i.e. Status code:0, Status:Failed but Duration still increasing.

Functions timing out with database errors… any update?

Hello, have you found any solution? A got same problem after updating 1.8.0->1.9.0

Please open a new ticket with all details