Image uploads, federation delays, and performance
Image uploads, federation delays, and performance
Happy new year!
Hi folks! I hope everybody had a good holiday period and I wish you all the best for 2024. I have some quick updates to share about lemm.ee:
Image uploads
Image uploads are now enabled for all lemm.ee users 4 weeks after account creation. The upload size limit is currently set to 500kb.
The 4 week account age requirement is in place to discourage spam and abuse. It is of course not a fool-proof solution, but let's give it a go and see what the results are.
Please note that lemm.ee is not intended to be a image hosting service! Feel free to upload avatars and banners for your profile and communities, but please be aware that we reserve the right to modify the upload limits going forward, as well as delete old images if storage costs become too high.
For image posts and comments, it would still be preferable for you to use an external image hosting service.
Federation delays
Over the holidays, our outgoing federation workers began experiencing some significant delays. I have been working on this problem for the past few days, and after updating to 0.19.1, applying some additional patches to the code, and changing our infrastructure a bit, I believe the issue has been resolved.
The good news is that now that we are on 0.19, problems such as this do not cause Lemmy to completely drop federated activities, as we now retain a persistent queue of federation activities for all linked instances. This means that after the issue was resolved, our federation workers started going through the backlog of likes, comments, and posts which you had made over the past several days, and sending these out to other instances. Essentially, all of your activities did end up reaching their target servers, just with some additional delay.
One quick side-note here, while we are now federating your activities in real-time again to most big instances, there is still a bit of a backlog left on the lemm.ee -> lemmy.world federation (it is a few days behind). I expect this to also catch up by tomorrow.
Performance
The new persistent federation queue is still quite a new feature in Lemmy, so it's a bit rough around the edges - after resolving the federation issues, our federation workers started going through the queue at extreme speed, which caused intense additional load on our database. This was one of the reasons for some performance degradation many of you noticed over the past few days.
Additionally, since updating to 0.19, there have been regular performance issues for many users. I have managed to solve a few of these by making some changes in our infrastructure, but I am also aware of a few more issues which I will continue to monitor and hopefully improve in the near future. Sorry for the inconvenience, I hope that the changes I have made so far will help make it a bit smoother already!
That's all from me for now, as always, feel free to comment if you have any thoughts, and have a nice day!
You're a star!! Thanks for all the hard work you do to keep us entertained and Lemmy working well!
Thanks a ton!
For those that don’t know, @sunaurus@lemm.ee is a huge contributor to the Lemmy codebase and discussion on GitHub, probably aware of most problems before we are. Silence here likely means our admin is contributing to all of Lemmy or taking a much deserved break
He also has an alt he uses, which is understandable.
He could be anyone of us, he could you, he could even be me!
"Huge contributor" is definitely over selling it 😃 I try to contribute a bit here and there, especially with things that are relevant for this instance
You're being modest. "Here and there" does nothing to credit the significance of what you do. Penicillin is used "here and there".
I'm sure there are other professionals who could do more, just as I'm sure that you aren't 100% focused on lemm.ee (not that you should have to be), but history so far has shown that you're far ahead of the curve in providing a stable platform - one that other instances should aspire to.
Thank You for update
Thanks, happy new year.
Anyone have any suggestions on lemmy friendly image hosting services?
postimg.cc is my host of choice.
I use imgflip.com a lot and it's worked very well.
I use Imgur still.
I’ve tried file.coffee a few times and so far it’s good for me. I learned about it from a similar question posted a few months ago.
Imgchest is just like imgur
Thank you very much! In the future, what is the best method to constructively notify of issues we see like this?
Yeah, it would be good to know whether we should Post reports about Problems to !meta@lemm.ee or !support@lemm.ee or elsewhere
!support@lemm.ee is the preferred place to report technical issues related to this instance
Thank you for your hard work!
What is the correct way to embed images inline so they display?
You can use a service like PostImage to upload your photo, then copy the direct link after uploading and paste it into your comment or post like this:
Happy New Year! 🥳
Great update. Thanks for your continued dedication and support.
Thanks for the effort, and happy holidays!
Thank you for everything you do. Have a great new year and 2024
Thank you for your time and effort. Best instance earns its status yet again. Happy New Year.
Thanks for the update and the work on fixing these issues!
I'm very happy to hear that your upgrade was a huge success. Cheers to a new year!
Great news, looks like performance is way better. Awesome work, thanks so much.
Awesome! Immediately noticed it, because I got some responses to some "older" posts. You're the best!
That’s awesome news, thank you! I know it must have been a challenge with the holidays, but it’s much appreciated.
Thanks for the update! I was almost ready to create a new account on another instance lol. This is great news and hopefully everything will be up to speed soon.
Thank you!
Out of curiosity, are the 19.0 federation issues actually solved with 19.1? Or are the issues just improved with further fixes in the works?
The story I seemed to be seeing was that 19.1 hadn’t actually fixed (but maybe improved?) federation issues and that another high-priority fix was coming.
0.19.1 did not fix everything, but the upcoming 0.19.2 should (and we are already running some 0.19.2 code as a patch on lemm.ee)
I'm going to ignore this post and continue to upload to 3rd party hosts. I don't want to drain the resources here any more than necessasry!
Thank you for all your hard work!
Happy new year and thank you for hosting!
