Notice

The forum is in read only mode.

Support Forum

Welcome! Support Forums have been reactivated
Welcome the Technical Support section. Help us in assisting you by providing us with a concise and descriptive elaboration of your issues. Be specific and if possible, provide us with a step-by-step instruction in replicating your problem.

Server Bogged down by ffmpeg processes

11 years 10 months ago
Licenses:
JomSocial Active Socialize Expired

Hello,

I have a VPS-02 account with Imageleet. We moved from shared hosting to VPS hoping to see this problem resolved by the increased resources... our site is slowing to a hault- basically Imageleet is telling us that the cpu is maxed out by the ffmpeg processes in the queue. I have the max file size set to 400mb in JomSocial, and php.ini says 500mb. Imageleet sent me this reply, but I'm confused as to how we can have file sizes like that if the maximums are set well below that? Please help! We need video upload on our site.

Thanks,


Hello Scott,

Problem is not the number of users but video encoding process and if 3-4 video encoding process keep going on it will impact performance of the site as ffmpeg will take most of the CPU. You can check your VPS CPU load is always staying above 10. Video being encoded are very large in size and currently one video being processed is more than 1 GB after encoding still going on. You can check folder images/video/videos/298/ where this encoded video is being put. Original video is also 618 MB in size.

Video encoding take lot of CPU and its normal for ffmpeg to consume amount of CPU, Its same as you encode video on your local system using any encoding app and process take lot of time. 100-150 MB video can take upto an hour or more on already overloaded system.

Currently VPS is running 5 ffmpeg process encoding 5 videos at same time using all the CPU which leave very little for actual site loading.
16199 xpinnets 25 0 632m 558m 4276 R 21.6 18.2 1729:40 ffmpeg
29815 xpinnets 18 0 137m 63m 4348 R 21.3 2.1 0:41.25 ffmpeg
10162 xpinnets 18 0 141m 67m 4292 R 10.2 2.2 9:53.85 ffmpeg
9247 xpinnets 18 0 131m 58m 4256 R 9.0 1.9 5:41.14 ffmpeg
16104 xpinnets 18 0 131m 58m 4260 R 9.0 1.9 7:18.77 ffmpeg
9310 xpinnets 18 0 143m 69m 4300 R 8.7 2.3 16:37.36 ffmpeg
11668 xpinnets 18 0 144m 70m 4300 R 8.7 2.3 21:19.54 ffmpeg

Please provide me joomla login so that i can review encoding commands further, jomsocial default command seem to be creating very large video files and re-encoding mp4 files which can be played without encoding. Perhaps it can save some CPU.

----
Warm Regards
Raul
Imageleet Networks

11 years 10 months ago
  • Dimas Tekad Santosa's Avatar
  • Dimas Tekad Santosa
  • Visitor
  • Thank you received: 0
Licenses:

Hi Scott ,

Thank you for reporting, we are discussing this issue right now.. and I hope we will get the solution then.

This is the temp solution, please you edit this file components/com_community/libraries/videos.php, find this :

foreach ($videos as $video) {

replace to :
$q = 0;
foreach ($videos as $video) {
if($q>=1) break;
$q++;

that code for making 1 video process for each cron job, i hope it will help

thank you

11 years 10 months ago
  • Dimas Tekad Santosa's Avatar
  • Dimas Tekad Santosa
  • Visitor
  • Thank you received: 0
Licenses:

OH ya another solution, you can try use zencoder documentation.jomsocial.com/wiki/ZenCode...mazon_S3_Integration

11 years 10 months ago
Licenses:
JomSocial Active Socialize Expired

Thank you for the reply- is this normal? Or is there something wrong in settings or something?

11 years 10 months ago
  • Dimas Tekad Santosa's Avatar
  • Dimas Tekad Santosa
  • Visitor
  • Thank you received: 0
Licenses:

This is normal and something happens for converting the large files, but if you convert the small video files I think this issue won't be happened..
We have plan and improvment for this issue in the future

11 years 10 months ago
Licenses:
JomSocial Active Socialize Expired

1) What about this from the host: "Please provide me joomla login so that i can review encoding commands further, jomsocial default command seem to be creating very large video files and re-encoding mp4 files which can be played without encoding. Perhaps it can save some CPU."

I see there are some files over 1GB! How does that happen when I have the max file size set at 400mb?

2) Also, would Zencoder completely eliminate this problem with slowing our server?

11 years 10 months ago
  • Dimas Tekad Santosa's Avatar
  • Dimas Tekad Santosa
  • Visitor
  • Thank you received: 0
Licenses:

1. You can provide the login and FTP to the host, maybe they can help you and can share with us.. I am not sure how 1GB can be uploaded, please you check again the setting.. I cant test the 1GB issue, I will get some problem if upload very large file :D

2. Zencoder is coming from amazon S3 server, it wont effect too much with your server.

Moderators: Piotr Garasiński
Powered by Kunena Forum

Join 180,000 websites creating Amazing communities

JomSocial is the most complete, easy-to-use addon that turns Joomla CMS into a
full -fledged, social networking site

TRY NOW BUY NOW