Comments (13)
Weird, can you reproduce it on the demo site?
from avideo.
Daniel, if I upload ten videos and go to edit the thumbs this will happen 1-2 times. Time is valuable and I do not have it to reproduce on the demo site. Did you scan the log? I captured it as the event occurred.
UPDATE: the video file is most definitely missing, it is unclear if it ever successfully encoded, or, if it "pretended to" and we didn't detect the "Broken Missing Files" condition until I did a pageload of conspyre.tv/v/18427?
This is after fixing permissions on the videos directory, which, we have no idea how the permissions got ganked in the first place. 🤨
mysql> select id,title,filename from videos where title like "Stanley Meyer%";
+-------+--------------------------------------------------------------+------------------------------------+
| id | title | filename |
+-------+--------------------------------------------------------------+------------------------------------+
| 411 | Stanley Meyer on How the Water Fuel Injection System Works | _YPTuniqid_604b11ac18e6b9.63756340 |
| 11742 | Stanley Meyers Water Powered Car | video_220924180445_v55c5 |
| 11743 | Stanley Meyer 1995 It runs on water | video_220924180556_vb2a2 |
| 18427 | Stanley Meyer: The Mysterious Inventor of Water-Powered Cars | v_240429231036_v7db3 |
+-------+--------------------------------------------------------------+------------------------------------+
4 rows in set (0.03 sec)
mysql> ^DBye
ubuntu@pyron:~/scripts$ ls -ls /var/www/html/conspyre.tv/videos/v_240429231036_v7db3
total 1784
1172 -rw-r--r-- 1 www-data www-data 1197354 Apr 30 07:27 v_240429231036_v7db3.jpg
4 -rw-r--r-- 1 www-data www-data 10 Apr 30 04:16 v_240429231036_v7db3.notfound
16 -rw-rw-rw- 1 www-data www-data 15164 Apr 30 08:04 v_240429231036_v7db3_128.jpg
32 -rw-rw-rw- 1 www-data www-data 30858 Apr 30 08:04 v_240429231036_v7db3_192.jpg
52 -rw-rw-rw- 1 www-data www-data 50447 Apr 30 08:04 v_240429231036_v7db3_256.jpg
100 -rw-rw-rw- 1 www-data www-data 98755 Apr 30 08:04 v_240429231036_v7db3_384.jpg
160 -rw-rw-rw- 1 www-data www-data 161905 Apr 30 08:04 v_240429231036_v7db3_512.jpg
12 -rw-rw-rw- 1 www-data www-data 9491 Apr 30 08:04 v_240429231036_v7db3_96.jpg
236 -rw-rw-rw- 1 www-data www-data 239818 Apr 30 08:04 v_240429231036_v7db3_thumbsV2.jpg
If I continue to look for more "Broken Missing Files" I can see that not all are created equally:
This one doesn't appear to be in the same state:
mysql> select id,title,filename from videos where title like "United We%";
+-------+---------------------------------------------------+----------------------+
| id | title | filename |
+-------+---------------------------------------------------+----------------------+
| 18409 | United We Stream: Navigating Tough Paths Together | v_240428124253_v9bb1 |
+-------+---------------------------------------------------+----------------------+
1 row in set (0.01 sec)
mysql> ^DBye
ubuntu@pyron:~/scripts$ ls -ls /var/www/html/conspyre.tv/videos/v_240428124253_v9bb1
total 4
4 -rw-r--r-- 1 www-data www-data 10 Apr 28 19:04 v_240428124253_v9bb1.notfound
My workflow is I have very little time in the morning to scan social media for new content. I upload 3-5 pieces and come back at the end of the week to publish on the Roku. There are always several broken videos. Always.
Why is this so flaky, Daniel? It's always been this way, just haven't been vocal about it. :-/
from avideo.
you may want to check your logs to try to find some clue
in this dir /var/www/html/conspyre.tv/videos/v_240429231036_v7db3
there is no video, so it is really a broken missing file video
there was any video before changing the image?
from avideo.
How many concurrent in encoder configuration.php? If multiple, are there enough server resources to handle concurrent count? Largest source and format? Are php.ini settings configured to handle largest source and processing?
from avideo.
@DanielnetoDotCom @walt93 I also have old videos, which are in "Broken Missing Files", even though the files are present on the server.
from avideo.
There's only two of us using the encoder & I have PHP set to 10GB upload size and the ram is IIRC 512GB (or whatever was recommended at install time). I had an encoder farm setup, but, moved the server & the instructions to install it don't work at all so I'm down to a single encoder.
It seems that a video does not go into "Broken Missing Files" until someone loads it via /video or /v/ routes, so I suspect that many times when I hit this it's genuinely missing the video.
But why? Why is it missing the video? It seems the encoder is having tons of issues, it's not reliable for me.
from avideo.
I'm coming to the conclusion that its a lot more than 1-2 files in 10. It's looking more like 80% of the uploads I did this week are broken.
My time schedule is too limited for this. What can I do to help you debug this encoder so it's not producing so many "broken" files. FWIW I'm not calling these files "broken". I claim it's the encoder which is "broken" Daniel…
The streamer log is super noisy. It sprays tons of noise.
The encoder log is super clean. There are only two people using it.
Can we put some logging in the encoder which is useful? It seems that when the encoder is done, we should know if the encode is "broken" or not. If we put some logging in here, we will actually be able to find it again.
When I upload files on Monday morning, and on Tuesday morning, and on Wednesday morning... and eventually find time on Saturday or maybe Sunday, the streamer logs are so far in the past as to be gone.
Let's use some of our cleverness to solve the problem, the computer is [still] stupid (for the moment…)
from avideo.
Not saying this is causing issue but in your php.ini for apache2 settings you have:
upload_max_filesize = 10240M
Yes?
What are the settings for:
max_execution_time = ?
max_input_time = ?
memory_limit = ?
(should be slightly larger than post_max_size, something like 10252M)
post_max_size = ?
(should be slightly larger than upload_max_filesize, something like 10246M)
from avideo.
max_execution_time = 7200
memory_limit = 512M
max_input_time = 60
post_max_size = 10G
I just did a deeper dive. Filtering /mvideos on Broken Missing Files doesn't do anything (finds nothing). You have to open every videos page before it even knows that it has a "broken missing files" condition - that seems to be the only place its detected. So I have a LOT more of these than I was aware of.
I'm using this /plugin/MobileManager/upload.php which Daniel said to use about a year ago.
It used to work.
Now it seems like it does nothing but fall on its face.
I literally cannot use the regular encode/upload flow as it takes a retarded number of steps which equates to about 3-4 minutes per video including doing the thumbnail - not going to happen.
My script which calls this accomplishes everything with about 5 seconds of user time required but it seems like it has been broken for some time now.
from avideo.
from avideo.
Daniel - we went through this already and there is nothing in the encoder logs.
I've just come to the realization that it is failing more like 80% of the time. It will fail fo a short 5 minute video, and work for a 90 minute video - so I don't think its a resource constraint.
What can we do to diagnose / debug this when there is nothing in the encoder log for all of these broken/missing files?
from avideo.
I am not asking for the logs, I am asking for some clues, without clues I cannot help
but any way, I hardly can help if there is nothing in the logs
from avideo.
In order of size, memory_limit should be larger than post_max_size and post_max_size should be larger than upload_max_filesize (there's inherent overhead in addition to uploaded video). You also may want to change max_input_time to match max_exection_time. Your setting of 60 seconds may timeout prior to parsing an uploaded video.
from avideo.
Related Issues (20)
- Short and reels HOT 3
- Site menus are not working on mobile HOT 3
- ERROR uploadPoster.php HOT 1
- Cannot login to site - No top menus showing - Videos not playing HOT 4
- Encoder is still broken HOT 3
- The encoder /videos directory is full of junk. Do we need any of it? HOT 1
- "Session Timeout in Seconds" is set to 14400. The actual timeout is <5 minutes before we must log in again. HOT 4
- Changing the encoder in "Advanced Configuration" does not work. THe system continues to use the old encoder. HOT 2
- Is there a new update for the network encoder / install instructions? HOT 2
- Adding a video to a playlist adds to the bottom of the list. This has been inverted; it used to (correctly) place at the top. HOT 2
- (Backup Plugin) Restore Backup files fom command possible ? HOT 3
- Editing video description fields don't refresh HOT 3
- advanced video editing HOT 4
- Black frame showing in the main page HOT 1
- advanced video editing HOT 1
- errors after update HOT 18
- the upload Encorder Butoon is not showing for all users HOT 2
- MP4ThumbsAndGif error after plugin update HOT 1
- Is there any documentation for developing your own plugins? HOT 1
- subtitle plugin is not working HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from avideo.