Giter Club home page Giter Club logo

avideo-storage's People

Contributors

akhilleusuggo avatar alexious avatar danielnetodotcom avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

avideo-storage's Issues

Add up storage to my YPT

Hi, I have a question please !
I added an extra storage to my YPT site so that to extend the size of hosting using YPT storage plugin, but I can't get it working. I mounted the drive inside the website folder in the but still no luck. can somebody guide me with some useful information and what configurations need to be done so that my HDD appears as extended storage on my website.

thanks

img

I see that only the videos are moved to a different server .
Is there anyway to use this script to move img/webp/gifs to a storage server dedicated only for the img/webp/gifs . This will improve a lot the speed of the server / IO .

I have the main server with 120GB Nvem SSD , and the Database is doing great , but at some point may reach the limit .

That's why I was wondering if there's anyway to move img/webp/gifs to another server/directory .
This same script/plugin could have this option

Can't move HLS video

Only HLS videos can't get transferred .
The zips are created , but nothing happens . They're stuck on the streamer site .
image

On the Storage site :

image

Under Status Done :
image

Logs :

Site Response {"error":true,"msg":"The filesize in the storage is smaller then 1 Mb ","aVideoStorageURL":"https:\/\/example.com\/","filename":"\/var\/www\/html\/AVideo-Storage\/videos\/_ID65.07571854.tgz"}
Finished
The filesize in the storage is smaller then 1 Mb

Backup of AVideo-Storage video folder

Hello

Is there a preferred way of backing up the videos in an AVideo-Storage server?

Should I use the "Backup" plugin? I'm not sure if it is able to backup the files in an external Storage server

Thank you

Installation command failed 404

@DanielnetoDotCom Danny, I noticed that the installation command is missing the permissions:
sudo chmod -R 755 /var/www/html/AVideo-Storage

Without this command, the files become inaccessible and give a 404 error.

errorr storage

Hello, I decided to add one more storage and ran into a problem, some files seem to be transferred, then their size in the streamer increases, and it is also not displayed that they have been transferred. Basically, these are large files. I so wanted to be able to install everything and everything worked, but I always come across this. Unfortunately, one instruction is not enough for proper operation. Even when you try to throw it off for the second time, it starts not from the beginning, but from 50.
Screenshot_6
Screenshot_5
Screenshot_2

Screenshot_3
Screenshot_7

YPTStorage is not working

I got this log
[07-Oct-2020 15:23:27 UTC] PHP Fatal error: Uncaught Error: Class 'PluginTags' not found in /var/www/FLC/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code:11
Stack trace:
#0 /var/www/FLC/objects/plugin.php(211): YPTStorage->getTags()
#1 /var/www/FLC/objects/pluginsAvailable.json.php(9): Plugin::getAvailablePlugins()
#2 {main}
thrown in /var/www/FLC/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code on line 11

No plugin called YPTStorage Plugin

Enable YPTStorage Plugin
Make sure you enable it before your installation, this is necessary because the Storage installation will check your plugin during the configuration assistant

If you do not have the plugin yet, get it here

I don't see any plugin called like this , not on the web you linked or anywhere . Do I need to git pull or something ?

SecureVideosDirectory

in the apache2 error log, the following information is displayed with each access:
{" authorization ": true," msg ":" SecureVideosDirectory NOT enabled "}
I suspect it refers to the same plugin.
The storage works normally it is only the hint.
What does that mean?

greeting
Donnerstein

YPTStorage connected to local NFS mount issue

Hi Daniel,

Here is my issue which causes me some problems, major ones. I have two main server as you know, one is our Live streaming, which is connected to few storage places through NFS mounts. The problem is that if one of those mounts or basically server that mount is connected to goes down, there is no way for AVideo to know this and users will still requests for videos which are stored there that are now not available. Instead of announcing to the user that the video is currently unavailable until the storage location is back online, the request for the video goes through and the server get choked with requests to unavailable storage location. This makes me reboot the server with the storage unmounted until its back online and I can reconnect it again.

  1. There needs to be a way to notify the user and make a simple check to see if the storage location is available and the video is available before trying to load it, taking cpu resources and more.
  2. There needs to be another filter for the videos to display them based on the storage location their at. With many videos its hard to keep track on what is stored where.

I think the plugin works great and helps manage and solve storage issues but it requires some more attention as it is crucial for the sites to operate properly while storage issues arise.

Best Regards,

errorHandlerPsi : - PHP throws a error

There is message of error
errorHandlerPsi : - PHP throws a error
Level : 8 Message : fgets(): read of 8192 bytes failed with errno=22 Invalid argument File : /var/www/html/AVideo-Storage/phpsysinfo/includes/class.CommonFunctions.inc.php Line : 372

Steps to reproduce

  1. install AVideo-Storage server as documentation on ubuntu 20.04 and activate the plugin on the avideo-server
  2. move some videos on the avideo-storage from avideo-server video panel.
  3. go to the avideo-storage and press SYS-info tab
    Result:
    there is a warning icon on te title. Pressing on it appear this error message:
    Captura de pantalla de 2021-05-04 18-18-53

here my sys info of the storage server
Captura de pantalla de 2021-05-04 18-19-06

Note: The system is working, but this error can be a problem in the future

3 Proposals improvement for AVideo-Storage

  1. To see how much space I have available I have to go to the Storage server in use, and look at "Mounted Filesystems".
    It would be very good if this information was available directly on the Streaming Server with colours bars for each storage server, in the Videos page.

  2. Also that the Videos can be filtered by Storage, so that it is possible to see which are the videos present in a Storage server or in the others.

  3. Another suggestion is that you can manage the replicas of the videos in several copies of servers, so that if a server storage is down, your partner can take over even if it is in the other part of the world. I know that this can be done easily with several computers in the same datacenter, but:
    a) It is not easy for everyone.
    b) if it happens that the datacenter catches fire (like OVH in France for example) this will not help.
    c) many times it is not that the server has crashed, but that it is not reachable by the user. On the other hand, the user press the play button, a javascript has 2 url available to show the video, and if the first url does not answer, then it would automatically go to the second in a transparent way for the client

regards
MaX

CDN rederict

Hello, you can somehow do so that using the CDN address and going to it, we do not get to the original page, how can we hide the real address or simply deny access to the page for ordinary users.

Question

So if my streaming site has 20-30Gb , and each storage 1TB let's say . The streaming site acts like a DNS for each storage site ?
And how the plugins FTP and AWS works ? Does the streaming site has to download the files to share them to the viewers ? Or does it act as a link to the FTP storage ?
I mean the bandwidth , where is consumed from ? The streaming site or the FTP server ?
Thanks

transfer problems

when there's a transfer between servers , the compressed files ( HLS ) , does not get deleted after the transfer , not the videos's folders are deleted .

I've just moved all the videos to Local , and when checking ths Storage site :

image

image

The deleteOrphanFiles.php does not help

I can't move video to new storage

I got the following error log.

PHP Fatal error: Uncaught Error: Call to undefined function _error_log() in /var/www/AVideo/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code:659
Stack trace:
#0 /var/www/AVideo/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code(530): YPTStorage::log(77, 'Start (Local to...')
#1 /var/www/AVideo/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code(725): YPTStorage::moveFromLocalToSite(77, '2')
#2 /var/www/AVideo/plugin/AVideoPlugin.php(506): YPTStorage->afterNewVideo(77)
#3 /var/www/AVideo/objects/aVideoEncoderNotifyIsDone.json.php(58): AVideoPlugin::afterNewVideo(77)
#4 {main}
thrown in /var/www/AVideo/plugin/YPTStorage/YPTStorage.php(14) : eval()'d code(1) : eval()'d code on line 659

What's the price of Avideo storages?

I searched Avideo website and WWBN website, didn't find Avideo storage price structure. Could you let me know how you charge storage and bandwidth?

Problem with using Storage and Encoder together on the same server ...

Hello!
For the first thing I wanted once again to thank the author of the platform because only for his merits I can now experience the full power of this architecture with multiple servers each with its own task.

I tried to load on the same Debian 10 server ... according to them Wiki ... and apparently everything works ... the only thing is that when transferring the converted files from the encoder instead of moving to the same server with also, the Storage script ... the converted files disappear ...) it does not even appear in the Streamer in the video management (local) ...
I tried to put back as before, the old external encoder that is on another server (a third IP) and everything works well ... there seems to be a wrong management of the videos in the Sreamer because in the description of the videos it appears as the destination of the videos the local area ... but in the local area (Streamers / videos) I can't find them ... in addition, the link doesn't even appear ...

1

Disable directory browsing

Options All -Indexes

This line is giving me too many error logs, Removing the "minus* sign" fixes my problem.

AH01276: Cannot serve directory /var/www/html/AVideo-Storage/videos/xxxxxxxxxxx65.92760120/: No matching DirectoryIndex (index.html,index.cgi,index.pl,index.php,index.xhtml,index.htm) found, and server-generated directory index forbidden by Options directive

This issue is related to WWBN/AVideo#5680

Update Disk Usage ;

When I update disk usage , does not report the right usage . For some reason does it multiple times . Those are the logs of after 1 click on disk update usage .

[30/Jun/2020:08:52:54 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_HD.mp4 HTTP/1.1" 200 3646 "-" "-"
[30/Jun/2020:08:52:59 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_Low.mp4 HTTP/1.1" 200 3645 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_SD.mp4 HTTP/1.1" 200 3645 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_HD.mp4 HTTP/1.1" 200 3646 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_Low.mp4 HTTP/1.1" 200 3645 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_SD.mp4 HTTP/1.1" 200 3645 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_HD.mp4 HTTP/1.1" 200 3646 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_Low.mp4 HTTP/1.1" 200 3645 "-" "-"
[30/Jun/2020:08:53:00 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_SD.mp4 HTTP/1.1" 200 3645 "-" "-"
 [30/Jun/2020:08:53:01 +0000] "HEAD /videos/_YPTuniqid_5ef852e370b841.68237251_HD.mp4 HTTP/1.1" 200 3646 "-" "-"

File size shown on MyVideos section :
image

Real file size :
image

Usefulness of YouPHPTube-Storage

hi can u please explain better why this is better than s3 or wasabi? i mean u can get 1TB space on wasabi for $5 per month. i dont know any server seller that will sell you storage space of 1TB for less than $5. so why would buying my own storage to use with this plugin be more cost-effective? i dont get it.

bzip2

Why are we using the slowest compression method ? Really really slow . Like 4-8mb/s with luck .
Can you change it to something else ? Anything special about this type of compression ?

Algorithm     Compressed size        Compression          Decompression

lzop           398MB    20.8%      4.2s    455.6MB/s     3.1s    617.3MB/s
lz4            416MB    21.7%      4.5s    424.2MB/s     1.6s   1181.3MB/s
brotli (q0)    307MB    16.1%      7.3s    262.1MB/s     4.9s    390.5MB/s
brotli (q1)    234MB    12.2%      8.7s    220.0MB/s     4.9s    390.5MB/s
zstd           266MB    13.9%     11.9s    161.1MB/s     3.5s    539.5MB/s
pigz (x4)      232MB    12.1%     13.1s    146.1MB/s     4.2s    455.6MB/s
gzip           232MB    12.1%     39.1s     48.9MB/s     9.2s    208.0MB/s
lbzip2 (x4)    188MB     9.9%     42.0s     45.6MB/s    13.2s    144.9MB/s
pbzip2 (x4)    189MB     9.9%    117.5s     16.3MB/s    20.1s     95.2MB/s
bzip2          189MB     9.9%    273.4s      7.0MB/s    42.8s     44.7MB/s
pixz (x4)      132MB     6.9%    456.3s      4.2MB/s     7.9s    242.2MB/s
xz             132MB     6.9%   1027.8s      1.9MB/s    17.3s    110.6MB/s
brotli (q11)   141MB     7.4%   4979.2s      0.4MB/s     3.6s    531.6MB/s

https://serverfault.com/questions/872749/bzip2-too-slow-multiple-cores-are-avaible

No matter how much compression we use , the file-size will not decrease .

New naming convention in YPTStorage 4.0 makes the Streamer unable to reproduce old and new videos

Hello, after the last YPTStorage 4.0 update, from a 3.X version, my Streamer can't reproduce videos from the Storage anymore.

I've found in the Apache HTTP Server access.log of the Storage, that the Streamer calls for videos in the Storage stopped getting a successful 206 code (before the update), and started getting an error 404 code (after the update).

The reason is the new directory structure after the update, the Streamer went from asking for the video file like this (this is an older video with the older naming convention, but it also fails for newly uploaded videos with the new naming convention):
/videos/_YPTuniqid_20951ace116687.06176394_HD.mp4

To ask like this (each video being in a folder, named like the video):
/videos/_YPTuniqid_20951ace116687.06176394/_YPTuniqid_20951ace116687.06176394_HD.mp4

So, since the path invoked by the Streamer doesn't exactly exist in the Storage, the video never loads. If there was an update script for this, it failed in my case.

I tried to:

-re-install the YPTStorage plugin
-de-activate the YPTStorage plugin and activate it again
-edit the options in the Admin Panel and in the Plugin options

But it still fails for both:

-old videos fail with their old naming convention
-new videos also fail, with their new naming convention

If I manually create the folder and manually move the video into the folder, the Streamer is again able to reproduce the video.

How should I proceed?

Thank you

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.