Upload and host files locally
I need to crawl the following Commons site:
and to insure that archive-it crawls it correctly, we need to locally host all video and audio on the server. I addition to file sizes limits and possible file type restrictions, I am wondering if we need to send you these files via dropbox to upload to Common server? Would that be possible?
Also, I might need to build a standalone child page within the domain scope of justpublics365.commons.gc.cuny.edu and send to you. Would that also be possible?
#4 Updated by Stephen Klein about 3 years ago
There is little documentation on what goes wrong, but I know from using that it cannot handle Vimeo or soundcloud embeds, struggles with youtube embeds, etc.
#6 Updated by Stephen Klein about 3 years ago
I am not sure of the # or size of video and audio files; I am waiting to hear back from Polly, etc.
I may have a workaround that I need to test that would not require assistance from the Commons crew, but I will need assistance if the workaround does not work. Let's sit on this for now, I will know in a few days. Appreciate your patience.
#8 Updated by Stephen Klein about 3 years ago
But doesn't JITP locally host their media on the Commons?
This was a recommendation.
The multimedia guidelines need editing, but the intent is for us to host locally for preservation reasons:
Authors of video and multimedia texts are advised that submissions should already be in edited and polished form, and must be capable of being stored locally (i.e. not on YouTube or elsewhere in the cloud). Please send compressed files or links to your server. Multimedia pieces significantly longer than 5-10 minutes are probably not likely to be article-equivalent, and thus might be a better match for a publisher other than a journal. Please email the editors at firstname.lastname@example.org with any queries.1
#11 Updated by Matt Gold about 3 years ago
Okay -- but since this involves the Commons, it would have been good to have contacted the Commons team before adopting this as a policy of the journal.
I am not saying no definitely for JITP, but again, our standing policy is not to host large video files. We will consider exceptions to that policy, but we would need detail on the number of files, the size of the files, and the expected viewing load. Our general policy is to have users upload content to third-party servers and embed it from there on Commons sites.
#13 Updated by Raymond Hoh about 3 years ago
Sorry to jump in without any background context, but I'm just going through some issues on Redmine and came across this one.
Stephen, what is the purpose of crawling your site? if you are crawling your JP365 site just to archive the content for backup purposes, there are ways to download Soundcloud and Vimeo files. Just to note that there are potential copyright issues with mirroring media content. If the content is your own, then disregard my last comment.
If you're talking about hosting and serving these files on the Commons, I'll leave that to Matt.
#15 Updated by Raymond Hoh about 3 years ago
In that case, one solution is to download the media files and host them on Google Drive. Then, you could use our Google Docs Shortcode plugin to embed them.
The Google Docs Shortcode plugin should be able to embed most media items properly.
If your colleague wants to explore this option, then I can help you download these files from sites such as Vimeo, etc. If you do use this option, perhaps your colleague can add the media URL as a reference in their book.
#18 Updated by Stephen Klein almost 3 years ago
I still have an open ticket with archive-it.
#21 Updated by Stephen Klein over 1 year ago
Hosting video and audio on archive.org and using this methodology:
So, I am not sure how relevant & how to get out the message, but it would be good if folks used archive.org rather than youtube or vimeo to insure better sustainability.