Very Large Files in the PKP PLN

ctgraham 2017-07-14 15:55:42 UTC #1

If we begin adding Very Large Files (say, for example, an 8 gigabyte video file or dataset) to our journals, will the PKP Private LOCKSS Network plugin be happy transferring such large data?

mjoyce 2017-07-14 16:13:31 UTC #2

I don't think the PKP PLN will be able to handle it. OJS embeds video as base64 elements inside the XML, so the resulting deposit XML is likely to be much much larger. Our tools are unlikely to validate XML of that size, or scan the embedded content for viruses.

Maybe @mjordan can give a better answer.

ctgraham 2017-07-14 19:20:44 UTC #3

If failure is expected, will it be a soft fail (recoverable, with other content still captured), or a hard fail (breaking, with other content prevented from capture)?

mjoyce 2017-07-17 18:00:40 UTC #4

There's a good chance it'll prevent other content getting processed, yes.

ctgraham 2017-07-17 19:29:45 UTC #5

So, what is the practical limit of file sizes for the PLN?

ctgraham 2017-07-24 14:41:00 UTC #6

^ Bump. @mjoyce, @mjordan?

mjordan 2017-07-24 16:17:16 UTC #7

Hi @ctgraham, there are a lot of variables that will influence the maximum size of a individual file coming out of an OJS instance and moving through the PKP PLN pipeline. @mjoyce will contact you to get some sample data so we can test.