Very Large Files in the PKP PLN


#1

@mjoyce,

If we begin adding Very Large Files (say, for example, an 8 gigabyte video file or dataset) to our journals, will the PKP Private LOCKSS Network plugin be happy transferring such large data?


#2

I don’t think the PKP PLN will be able to handle it. OJS embeds video as base64 elements inside the XML, so the resulting deposit XML is likely to be much much larger. Our tools are unlikely to validate XML of that size, or scan the embedded content for viruses.

Maybe @mjordan can give a better answer.


#3

If failure is expected, will it be a soft fail (recoverable, with other content still captured), or a hard fail (breaking, with other content prevented from capture)?


#4

There’s a good chance it’ll prevent other content getting processed, yes.


#5

So, what is the practical limit of file sizes for the PLN?


#6

^ Bump. @mjoyce, @mjordan?


#7

Hi @ctgraham, there are a lot of variables that will influence the maximum size of a individual file coming out of an OJS instance and moving through the PKP PLN pipeline. @mjoyce will contact you to get some sample data so we can test.