Re: [Virtuoso 7] Upload large RDF file into quad store

While I have no experience with Virtuoso, some databases are not capable of
working with data beyond a particular size. Even when the store can be
force-fed the data, the resulting system can be unstable, making all that
effort pointless.

Are you able to use any other stores? If so, then I'd encourage you to try
some out and see how they go.

Regards,
Paul Gearon



On Wed, Feb 5, 2014 at 10:19 AM, Souza, Renan F. S. <
renan123@missouristate.edu> wrote:

> Dear all,
>
> I am using virtuoso-open-source-7.0.0.
> What is a good way of uploading a large file (say 5GB) into Virtuoso 7
> database? It is a Turtle file format, around 50M triples.
>
> Solutions I tried:
> 1) Upload the entire file at once
> I tried more than once and all times it got stuck while having exactly 39%
> uploaded using Conductor quad store uploader, then nothing seems to change
> after that.
>
> 2) Split the file into may shorter files (~150 MB each) and upload each of
> them separately.
> 2.1. I tried to upload them programmatically using Open RDF API for Java,
> but it takes forever to upload a single file. I could not wait, so I do not
> know exactly how long it takes.
> 2.2. I tried to upload them manually using Conductor quad store uploader.
> These smaller files seem get uploaded very quickly in the beginning, but it
> somehow stops working after having some of the data uploaded, then I am
> unable to upload more files.
>
> I do not know what else to do.
>
> Have you ever had to do something like this? What did you do?
>
> Thanks a lot in advance.
>
> -
> Thank you!
> Regards,
>
> Souza, Renan F. S.
> Bachelor of Computer Science Student
> Federal University of Rio de Janeiro, Brazil
> Missouri State University, Springfield, MO
>
> +55-21-99257-3934
> Personal email: renan-francisco@hotmail.com
>