Re: Minimizing data volume

On 9-9-2013 12:30, Sarven Capadisli wrote:
> On 09/09/2013 11:47 AM, Frans Knibbe | Geodan wrote:
>> Hello,
>>
>> In my line of work (geographical information) I often deal with high
>> volume data. The high volume is caused by single facts having a big
>> size. A single 2D or 3D geometry is often encoded as a single text
>> string and can consist of thousands of numbers (coordinates). It is easy
>> to see that this can cause performance issues with transferring and
>> processing data. So I wonder about the state of the art in minimizing
>> data volume in Linked Data. I know that careful publication of data will
>> help a bit: multiple levels of detail could be published, coordinates
>> could use significant digits (they almost never do), but it seems to me
>> that some kind of compression is needed too. Is there something like a
>> common approach to data compression at the moment? Something that is
>> understood by both publishers and consumers of data?
>>
>> Regards,
>> Frans
>
> You might want to look into RDF HDT [1].
>
> [1] http://www.rdfhdt.org/

Thank you! That looks promising, especially since it is a W3C 
enterprise. After having read the explanation of HDT I do wonder about 
how content negotiation and compression of literals are handled, but I 
see HDT has its own forum so I can post any further questions there.

>
> -Sarven
> http://csarven.ca/#i
>
>


-