Re: Think before you write Semantic Web crawlers

> Sorry, but if paying for a service is what is required to protect
> publishers from massive abuse of their resources


No, not what I meant. You can also implement simple methods already
discussed here. Now if your provider does not support that, then you'd be
better off changing to another provider that does. As with any technological
advance, the slower businesses are left behind. As for paying or not, I'm
sure there will be creative people able to create a business model that will
balance the technological requirements and user demand.

> I will personally email every Drupal user account on drupal.org and tell
> them to turn of RDF module


Radical, no?
If the Drupal RDF module takes up significantly more resources to generate
its output as compared to the HTML and other renderers, then YES, it should
protect itself. Instead of e-mailing every Drupal user, e-mail the Drupal
RDF module developers and request them to implement protection.

Cheers,
Pablo

On Thu, Jun 23, 2011 at 12:38 PM, Lin Clark <lin.w.clark@gmail.com> wrote:

>
> On Thu, Jun 23, 2011 at 10:12 AM, Pablo Mendes <pablomendes@gmail.com>wrote:
>>
>> Maybe we should also consider that companies/universities advising people
>> (esp. small companies) to publish Linked Data, should give them complete
>> advice, including protection.  If their providers are not able to implement
>> such simple solutions such as throttling, white/blacklisting, then this a
>> business opportunity. One could sell Safe Linked Data provision (potentially
>> including all the WebID goodness) as a package that both shows the beauty
>> and protects from bad behavior.
>>
> Sorry, but if paying for a service is what is required to protect
> publishers from massive abuse of their resources, then I will personally
> email every Drupal user account on drupal.org and tell them to turn of RDF
> module and forget about Linked Data. Fortunately, I think that the Linked
> Data community can come up with a better way to handle this kind of abuse.
>
> I know this proposal was with the best of intentions, but it simply isn't
> something I would be willing to stand behind.
>
> -Lin
>