Re: Introducing CBOR-LD...

[apologies to Manu who already saw this response in the VC CG mailing list]

Manu - I agree that there is a problem to be solved here, and I appreciate the work that you and your team has done to architect one possible approach.

While the use of a pre-defined dictionary approach to improving compression ratios is well established and proven - there is a reason that it isn't used for data that is "long lived" -  versioning (or lack thereof).  There is no way to for a given decoder to know what version of the dictionary was used to compress the data - and (of course) they must match.  In our world where (standard) schemas are being created & edited daily, let alone the existence of custom ones - I just don't see how this will work for the types of data being considered here (eg. VC's)

Accordingly, I don’t see this as a viable option.

Leonard

On 7/23/20, 9:38 PM, "Manu Sporny" <msporny@digitalbazaar.com> wrote:

    Hi JSON-LD WG (bcc: JSON-LD CG),

    This email introduces CBOR-LD, the Concise Binary Object Representation
    for Linked Data.

    CBOR-LD provides a general purpose algorithm to compress JSON-LD
    documents, such as W3C Verifiable Credentials and W3C Decentralized
    Identifier Documents, to a compact binary representation. Using this new
    technology, it is possible to achieve compression ratios north of 300%,
    resulting in new ecosystem capabilities like being able to squeeze a
    digitally signed Verifiable Credential into a relatively small QR Code,
    store 3x as many VCs in a digital wallet, and other gains in storage
    efficiency. The algorithm is generalized and is able to achieve these
    gains for many types of JSON-LD inputs.

    An introductory presentation on CBOR-LD is attached as a PDF. The latest
    copy of the presentation is here:

    https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fpresentation%2Fd%2F1ksh-gUdjJJwDpdleasvs9aRXEmeRvqhkVWqeitx5ZAE%2Fedit&amp;data=02%7C01%7Clrosenth%40adobe.com%7Cc12dd591688e4f3ca33d08d82f723040%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637311515062783924&amp;sdata=K1OZioTwwzmd3Fqw%2FsjBf9IbaTqkTvt9uBUpBk7WSpE%3D&amp;reserved=0


    There is an implementation of the concepts outlined in the presentation
    above here in Node.js (browser-based version coming soon-ish):

    https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fdigitalbazaar%2Fcborld&amp;data=02%7C01%7Clrosenth%40adobe.com%7Cc12dd591688e4f3ca33d08d82f723040%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637311515062783924&amp;sdata=F%2Fsa6ccTUWDOnUKiCvOGqPBgBCIVMN0q%2FPD4bQqg500%3D&amp;reserved=0


    A very rough specification is forming here:

    https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdigitalbazaar.github.io%2Fcbor-ld-spec%2F&amp;data=02%7C01%7Clrosenth%40adobe.com%7Cc12dd591688e4f3ca33d08d82f723040%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637311515062783924&amp;sdata=R0bsLsOWwbFWoaDNtpSfWIbcnWENOllx7yY6wgN%2FRWY%3D&amp;reserved=0


    This is mostly just a notification for work that is ready for public
    circulation, discussion, and feedback. Digital Bazaar feels pretty
    confident in the direction of the work at this point, but also caution
    that this is merely a start and there will need to be many more months
    of work put into it to discover bugs, finalize the general algorithm,
    and other perform other nascent technology gyrations. We would not
    recommend that anyone implement the technology at this time without
    reading the source implementation above. There are known bugs and this
    technology isn't ready for prime time -- DO NOT use it for production
    deployments unless you really know what you're doing -- expect things to
    change.

    We will have a public presentation on CBOR-LD in a few weeks and will
    let this group know when and where that is happening. In the meantime,
    questions and feedback via the mailing list and via the appropriate
    Github issue tracker is appreciated.

    -- manu

    -- 
    Manu Sporny - https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fin%2Fmanusporny%2F&amp;data=02%7C01%7Clrosenth%40adobe.com%7Cc12dd591688e4f3ca33d08d82f723040%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637311515062793920&amp;sdata=V%2Fk8sDyMFtU7VczxqceDyN%2BNa0kzf%2FHlQ%2FfbyUxTid8%3D&amp;reserved=0

    Founder/CEO - Digital Bazaar, Inc.
    blog: Veres One Decentralized Identifier Blockchain Launches
    https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftinyurl.com%2Fveres-one-launches&amp;data=02%7C01%7Clrosenth%40adobe.com%7Cc12dd591688e4f3ca33d08d82f723040%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C637311515062793920&amp;sdata=bEyX%2Fv%2FAlXtprgt8usUrOKv8JA0OwzMSTNIcXnvdco0%3D&amp;reserved=0

Received on Friday, 24 July 2020 14:00:49 UTC