Re: [External] Re: Synchronization Accessibility User Requirements: Speech recognition accuracy

Thank you Janina. Your version is good. One question -- do you cite or
footnote? It would be good to add a link to the FCC approvals, which are
permanent links.

On Wed, Sep 1, 2021 at 3:29 PM White, Jason J <jjwhite@ets.org> wrote:

> Thank you, Janina, I am satisfied with your version.
>
> -----Original Message-----
> From: Janina Sajka <janina@rednote.net>
> Sent: Wednesday, 1 September 2021 15:24
> To: White, Jason J <jjwhite@ets.org>
> Cc: Noble, Stephen <steve.noble@pearson.com>; public-rqtf@w3.org; Judy
> Brewer <jbrewer@w3.org>; Raja Kushalnagar <raja.kushalnagar@gallaudet.edu>
> Subject: [EXTERNAL] Re: Synchronization Accessibility User Requirements:
> Speech recognition accuracy
>
> Suggesting an edit, and adding Judy and Raja to the cc's ...
>
> "The Task Force is also aware of recent decisions by the U.S. Federal
> Communications Commission granting conditional certification for ASR
> generated captions in Internet telephony. This and similar research or
> regulatory activities will be of interest for subsequent drafts of this
> document."
>
> White, Jason J writes:
> > Suppose we add something along the lines of the following at the end of
> the existing editors' note:
> > "The Task Force is also aware of recent decisions by the U.S. Federal
> Communications Commission granting conditional certification of Internet
> telephony-based services that use ASR to generate captions. This and any
> other recent research or regulatory activities are of interest as the Task
> Force works to revise the discussion of synchronization and ASR accuracy in
> subsequent drafts of this document."
> >
> > -----Original Message-----
> > From: Janina Sajka <janina@rednote.net>
> > Sent: Wednesday, 1 September 2021 11:27
> > To: White, Jason J <jjwhite@ets.org>
> > Cc: Noble, Stephen <steve.noble@pearson.com>; public-rqtf@w3.org
> > Subject: Re: Synchronization Accessibility User Requirements: Speech
> > recognition accuracy
> >
> > It might be interesting to know whether other governments have done
> similar things. I think we're only aware of U.S. activity to date.
> >
> > White, Jason J writes:
> > > Should we request reviewers to cite any other regulatory efforts in
> this area? We already request comments in a general way, so I don't think a
> call for regulatory references is needed, but we could include it if it
> would be helpful in soliciting comments.
> > >
> > > -----Original Message-----
> > > From: Janina Sajka <janina@rednote.net>
> > > Sent: Wednesday, 1 September 2021 11:17
> > > To: White, Jason J <jjwhite@ets.org>
> > > Cc: Noble, Stephen <steve.noble@pearson.com>; public-rqtf@w3.org
> > > Subject: Re: [EXTERNAL] Re: Synchronization Accessibility User
> > > Requirements: Speech recognition accuracy
> > >
> > > So I'm thinking of language in our note that says something like ...
> > >
> > > We are of recent rulings from the U.S. Federal Communications
> Commission allowing use of ASR under certain circumstances and may
> incorporate additional content from their findings in future revisions of
> this document.
> > >
> > > end language. I don't think we need say more than that. Perhaps
> "ruling"
> > > or some other portion of the above could be a hyperlink to that
> document?
> > >
> > > Jason, Steve, others, if you agree we can run this by Judy and Raja
> and perhaps go forward with that? Thoughts?
> > >
> > > Janina
> > >
> > > White, Jason J writes:
> > > > The underlying ruling appears to be in this 2018 document (see
> paragraph 48 et seq):
> > > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2F
> > > > do
> > > > cs
> > > > .fcc.gov%2Fpublic%2Fattachments%2FFCC-18-79A1.docx&amp;data=04%7C0
> > > > 1%
> > > > 7C
> > > > jjwhite%40ets.org%7C4a3e187064354b2c804408d96d5b9180%7C0ba6e9b760b
> > > > 34
> > > > fa
> > > > e92f37e6ddd9e9b65%7C0%7C0%7C637661062328800213%7CUnknown%7CTWFpbGZ
> > > > sb
> > > > 3d
> > > > 8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3
> > > > D%
> > > > 7C
> > > > 1000&amp;sdata=wWfKYBd%2F2Xd6jorTNcLnTp%2FRdG24b5Dl0X3YVHcdnOw%3D&
> > > > am
> > > > p;
> > > > reserved=0 where delay and accuracy are discussed with reference
> > > > to a Mitre Corporation study and to claims of accuracy by Google and
> Microsoft.
> > > > The first certification of a captioning service using only automatic
> speech recognition dates from 2020:
> > > >
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.
> > > > fcc.gov%2Fdocument%2Ffcc-certifies-first-ip-cts-using-only-automat
> > > > ic
> > > > -s
> > > > peech-recognition&amp;data=04%7C01%7Cjjwhite%40ets.org%7C4a3e18706
> > > > 43
> > > > 54
> > > > b2c804408d96d5b9180%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C6
> > > > 37
> > > > 66
> > > > 1062328800213%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoi
> > > > V2
> > > > lu
> > > > MzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=%2FYVDa0eTcnE1
> > > > PK
> > > > FC
> > > > AbpKR0Oj2FtJIHKnAL%2BvrJmU14I%3D&amp;reserved=0
> > > > Thus, as discussed at the meeting today, the most recent grant seems
> to be effectively a continuation of the existing policy of allowing ASR to
> be used for government-funded, telephony-based captioning services. I
> haven't looked at the details of the conditions under which this is
> authorized.
> > > >
> > > > -----Original Message-----
> > > > From: Janina Sajka <janina@rednote.net>
> > > > Sent: Wednesday, 1 September 2021 3:20
> > > > To: Noble, Stephen <steve.noble@pearson.com>
> > > > Cc: White, Jason J <jjwhite@ets.org>; public-rqtf@w3.org
> > > > Subject: [EXTERNAL] Re: Synchronization Accessibility User
> > > > Requirements: Speech recognition accuracy
> > > >
> > > > CAUTION: This email originated from outside of our organization. Do
> not click links or open attachments unless you recognize the sender and
> know the content is safe.
> > > >
> > > > Thanks for catching this one, Steve. I think it's important we
> capture this in our FPWD somehow. If we don't, we'll almost certainly hear
> about the omission in the comments we receive.
> > > >
> > > > I'm noticing there's an FCC Order here. That establishes a
> regulatory ruling, and companies providing these services to customers will
> now be able to rely on ASR.
> > > >
> > > > I'm a bit unclear whether the order covers everything here, or
> whether there's stilla Notice of Proposed Rule Making (NPRM) buried in
> there for part of it. More coffee and more reading, I guess.
> > > >
> > > > In any case at a minimum we need to check whether their numbers
> comport with our current text. If they do, perhaps with only small
> variations, we can refer to the Order noting the FCC found similar numbers.
> > > >
> > > > If there's greater variance in what we have, it's probably worth
> digesting this FCC order more fully and adding it to our text.
> > > >
> > > > I'm eager to hear from Raja and others about this on the call.
> > > >
> > > > Best,
> > > >
> > > > Janina
> > > >
> > > > Noble, Stephen writes:
> > > > > I just saw this interesting and perhaps pertinent communication
> from the US Federal Communications Commission:
> > > > > IP CTS ASR-Only Authorization Granted to
> > > > > CaptionCall<https://nam10.safelinks.protection.outlook.com/?url=
> > > > > ht
> > > > > tp
> > > > > s%25
> > > > > 3A%2F%2Fwww.fcc.gov%2Fdocument%2Fip-cts-asr-only-authorization-g
> > > > > ra
> > > > > nt
> > > > > ed
> > > > > -captioncall&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7b55dede32ac
> > > > > 43
> > > > > 7f
> > > > > 0b
> > > > > 7708d96d18dbaa%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C6376
> > > > > 60
> > > > > 77
> > > > > 58
> > > > > 12391549%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2l
> > > > > uM
> > > > > zI
> > > > > iL
> > > > > CJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=DbKdfs4MawUVPkdTd
> > > > > 17
> > > > > %2 BM VfPsRAkJ57mApi6kC63Mtk%3D&amp;reserved=0>
> > > > >
> > > > > In particular, the files that are linked at the bottom of the page
> include some information that may be relevant to our discussion, and we
> should probably try to digest some of this information and see if any of it
> is relevant to the SAUR. Here is an interesting snippet from the background
> file. Unfortunately, some of this gets jumbled up because of all the
> footnotes, so you may want to read from the Word document they include.
> > > > > <start clip>
> > > > > 9. Captioning Speed / Delay.
> > > > > CaptionCall sufficiently supported its claim that its ASR
> technology will transcribe captions in real time and in compliance with the
> minimum TRS standards relating to captioning speed and delay. Currently,
> there is no quantitative standard for IP CTS caption delay per se.
> However, captions must be delivered “fast enough so that they keep up with
> the speed of the other party’s speech,” and “if captions are not keeping up
> with the speech (although a short delay is inevitable), at some point the
> provider is no longer offering relay service and the call is not
> compensable.”  Telecommunications Relay Services and Speech-to-Speech
> Services for Individuals with Hearing and Speech Disabilities;
> Internet-based Captioned Telephone Service, CG Docket No. 03-123,
> Declaratory Ruling, 22 FCC Rcd 379, 388-89, para. 22 & n.69 (2007) (2007 IP
> CTS Declaratory Ruling).  In addition, the typing speed standard for
> text-based TRS is applicable.  See id. at 388, para. 22 n.69; 47 CFR §
> 64.604(a)(1)(iii) (requiring TRS CAs to have a minimum typing speed of 60
> words per minute).  Based on the test results and other evidence discussed
> above, CaptionCall has shown that its fully automatic IP CTS not only will
> meet this standard but also will “keep up with the speed of the other
> party’s speech.”  2007 IP CTS Declaratory Ruling, 22 FCC Rcd at 388, para.
> 22.  On October 2, 2020, the Commission released a Further Notice of
> Proposed Rulemaking that proposed quantitative standards for IP CTS caption
> delay.  Misuse of Internet Protocol (IP) Captioned Telephone Service;
> Telecommunications Relay Services for Individuals with Hearing and Speech
> Disabilities; Structure and Practices of the Video Relay Service Program,
> CG Docket Nos. 13-24, 03-123, and 10-51, Report and Order, Order on
> Reconsideration, and Further Notice of Proposed Rulemaking, 35 FCC Rcd
> 10866, 10896-903, paras. 62-81 (2020) (IP CTS Metrics Further Notice).
> > > > >   CaptionCall reports that testing with simulations of audio files
> used for stenographer tests showed that its ASR-only captioning meets the
> typing speed standard of 60 words per minute. CaptionCall Application at
> 12; see also 47 CFR § 64.604(a)(1)(iii).
> > > > >   CaptionCall further states that internal testing found the
> ASR-only system averages a captioning delay “of less than 2 seconds from
> the time the phrase ends.” CaptionCall Application at 12 (emphasis added).
> > > > >   Additionally, in performance testing of CA-assisted and ASR-only
> IP CTS technologies by the Commission’s National Test Lab, See FCC
> Telecommunications Relay Services Project, Captioning Device Performance
> Testing: [Caption Call] Automated Speech Recognition (ASR) Assessment, CG
> Docket No. 03-123, at 2 (posted by CGB on April 19, 2021) (NTL Test
> Report).  The National Test Lab is operated by MITRE Corporation (MITRE) as
> part of the CMS Alliance to Modernize Healthcare Services, a Federally
> Funded Research and Development Center sponsored by the Centers for
> Medicare & Medicaid Services (CMS).  See CMS Alliance to Modernize
> Healthcare, Internet Protocol Caption Telephone Service (IP CTS) Devices:
> Summary of Phase I Activities, at 1 (July 24, 2017), CG Docket Nos. 13-24
> and 03-123 (filed by CGB Apr. 11, 2018).
> > > > >  CaptionCall’s median per-word caption delays for various call
> scenarios ranged from 3.3 to 3.8 seconds, while CA-assisted providers’
> median caption delays were significantly longer, averaging from 5.2 to 17..8
> seconds. NTL Test Report at 4.
> > > > >   These test results show that CaptionCall’s ASR-only captioning
> will satisfy the Commission’s minimum standards for captioning speed and
> delay.
> > > > >
> > > > > 10. Accuracy and Readability.
> > > > > Although the TRS rules do not currently provide metrics for
> accuracy and readability, the typing, grammar, and spelling of captions
> must be “competent,” and conversations must be transcribed “verbatim,” with
> no intentional alteration of content unless the user specifically requests
> summarization. 47 CFR § 64.604(a)(1)(ii), (2)(ii).  These standards apply
> to captions developed with ASR.  See Telecommunications Relay Services and
> Speech-to-Speech Services for Individual with Hearing and Speech
> Disabilities, CC Docket No. 98-67, Declaratory Ruling, 18 FCC Rcd 16121,
> 16134-35, paras. 37-39 (2003); 2018 ASR Declaratory Ruling, 33 FCC Rcd at
> 5832, para. 60.  The Commission recently proposed a quantitative standard
> for accuracy based on measuring word error rate.  IP CTS Metrics Further
> Notice, 35 FCC Rcd at 10900-02, paras. 71-78.
> > > > >   We find sufficient record evidence that CaptionCall’s fully
> automatic IP CTS will meet or exceed the Commission’s competence and
> “verbatim” requirements.  CaptionCall states that it evaluated the
> performance of leading ASR vendors and selected an ASR platform based on
> accuracy, transcription formatting, including punctuation and
> capitalization, and user-friendly handling of acronyms, prices, dates, and
> numerics. CaptionCall Application at 9, 13.
> > > > >   CaptionCall reports that it conducted internal testing of its
> engine’s captioning accuracy using the audio files developed by the
> National Test Lab.  The Word Error Rates reported from CaptionCall’s
> internal testing are comparable to results of National Test Lab testing of
> other conditionally certified ASR-only providers and compare favorably with
> the average results for CA-assisted providers, described below. Id. at 10;
> CaptionCall Reply at 2.  The numerical results were provided in the
> confidential version of the CaptionCall Application.
> > > > >
> > > > > 11. The National Test Lab’s own testing provides further evidence
> that, in terms of accuracy, CaptionCall’s ASR platform can outperform
> CA-assisted IP CTS.  In repeated tests of five call scenarios,
> CaptionCall’s ASR platform achieved median Word Error Rates ranging from
> 2.9 to 14.5, while CA-assisted providers’ median Word Error Rates ranged
> from 8.9 to 19.5 on average.
> > > > >   These test results sufficiently support our determination, for
> the purpose of conditional certification, that CaptionCall’s ASR-only
> captioning will meet or exceed the minimum TRS standards for competence and
> verbatim transcription, as well as CaptionCall’s claim that “[t]here is no
> reason to believe that CaptionCall’s implementation of ASR-only as
> described [in its application] will lead to service degradation.” We
> believe the MITRE test results, published after the close of the comment
> period on this application, supply sufficient public information on the
> latency and accuracy results to address the Consumer Groups’ concern about
> the transparency of testing for both caption delay and accuracy.
> > > > > <end clip>
> > > > >
> > > > > We might could include this as a reference if we think this is
> useful.
> > > > >
> > > > > --Steve
> > > > >
> > > > >
> > > > >
> > > > > Steve Noble
> > > > > Instructional Designer, Accessibility Psychometrics & Testing
> > > > > Services
> > > > >
> > > > > Pearson
> > > > >
> > > > > 502 969 3088
> > > > > steve.noble@pearson.com<mailto:steve.noble@pearson.com>
> > > > >
> > > > > [https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F
> > > > > %252
> > > > > Fc
> > > > > i3
> > > > > .googleusercontent.com%2Fproxy%2FxFjftXlwMzpdFeTtDgc4_IwyMYm8Tht
> > > > > QH
> > > > > Is
> > > > > gE
> > > > > lkS8fyiCO2M7ZM0WaO7r2uy-bmKAe5S2sIcg7d-mwbD4ArkJhyafHke-SgJ2ui8D
> > > > > oG
> > > > > oB
> > > > > hZ
> > > > > w4YIyWeK3LUozNMwBff4JR2tdu8nZ2fvoNvkkA06KNw9-s3P9UvYsHSTphHss6X0
> > > > > %3
> > > > > Ds
> > > > > 0-
> > > > > d-e1-ft%23http%3A%2F%2Faccessibility4school.pearson.com%2Faccess
> > > > > %2
> > > > > F4
> > > > > c4
> > > > > 9fe02-e204-46b4-b6f0-82f5a3f159cb%2Fpearson-accessibility.jpg&am
> > > > > p;
> > > > > da
> > > > > ta
> > > > > =04%7C01%7Cjjwhite%40ets.org%7C7b55dede32ac437f0b7708d96d18dbaa%
> > > > > 7C
> > > > > 0b
> > > > > a6
> > > > > e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637660775812391549%7CUnkn
> > > > > ow
> > > > > n%
> > > > > 7C
> > > > > TWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwi
> > > > > LC
> > > > > JX
> > > > > VC
> > > > > I6Mn0%3D%7C1000&amp;sdata=3RB46V%2FLMBU26mpkokEv8FZufmTXWwFHB7SH
> > > > > %2
> > > > > Fu
> > > > > Vp
> > > > > kr8%3D&amp;reserved=0]
> > > > >
> > > > >
> > > > > ________________________________
> > > > > From: White, Jason J <jjwhite@ets.org>
> > > > > Sent: Monday, August 30, 2021 12:38 PM
> > > > > To: public-rqtf@w3.org <public-rqtf@w3.org>
> > > > > Subject: Synchronization Accessibility User Requirements: Speech
> > > > > recognition accuracy
> > > > >
> > > > >
> > > > > Dear colleagues,
> > > > >
> > > > > Please note in advance of this week’s meeting the recent update to
> Issue #229:
> > > > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%
> > > > > 2F
> > > > > gi
> > > > > th
> > > > > ub.com%2Fw3c%2Fapa%2Fissues%2F229&amp;data=04%7C01%7Cjjwhite%40e
> > > > > ts
> > > > > .o
> > > > > rg
> > > > > %7C7b55dede32ac437f0b7708d96d18dbaa%7C0ba6e9b760b34fae92f37e6ddd
> > > > > 9e
> > > > > 9b
> > > > > 65
> > > > > %7C0%7C0%7C637660775812401550%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC
> > > > > 4w
> > > > > Lj
> > > > > Aw
> > > > > MDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sd
> > > > > at
> > > > > a=
> > > > > md
> > > > > %2F98y2x1Nc%2BTW7gJi1sP5qImRK1E959xn%2F3JXiU%2BRE%3D&amp;reserve
> > > > > d=
> > > > > 0<
> > > > > ht
> > > > > tps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2F
> > > > > ur
> > > > > ld
> > > > > ef
> > > > > ense.com%2Fv3%2F__https%3A%2F%2Fgithub.com%2Fw3c%2Fapa%2Fissues%
> > > > > 2F
> > > > > 22
> > > > > 9_
> > > > > _%3B!!LtJ5xwj-!bXktOvEQkyOABF3yRg-6P3v71FsV3ZteYZcII2qKuy7vjWAJD
> > > > > j8
> > > > > Ly
> > > > > bG
> > > > > -wWxRj8r5uw%24&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7b55dede32
> > > > > ac
> > > > > 43
> > > > > 7f
> > > > > 0b7708d96d18dbaa%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C63
> > > > > 76
> > > > > 60
> > > > > 77
> > > > > 5812401550%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV
> > > > > 2l
> > > > > uM
> > > > > zI
> > > > > iLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=ryp8kxZ%2FQoB3Q
> > > > > W2
> > > > > SA
> > > > > p5 CBH779g0%2FCVRqsApTu30wj0A%3D&amp;reserved=0>
> > > > > and the corresponding changes that I made to the draft, which
> > > > > Josh has merged at
> > > > >
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fraw.
> > > > > githack.com%2Fw3c%2Fapa%2Fmain%2Fsaur%2F&amp;data=04%7C01%7Cjjwh
> > > > > it
> > > > > e%
> > > > > 40
> > > > > ets.org%7C7b55dede32ac437f0b7708d96d18dbaa%7C0ba6e9b760b34fae92f
> > > > > 37
> > > > > e6
> > > > > dd
> > > > > d9e9b65%7C0%7C0%7C637660775812401550%7CUnknown%7CTWFpbGZsb3d8eyJ
> > > > > WI
> > > > > jo
> > > > > iM
> > > > > C4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000
> > > > > &a
> > > > > mp
> > > > > ;s
> > > > > data=deiTq26z3fivdFab7%2FxSFPEazMRzBsWonDvb13bTAMs%3D&amp;reserv
> > > > > ed
> > > > > =0
> > > > > <h
> > > > > ttps://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2
> > > > > Fu
> > > > > rl
> > > > > de
> > > > > fense.com%2Fv3%2F__https%3A%2F%2Fraw.githack.com%2Fw3c%2Fapa%2Fm
> > > > > ai
> > > > > n%
> > > > > 2F
> > > > > saur%2F__%3B!!LtJ5xwj-!bXktOvEQkyOABF3yRg-6P3v71FsV3ZteYZcII2qKu
> > > > > y7
> > > > > vj
> > > > > WA
> > > > > JDj8LybG-wWyiGwiNug%24&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7b
> > > > > 55
> > > > > de
> > > > > de
> > > > > 32ac437f0b7708d96d18dbaa%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%
> > > > > 7C
> > > > > 0%
> > > > > 7C
> > > > > 637660775812401550%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiL
> > > > > CJ
> > > > > QI
> > > > > jo
> > > > > iV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=yideNSB
> > > > > 62 WI i% 2BEFxxuxz4PXGyinU3fVc3QQMI5RAAsE%3D&amp;reserved=0>
> > > > >
> > > > >
> > > > >
> > > > > ________________________________
> > > > >
> > > > > This e-mail and any files transmitted with it may contain
> privileged or confidential information. It is solely for use by the
> individual for whom it is intended, even if addressed incorrectly. If you
> received this e-mail in error, please notify the sender; do not disclose,
> copy, distribute, or take any action in reliance on the contents of this
> information; and delete it from your system. Any other use of this e-mail
> is prohibited.
> > > > >
> > > > >
> > > > > Thank you for your compliance.
> > > > >
> > > > > ________________________________
> > > >
> > > > --
> > > >
> > > > Janina Sajka
> > > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2F
> > > > li
> > > > nk
> > > > edin.com%2Fin%2Fjsajka&amp;data=04%7C01%7Cjjwhite%40ets.org%7C4a3e
> > > > 18
> > > > 70
> > > > 64354b2c804408d96d5b9180%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C
> > > > 0%
> > > > 7C
> > > > 637661062328800213%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJ
> > > > QI
> > > > jo
> > > > iV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=P9wpHzYEL
> > > > cC
> > > > g6
> > > > sMpMCaOldmrNMa1HNozVa6UHSwjG50%3D&amp;reserved=0
> > > >
> > > > Linux Foundation Fellow
> > > > Executive Chair, Accessibility Workgroup:
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fa11y.org%2F&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366936515%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=DSp%2BATUUKpiCiCtf6k4sWZylXBYgUfTtdVZhwlxobew%3D&amp;reserved=0
> > > >
> > > > The World Wide Web Consortium (W3C), Web Accessibility Initiative
> (WAI)
> > > > Co-Chair, Accessible Platform Architectures
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.w3..org%2Fwai%2Fapa&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366936515%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=MWgOHg7zWDGU%2Fo3GQry6mdVdA75BkIP75yGZmIfjQ7A%3D&amp;reserved=0
> > > >
> > > >
> > > > ________________________________
> > > >
> > > > This e-mail and any files transmitted with it may contain privileged
> or confidential information. It is solely for use by the individual for
> whom it is intended, even if addressed incorrectly. If you received this
> e-mail in error, please notify the sender; do not disclose, copy,
> distribute, or take any action in reliance on the contents of this
> information; and delete it from your system. Any other use of this e-mail
> is prohibited.
> > > >
> > > >
> > > > Thank you for your compliance.
> > > >
> > > > ________________________________
> > >
> > > --
> > >
> > > Janina Sajka
> > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fli
> > > nk
> > > edin.com%2Fin%2Fjsajka&amp;data=04%7C01%7Cjjwhite%40ets.org%7C9855cf
> > > 30
> > > c8fe4895468c08d96d5cfbc6%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%
> > > 7C
> > > 637661068396469134%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQI
> > > jo
> > > iV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=V1MVSWhMDZ1
> > > lS
> > > TAAFbfdAcE4h6tQ8VBBKxMmzBrQxfk%3D&amp;reserved=0
> > >
> > > Linux Foundation Fellow
> > > Executive Chair, Accessibility Workgroup:
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fa11y.org%2F&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=3nwlgOi6Dwho1JkQqmUjzLjN3tbvO86YOQMbV2Mibbw%3D&amp;reserved=0
> > >
> > > The World Wide Web Consortium (W3C), Web Accessibility Initiative (WAI)
> > > Co-Chair, Accessible Platform Architectures
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.w3..org%2Fwai%2Fapa&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=NEh0M01xFVbrj2y%2FBty0%2BO5vxW3werRMuU3JAJZvfuE%3D&amp;reserved=0
> > >
> > >
> > > ________________________________
> > >
> > > This e-mail and any files transmitted with it may contain privileged
> or confidential information. It is solely for use by the individual for
> whom it is intended, even if addressed incorrectly. If you received this
> e-mail in error, please notify the sender; do not disclose, copy,
> distribute, or take any action in reliance on the contents of this
> information; and delete it from your system. Any other use of this e-mail
> is prohibited.
> > >
> > >
> > > Thank you for your compliance.
> > >
> > > ________________________________
> >
> > --
> >
> > Janina Sajka
> > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Flink
> > edin.com%2Fin%2Fjsajka&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c390173
> > 23514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C
> > 637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjo
> > iV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=EHKVx%2FkelMP
> > 0IXqNc45Rv%2FwEqVxoXvrnxsdrh2kEkGM%3D&amp;reserved=0
> >
> > Linux Foundation Fellow
> > Executive Chair, Accessibility Workgroup:
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fa11y.org%2F&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=3nwlgOi6Dwho1JkQqmUjzLjN3tbvO86YOQMbV2Mibbw%3D&amp;reserved=0
> >
> > The World Wide Web Consortium (W3C), Web Accessibility Initiative (WAI)
> > Co-Chair, Accessible Platform Architectures
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.w3..org%2Fwai%2Fapa&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=NEh0M01xFVbrj2y%2FBty0%2BO5vxW3werRMuU3JAJZvfuE%3D&amp;reserved=0
> >
> >
> > ________________________________
> >
> > This e-mail and any files transmitted with it may contain privileged or
> confidential information. It is solely for use by the individual for whom
> it is intended, even if addressed incorrectly. If you received this e-mail
> in error, please notify the sender; do not disclose, copy, distribute, or
> take any action in reliance on the contents of this information; and delete
> it from your system. Any other use of this e-mail is prohibited.
> >
> >
> > Thank you for your compliance.
> >
> > ________________________________
>
> --
>
> Janina Sajka
>
> https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Flinkedin.com%2Fin%2Fjsajka&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=EHKVx%2FkelMP0IXqNc45Rv%2FwEqVxoXvrnxsdrh2kEkGM%3D&amp;reserved=0
>
> Linux Foundation Fellow
> Executive Chair, Accessibility Workgroup:
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fa11y.org%2F&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=3nwlgOi6Dwho1JkQqmUjzLjN3tbvO86YOQMbV2Mibbw%3D&amp;reserved=0
>
> The World Wide Web Consortium (W3C), Web Accessibility Initiative (WAI)
> Co-Chair, Accessible Platform Architectures
> https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.w3..org%2Fwai%2Fapa&amp;data=04%7C01%7Cjjwhite%40ets.org%7C7c39017323514100835308d96d7e093f%7C0ba6e9b760b34fae92f37e6ddd9e9b65%7C0%7C0%7C637661210366946508%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sdata=NEh0M01xFVbrj2y%2FBty0%2BO5vxW3werRMuU3JAJZvfuE%3D&amp;reserved=0
>
>
> ________________________________
>
> This e-mail and any files transmitted with it may contain privileged or
> confidential information. It is solely for use by the individual for whom
> it is intended, even if addressed incorrectly. If you received this e-mail
> in error, please notify the sender; do not disclose, copy, distribute, or
> take any action in reliance on the contents of this information; and delete
> it from your system. Any other use of this e-mail is prohibited.
>
>
> Thank you for your compliance.
>
> ________________________________
>

Received on Wednesday, 1 September 2021 20:18:43 UTC