Re: International Search Engine Submission

I have a question about the search engines. In addition to being able to
submit Web sites to search engines, these search engine companies
usually(?) run robots (crawlers) that automatically find Web sites and
index them for searching.

I'm wondering whether those crawlers deal with such character encodings
as ISO-2022-JP, where bytes such as '<', '>' and '&' can appear, but
don't have the same meaning as the HTML characters.

In other words, do the crawlers deal with ISO-2022-JP? Or do they fail
to parse those, thereby failing to follow any of the URLs in them?

Erik