> But there is no “naive” implementation of Unicode.
I assure you there are thousands if not millions of apps that implement search the naive way, by comparing bytes.
> It won't handle emoji, normalization, and thousands other things.
Yeah. But it works well enough for Americans, so the maintainers don't care enough to fix it.
> As for official stance, maybe it's time for some group to agree on certain non-conflicting sequences, and implement them in some library/stack.
And then what? What do you do with documents in Japanese that have already been converted without using your new codepoints? What do you do with programs that ignore your new standard? What do you do about search being broken in most apps with no prospect of fixing it? There are already some PUA codepoints for a proper implementation of Japanese, but most app authors don't even understand the problem, never mind being willing to support something that's "non-standard". Asking them to support traditional non-unicode encodings, which is something that's at least relatively well-known and standardised, and something they can test without knowing Japanese, is much easier.
> By the way, is it possible to make proper quotes from other languages as described above when using Shift JIS?
No, not for arbitrary languages. If you want to mix arbitrary languages, you need some structure that's a rope of strings with an encoding per segment. But that's exactly the same thing that the unicode advocates claim is easy ("just have a sequence of spans with different lang tags"), and at least if you use traditional encodings then you don't have to do any such fancy business for the much more common case of a file that's entirely in Japanese (perhaps with some ASCII keywords).
I assure you there are thousands if not millions of apps that implement search the naive way, by comparing bytes.
> It won't handle emoji, normalization, and thousands other things.
Yeah. But it works well enough for Americans, so the maintainers don't care enough to fix it.
> As for official stance, maybe it's time for some group to agree on certain non-conflicting sequences, and implement them in some library/stack.
And then what? What do you do with documents in Japanese that have already been converted without using your new codepoints? What do you do with programs that ignore your new standard? What do you do about search being broken in most apps with no prospect of fixing it? There are already some PUA codepoints for a proper implementation of Japanese, but most app authors don't even understand the problem, never mind being willing to support something that's "non-standard". Asking them to support traditional non-unicode encodings, which is something that's at least relatively well-known and standardised, and something they can test without knowing Japanese, is much easier.
> By the way, is it possible to make proper quotes from other languages as described above when using Shift JIS?
No, not for arbitrary languages. If you want to mix arbitrary languages, you need some structure that's a rope of strings with an encoding per segment. But that's exactly the same thing that the unicode advocates claim is easy ("just have a sequence of spans with different lang tags"), and at least if you use traditional encodings then you don't have to do any such fancy business for the much more common case of a file that's entirely in Japanese (perhaps with some ASCII keywords).