FSEditor: User how has problems pasting UTF-8 text

This is a report verbatim from my user

I am writing to report a change in how the editor behaves.                     ▒
This is not urgent, i just thought i would give a heads up.                    ▒
Formerly, when i pasted content containing UTF-8 encoded                       ▒
characters, the editor would translate them to ASCII                           ▒
"line noise."  Now it seems to interpret them as editor                        ░
commands and it rearranges the existing text.                                  ░
                                                                               ░
For example, the word Saute' where the "e'" represents the                     ░
Unicode character LATIN SMALL LETTER E WITH ACUTE, whose                       ░
UTF-8 encoding is 0xC3 0xA9.                                                   ░
                                                                               ░
Input text:        
  Saute' onions, celery, pepper, garlic, and spices in oil.                    ░
                                                                               ░
Old result:                                                                    ░
  Saut|- onions, celery, pepper, garlic, and spices in oil.                    ░
                                                                               ░
New result:                                                                    ░
 onions, celery, pepper, garlic, and spices in oil.                            ▒
  Saut                                                                         ▒
                                                                               ▒
With longer texts, the rearrangement is more dramatic.         

This user is one of my biggest contributors so I'd like to make sure this gets fixed ASAP.

It would be good to know what terminal is in use.

Also, his terminal settings/detection.

For what it's worth, I could not reproduce this problem on Vertrauen (was able to paste UTF-8 into fseditor.js no problem):

2024-02-14

I have sent an email to get more detail. I just passed on what information I had received. As soon as I get more I'll update the ticket.

User says:

I am using xfce4-terminal 0.8.10 and openssh 9.3p2 ▒ ▒ (T) Terminal Mode Auto UTF-8 / ANSI (color) (mouse) DEL=BS

This was broken with an older Synchronet build I was running, but rebuilding and restarting made it work. :D

I configured FSEditor as such:

[Deuce's FSEditor Editor]
 1: Name                       Deuce's FSEditor
 2: Internal Code              FSEDITOR
 3: Command Line               ?fseditor %f
 4: Access Requirements        ANSI
 5: I/O Method                 FOSSIL or UART
 6: Native Executable/Script   No
 7: Use Shell or New Context   No
 8: Record Terminal Width      Yes
 9: Word-wrap Quoted Text      Yes, for terminal width
10: Automatically Quoted Text  All
11: Editor Information Files   WWIV EDITOR.INF/RESULT.ED
12: Expand Line Feeds to CRLF  Yes
13: Handle Soft CRs            N/A
14: Strip FidoNet Kludges      No
15: Support UTF-8 Encoding     Yes
16: BBS Drop File Type         None

and tried again and I get the same thing when using xfce4-terminal.

If I just try to paste the é character it acts as if I'm pressing ^B to move to the start of the line.

Here's the config I tested with that worked:

╠════════════════════════════════════════════════════════════════════╣
║ │Name                       JS FSE                                 ║
║ │Internal Code              FSEDITOR                               ║
║ │Command Line               ?fseditor %f                           ║
║ │Access Requirements        ANSI                                   ║
║ │I/O Method                 Socket                                 ║
║ │Native Executable/Script   Yes                                    ║
║ │Use Shell or New Context   No                                     ║
║ │Record Terminal Width      No                                     ║
║ │Word-wrap Quoted Text      No                                     ║
║ │Automatically Quoted Text  All                                    ║
║ │Editor Information Files   WWIV editor.inf/result.ed              ║
║ │Expand Line Feeds to CRLF  No                                     ║
║ │Handle Soft CRs            Retain                                 ║
║ │Strip FidoNet Kludges      No                                     ║
║ │Support UTF-8 Encoding     No                                     ║
║ │BBS Drop File Type         Synchronet      xtrn.dat               ║
╚════════════════════════════════════════════════════════════════════╝

[Deuce's FSEditor Editor]
 1: Name                       Deuce's FSEditor
 2: Internal Code              FSEDITOR
 3: Command Line               ?fseditor %f
 4: Access Requirements        ANSI
 5: I/O Method                 Socket
 6: Native Executable/Script   Yes
 7: Use Shell or New Context   No
 8: Record Terminal Width      No
 9: Word-wrap Quoted Text      No
10: Automatically Quoted Text  All
11: Editor Information Files   WWIV editor.inf/result.ed
12: Expand Line Feeds to CRLF  No
13: Handle Soft CRs            Retain
14: Strip FidoNet Kludges      No
15: Support UTF-8 Encoding     No
16: BBS Drop File Type         Synchronet      xtrn.dat

I have changed mine to match and still getting the pasting issue with xfce4-terminal. I tried with both ssh and telnet.

Support UTF-8 Encoding must should be set to "Yes"