UTF8 characters get corrupted after tidy

[melo]

Hi,

when I have UTF8 chars on my code, they get corrupted when using your extension perltidy command.

Please note that this only happens when using your extension. If I use the perltidy command line, the UTF8 characters are respected.

The simplest Perl script that shows this behaviour is this:

#!/usr/bin/perl

use utf8;

# a comment with UTF chars: áé
print "code with UTF chars: áé\n";

After the perltidy extension command is executed, the áé characters are corrupted.

The .perltidyrc file is this. With an empty file the same behaviour is observed.

% cat .perltidyrc 
-utf8 

Best regards,

---

Perl version:

% perl -v                     

This is perl 5, version 34, subversion 0 (v5.34.0) built for darwin-2level

Perl::Tidy version:

% perltidy --version         
This is perltidy, v20220613 

[kak-tus]

Please, try this.

http://perltidy.sourceforge.net/ChangeLog.html

• The flag --encode-output-strings, or -eos, is now set 'on' by default.
  This has no effect on the use of the 'perltidy' binary script, but could
  change the behavior of some programs which use the Perl::Tidy module on
  files encoded in UTF-8. If any problems are noticed, an emergency fix
  can be made by reverting to the old default by setting -neos. For
  an explanation of why this change needs to be made see:

  Future change in default setting of --encode-output-strings perltidy/perltidy#92

  https://github.com/perltidy/perltidy/blob/master/docs/eos_flag.md