How to replace characters in a file utf8 in perl?

Question

I have something like this (it works):

perl -C -MText::Unidecode -n -i -e'print unidecode( $_)' unicode_text.txt

and now i want to do the same in the script:

#!/usr/bin/perl -w -CSA use utf8; use Text::Unidecode; while(<>) { print unidecode($_); }

but it doesn't work.

use utf8 serves no purpose here: you don't use utf-8 characters in the code. — choroba
– choroba, Commented Jun 7, 2014 at 15:57
In file i have "ąćęłńóśźżĄĆĘŁŃÓŚŹŻ" and i want to get "acelnoszzACELNOSZZ", but I got "AAAAAA3AAoA1/4AAAAAAAA1A>> " — user3717897
– user3717897, Commented Jun 7, 2014 at 16:04
Your one-liner produces no output for me using Perl 5.20 and Text::Unidecode v0.04. However, there is at least one issue I spot when I attempt to run your full sample code. This line: #!/usr/bin/perl -w -CSA produces an error message: Too late for "-CSA" option at...... I believe the -CSA can be replaced in the script with use open ':encoding(utf8)';. — DavidO
– DavidO, Commented Jun 7, 2014 at 16:13

Borodin · Accepted Answer · 2014-06-07 16:25:17Z

2

You should have got the error message

Too late for "-CSA" option

which is what makes the program read the input file as UTF-8-encoded.

Instead you need to put

use open qw( :std :utf8 );

before the while loop, which does the same as -CS on the command line, i.e. to set the STDIN, STDOUT and STDERR handles to UTF-8 encoding

edited Jun 7, 2014 at 16:25

answered Jun 7, 2014 at 16:16

Borodin

127k9 gold badges72 silver badges146 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

DavidO Over a year ago

Does that result in you getting some output from his script? I would have posted this answer, but haven't been able to get Text::Unidecode to do anything useful... at least when used with Perl5.20.

Borodin Over a year ago

@DavidO: I am on version 20 and it works fine. I presume you've put a file name in @ARGV?

Collectives™ on Stack Overflow

How to replace characters in a file utf8 in perl?

1 Answer 1

2 Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Related