[ruby-dev:50770] [Ruby trunk Bug#15521] encoding is missed when using `CSV.generate`
From:
kou@...
Date:
2019-01-25 06:52:07 UTC
List:
ruby-dev #50770
Issue #15521 has been updated by kou (Kouhei Sutou).=0D
=0D
=0D
I've updated `lib/csv` in r66922.=0D
=0D
@naruse Could you backport the revision?=0D
=0D
----------------------------------------=0D
Bug #15521: encoding is missed when using `CSV.generate`=0D
https://bugs.ruby-lang.org/issues/15521#change-76503=0D
=0D
* Author: sue445 (Go Sueyoshi)=0D
* Status: Closed=0D
* Priority: Normal=0D
* Assignee: kou (Kouhei Sutou)=0D
* Target version: =0D
* ruby -v: ruby 2.6.0p0=0D
* Backport: 2.4: DONTNEED, 2.5: DONTNEED, 2.6: REQUIRED=0D
----------------------------------------=0D
# Sample code=0D
~~~ ruby=0D
require "csv"=0D
=0D
rows =3D [=0D
["a", "b", "c", "d", "e"],=0D
["=E3=81=82", "=E3=81=84", "=E3=81=86", "=E3=81=88", "=E3=81=8A"],=0D
]=0D
=0D
str =3D CSV.generate do |csv|=0D
rows.each do |row|=0D
csv << row=0D
end=0D
end=0D
=0D
p str=0D
p str.encoding=0D
~~~=0D
=0D
=0D
# Expected (on Ruby 2.5.3)=0D
~~~=0D
$ ruby csv_generate.rb=0D
"a,b,c,d,e\n=E3=81=82,=E3=81=84,=E3=81=86,=E3=81=88,=E3=81=8A\n"=0D
#<Encoding:UTF-8>=0D
~~~=0D
=0D
# Actual (on Ruby 2.6.0)=0D
~~~=0D
$ ruby csv_generate.rb=0D
"a,b,c,d,e\n\xE3\x81\x82,\xE3\x81\x84,\xE3\x81\x86,\xE3\x81\x88,\xE3\x81\x8=
A\n"=0D
#<Encoding:ASCII-8BIT>=0D
~~~=0D
=0D
=0D
This behavior is same to ruby-trunk=0D
=0D
~~~=0D
$ ruby -v=0D
ruby 2.7.0dev (2019-01-10 trunk 66768) [x86_64-darwin17]=0D
~~~=0D
=0D
# Workaround=0D
Use `force_encoding`=0D
=0D
~~~ruby=0D
require "csv"=0D
=0D
rows =3D [=0D
["a", "b", "c", "d", "e"],=0D
["=E3=81=82", "=E3=81=84", "=E3=81=86", "=E3=81=88", "=E3=81=8A"],=0D
]=0D
=0D
str =3D CSV.generate do |csv|=0D
rows.each do |row|=0D
csv << row=0D
end=0D
end.force_encoding("UTf-8")=0D
=0D
p str=0D
p str.encoding=0D
~~~=0D
=0D
This works, but little dirty...=0D
=0D
=0D
=0D
-- =0D
https://bugs.ruby-lang.org/=0D