Edge Cases · 17 files

Sample Text Encodings

CSV and text files in UTF-8 with BOM, UTF-16, Latin-1, Windows-1252, Shift_JIS and GB18030; CRLF, CR-only and mixed line endings; semicolon delimiters; tricky quoted fields; a Unicode stress test; NUL bytes and a 1 MB single line.

All 17 text encodings files

Download all with curl
Download 17 files (1 MB)Shell
# 17 files, 1 MB in total
while read -r url; do curl -LO --fail "$url"; done <<'EOF'
https://files.samplefiles.com/edge-cases/encoding/null-bytes.txt
https://files.samplefiles.com/edge-cases/encoding/gb18030.csv
https://files.samplefiles.com/edge-cases/encoding/shift-jis.csv
https://files.samplefiles.com/edge-cases/encoding/quoted-fields.csv
https://files.samplefiles.com/edge-cases/encoding/unicode-stress.txt
https://files.samplefiles.com/edge-cases/encoding/no-header.csv
https://files.samplefiles.com/edge-cases/encoding/latin1.csv
https://files.samplefiles.com/edge-cases/encoding/cr-only.csv
https://files.samplefiles.com/edge-cases/encoding/semicolon.csv
https://files.samplefiles.com/edge-cases/encoding/utf8-bom.csv
https://files.samplefiles.com/edge-cases/encoding/mixed-line-endings.csv
https://files.samplefiles.com/edge-cases/encoding/crlf.csv
https://files.samplefiles.com/edge-cases/encoding/windows-1252.csv
https://files.samplefiles.com/edge-cases/encoding/utf32.txt
https://files.samplefiles.com/edge-cases/encoding/utf16le.csv
https://files.samplefiles.com/edge-cases/encoding/utf16be.csv
https://files.samplefiles.com/edge-cases/encoding/long-line.txt
EOF

FAQ

Why does my CSV show a strange first column name?

A UTF-8 BOM (EF BB BF) at the start of the file is being read as part of the first header. Try utf8-bom.csv to reproduce it.