[Date Prev][Date Next][Thread Prev][Thread Next]
- Subject: Re: io:lines() and \0
- From: Tim Hill <drtimhill@...>
- Date: Fri, 21 Feb 2014 01:46:50 -0800
On Feb 20, 2014, at 11:34 PM, Ulrich Schmidt <email@example.com> wrote:
> Hi all.
> I have read the entire thread until now and (i am sorry) i cant find any good idea in here.
> What we are discussing about? We are talking about 8-bit charset text streams. Everyone who dealt with - including me - knows: 8-bit char-sets are .... outdated (very friendly spoken). In case you receive a 8-bit text file, you probably know nothing about it.
> - What codepage was used?
> - May be it is a old CP/M textfile where ^Z is used to define the text end. (CP/M file size is a multiple of 128)
> - UTF8 extensions in use?
> ... and much more Questions how to read the text i cant answer.
> There is no and there will never exist a fire-and-forget solution for reading 8-bit text streams.
> I would like to see a lua version working with UTF16. And if someone want to read 8-bit text, he can convert it - using his knowledge about the text history - to UTF16. And please dont blame lua for this 8-bit-mess.
I think a case might be made for UTF-8 support, however.