Re: Token filter

[Thomas Lauer <thomas.lauer@...>]

"Jerome Vuarand" <jerome.vuarand@ubisoft.com> wrote:
> I don't know if it's a more elegant solition, but you can also make your
> filter reset itself when it receives a eof token. Since the compilation
> and execution of a chunk are done in seperate steps, you should always
> receive the eof of a chunk before the compilation of another one starts.

I could indeed (at least under syntax-error-free conditions, as pointed
out by lhf). However, I have never actually seen this resetting done in
practice, so that's why I stumbled over that buglet in the first
place... and had an excuse to inspect the actual C code;-)

The C side could perhaps be made somewhat more robust than it is right
now (and a hint in the token filter documentation would be welcome as
well). I'm not sure whether that's easy to do without breaking backward
compatibility. This discussion is probably also relevant in this
context:
http://lua-users.org/lists/lua-l/2007-04/msg00501.html

Anyway, problem solved for now.

-- 
cheers  thomasl

web : http://thomaslauer.com/start