lua-users home
lua-l archive

[Date Prev][Date Next][Thread Prev][Thread Next] [Date Index] [Thread Index]


On Sat, 21 Jul 2007 05:09:55 -0700 (PDT)
gary ng <garyng2000@yahoo.com> wrote:

> That I beg to differ. It is the additional protocol
> that is needed between the helper and the main thread.
> This can create quite some string in lua to pass back
> and forth, in addition to the needed data.
> So If I have a 1M dataset, within a single thread,
> that would be 1M, with this approach, it needs 2X as
> more at least.
yes. but there can be a way to process dataset row by row in the
client, for example (it depends of task, of course). so you'll have 1M
in SQL helper and couple of KB in client...

or something like this. just process data chunk by chunk and don't keep
the whole data in memory.

and you always can write the time-consuming parts in the `real'
language, where Lua `hooks' calls here and there...