Re: YAJL and BIG files

[Rob Berendt <robertowenberendt@xxxxxxxxx>]

IBM i pages out memory.
If you google does ibm i page out memory
it will answer that.  Sometimes you'll even get some suggestions.

See also:
QSYS2.SYSTMPSTG <https://www.ibm.com/support/pages/node/1136110>

On Thu, Jan 23, 2025 at 2:26 PM <smith5646midrange@xxxxxxxxx> wrote:

> I have a program that uses SQL to read a table and write the JSON
> reformatted data to the IFS using YAJL.  This is going to be a BIG file.
> Since YAJL builds the file in memory, this is going to consume a LOT of
> memory.
>
> In the Windows world, when a program needs memory and none is available,
> Windows shuffles some memory to disk and frees up that memory.  Does the
> IBM i basically work the same way or am I going to eat all of the memory
> and crash the machine? ☹
>
> I'm thinking that I might need to rewrite the program to get away from
> YAJL and just manually write each record to the IFS as it is processed.
>
> Thoughts?
>
>
> --
> This is the Midrange Systems Technical Discussion (MIDRANGE-L) mailing list
> To post a message email: MIDRANGE-L@xxxxxxxxxxxxxxxxxx
> To subscribe, unsubscribe, or change list options,
> visit: https://lists.midrange.com/mailman/listinfo/midrange-l
> or email: MIDRANGE-L-request@xxxxxxxxxxxxxxxxxx
> Before posting, please take a moment to review the archives
> at https://archive.midrange.com/midrange-l.
>
> Please contact support@xxxxxxxxxxxxxxxxxxxx for any subscription related
> questions.