Re: JSON performance

Kevin

Your performance problems of course inspired me to the decision, but first
when Scott
added som more sub-procedures (that I needed) in july 2015 I integrated it.
I actually
started to look at it in 2014.

These new sub-procedures are:

I - export symbol(yajl_writeStdout)
I - export symbol(yajl_stdin_load_tree)
I - export symbol(yajl_addCharEx)
I - export symbol(yajl_addCharStmf)
I - export symbol(yajl_exbuf_new)
I - export symbol(yajl_exbuf_concat_ptr)
I - export symbol(yajl_exbuf_concat)
I - export symbol(yajl_exbuf_free)
I - export symbol(yajl_save_string_stmf)
I - export symbol(yajl_getBuf)
I - export symbol(yajl_tree_free_rpg)



Especially the yajl_getBuf(addr,size); without copying the storage helped a
lot.



On Sun, Oct 18, 2015 at 12:14 PM, Kevin Turner <kevin.turner@xxxxxxxxxxxxxxx

wrote:

Presumably you made this decision following that email trail I started a
few months ago comparing yajl to the offering from rpgnextgen (simply
called JSON)?

I switched to yajl back then when we discovered the bottleneck that was
caused by the rpgnextgen parser - it's a shame because it is actually a
little bit more intuitive to use (procedure name-wise). All I did was to
put a more intuitive wrapper around yajl and the performance improvements
were significant.

On 18 Oct 2015, at 10:51, Henrik Rützou <hr@xxxxxxxxxxxx> wrote:

In my newly uploaded October 2015 version (5.03) of powerEXT Core I have
included Scott Klement’s port of C based YAJL (Yet Another JSON Library)

a

port many seems to have overlooked.



Before I have written some sub-procedures in RPGLE (JSON node support)

but

in comparison to YAJL I get 2.5-5x better performance with YAJL thus
reducing an average 20KB JSON REST/CRUD total request time in the browser
from 300ms to approx. 150ms or a performance gain 2x.



Now, it could be funny to compare performance in other techniques such as
node.js and .NET. So I have built a little demo program that should be

easy

to replicate in another language or even other native JSON wrappers.



The program uses SQL to read a table we all have (QIWS/QCUSTCDT) but
instead of making a single JSON object per row it loops 1,000 times and
creates 1,000 row objects for each physical row in the table resulting in
132.000 JSON nodes being generated (31,500 per second) in a 3,6 MB JSON
object.



Using my RPG JSON node support it took 24 sec to generate the object,

with

YAJL it took 4,2 sec - with smaller objects the perfomance gain is only
2.5x.



Resources:



Scott Klements YAJL port: http://www.scottklement.com/yajl/



powerEXT Core including YAJL: http://powerext.com



My test program: http://powerext.com/rpgyajl.txt




--
Regards,
Henrik Rützou

http://powerEXT.com <http://powerext.com/>
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400) mailing

list

To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.


___________________________________________
This email has been scanned by iomartcloud.
http://www.iomartcloud.com/

________________________________

NOTICE: The information in this electronic mail transmission is intended
by CoralTree Systems Ltd for the use of the named individuals or entity to
which it is directed and may contain information that is privileged or
otherwise confidential. If you have received this electronic mail
transmission in error, please delete it from your system without copying or
forwarding it, and notify the sender of the error by reply email or by
telephone, so that the sender's address records can be corrected.




--------------------------------------------------------------------------------


CoralTree Systems Limited
25 Barnes Wallis Road
Segensworth East, Fareham
PO15 5TT

Company Registration Number 5021022.
Registered Office:
12-14 Carlton Place
Southampton, UK
SO15 2EA
VAT Registration Number 834 1020 74.
--
This is the Web Enabling the IBM i (AS/400 and iSeries) (WEB400) mailing
list
To post a message email: WEB400@xxxxxxxxxxxx
To subscribe, unsubscribe, or change list options,
visit: http://lists.midrange.com/mailman/listinfo/web400
or email: WEB400-request@xxxxxxxxxxxx
Before posting, please take a moment to review the archives
at http://archive.midrange.com/web400.