Informix write listener – Rest API setup issues

For my talk at IIUG 2017 I was working with the wire listener on Informix.

When setting up a wire listener for the REST API I found some Informix packaging issues and issues with the DeveloperWorks article.

I was following the developerWorks article Informix and NoSQL: First Steps with the REST API

NOTE: This series of articles REALLY helped when getting my talk ready!

I was working with the latest Informix server version 12.10.FC8 on CentOS 7 and found:

a) When unpacking nosql_sdk.zip this unpacks to folder nosql-sdk-1.2.2 – there was no explict step with the command to add a link called nosql_sdk to make the examples work, I add this below.

cd $INFORMIXDIR
unzip bin/nosql_sdk.zip

ln -s nosql-sdk-1.2.2 nosql_sdk

b) The library ${INFORMIXDIR}/nosql_sdk/tomcat-embed-core.jar is missing!

Noticing that the other libaries were for version 8.0.38 I went to

Tomcat Embed Core » 8.0.38

and on the “Files” line clicked the download link.

I then copied tomcat-embed-core-8.0.38.jar into $INFORMIXDIR/nosql_sdk/lib

and added this to the classpath.

3. In order to get class com.ibm.nosql.server.ListenerCLI I also had to add ${INFORMIXDIR}/nosql_sdk/com.ibm.nosql.informix-1.2.2.jar to the classpath.

The final result was:

cat rest_listener_start.sh
#!/bin/sh

${INFORMIXDIR}/extend/krakatoa/jre/bin/java \
-cp ${INFORMIXDIR}/bin/jsonListener.jar:${INFORMIXDIR}/nosql_sdk/lib/tomcat-embed-core-8.0.38.jar:${INFORMIXDIR}/nosql_sdk/com.ibm.nosql.informix-1.2.2.jar \
com.ibm.nosql.server.ListenerCLI \
-config ${INFORMIXDIR}/etc/restListener.properties \
-logfile /work/martinfu/731/restListener.log \
-start &

exit

cat rest_listener_stop.sh
#!/bin/sh

${INFORMIXDIR}/extend/krakatoa/jre/bin/java \
-cp ${INFORMIXDIR}/bin/jsonListener.jar:${INFORMIXDIR}/nosql_sdk/lib/tomcat-embed-core-8.0.38.jar:${INFORMIXDIR}/nosql_sdk/com.ibm.nosql.informix-1.2.2.jar \
com.ibm.nosql.server.ListenerCLI \
-config ${INFORMIXDIR}/etc/restListener.properties \
-stop

exit

I hope this helps and am talking to IBM about the issues I found.

 


Finding System Requirements for IBM Software Products.

IBM has a  Software Product Compatibility Reports facility.

http://www-969.ibm.com/software/reports/compatibility/clarity/softwareReqsForProduct.html


Managing GSKit Master Keys

http://www.ibm.com/developerworks/data/library/techarticle/dm-1504-master-encrypted-keys/index.html

Managing GSKit Master Keys


Huge Pages for Informix on SPARC Solaris

To get hugh pages for Informix on Solaris

1. Set RESIDENT to a value other than 0, >0 means the first N shared memory segments will be pinned in memory.

https://informixdba.wordpress.com/2013/03/08/huge-pages/

2. Make sure IFX_LARGE_PAGES is not set to 0.

http://www-01.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.sqlr.doc/ids_sqr_404.htm

3. To get pages >4MB in size the hardware must have support for 2GB pages, run pagesize -a to check what the hardware supports

https://blogs.oracle.com/mandalika/entry/enabling_2_gb_large_pages

4,  Either use ppgsz or mpss.so.1

The three ways to change the default page size for an application are:

  • Use the Oracle Solaris OS command ppgsz(1).
  • Compile the application with the -xpagesize, -xpagesize_heap, and -xpagesize_stack options. See the compiler man pages for details.
  • Use MPSS specific environment variables. See the mpss.so.1(1) man page for details.

http://docs.oracle.com/cd/E24457_01/html/E21996/aewda.html

ppgsz is documented at

https://docs.oracle.com/cd/E19683-01/816-0210/6m6nb7mht/index.html

mpss.so.1 is documented at

http://docs.oracle.com/cd/E19253-01/816-5165/6mbb0m9lf/index.html

5. Note

Solaris has had large parges for many years. Initially, a large page on SPARC was 4MB. Then, much later, Solaris 9 added new APIs for Multiple Page Size Support. At that time, the maximum supported by hardware was 256MB. Today, the T4 processor supports page sizes up to 2GB.

https://www.linkedin.com/groups/Solaris-Huge-pages-60651.S.78812448

6. UltraSPARC II/III/III+/IV/IV+ and UltraSPARC T1 (aka Niagara) only support large pages of 4MB

http://www.solarisinternals.com/wiki/index.php/Multiple_Page_Size_Support#Default_page_sizes.2C_and_tunables_on_different_platforms

7. Check none of these to disable large pages are being used

https://blogs.oracle.com/mandalika/entry/solaris_disabling_out_of_the

  • set exec_lpg_disable = 1This parameter prevents large pages from being used when the kernel is allocating memory for processes being executed. These constitute the memory needed for a processes’ text/data/bss.
  • set use_brk_lpg = 0This parameter prevents large pages from being used for heap. To enable large pages for heap, set the value of this parameter to 1 or remove this parameter from /etc/system completely.

    Note:
    brk() is the kernel routine that is called whenever a user level application invokes malloc().

  • set use_stk_lpg = 0This parameter disables the large pages for stack. Set it to 1 to retain the default functionality.
  • set use_zmap_lpg = 0This variable controls the size of anonymous (anon) pages.
  • set use_text_pgsz4m = 0This tunable disables the default use of 4M text pages on UltraSPARC-III/III+/IV/IV+/T1 platforms.
  • set use_text_pgsz64k = 0This tunable disables the default use of 64K text pages on UltraSPARC-T1 (Niagara) platform.
  • set use_initdata_pgsz64k = 0This tunable disables the default use of 64K data pages on UltraSPARC-T1 (Niagara) platform.

8.The T4 processor was the first to add “Support for a much larger Memory Management Unit page size (2GB)”

Click to access o11-090-sparc-t4-arch-496245.pdf

https://blogs.oracle.com/mandalika/entry/enabling_2_gb_large_pages

“Prerequisites:

OS: Solaris 10 8/11 (Update 10) or later
Hardware: SPARC T4. eg., SPARC T4-1, T4-2 or T4-4”


Informix Chat with Lab

https://www.ibm.com/developerworks/community/wikis/home?lang=en#!/wiki/Informix%20Chat%20With%20the%20Lab

Informix Chat with the Lab


Simple Informix C UDR on Centos 6.6

Simple Informix C UDR on Centos 6.


#include "dmi/mi.h"

mi_integer bigger_int(mi_integer left,mi_integer right)
{
if ( left > right )
return(left);
else
return(right);
}

To compile

gcc -I$INFORMIXDIR/incl -I $INFORMIXDIR/incl/esql -c -fPIC -DMI_SERVBUILD -g bigger_int.c
gcc -shared -fPIC -o /home/informix/bigger_int.so bigger_int.o

To load and run

dbaccess sysmaster

create database justdave;

CREATE FUNCTION bigger_int (arg1 integer, arg2 integer) RETURNING integer
EXTERNAL NAME '/home/informix/bigger_int.so(bigger_int)'
LANGUAGE C;

select bigger_int(1,2) from systables where tabid=1;

DROP FUNCTION bigger_int;

Only when you execute the function is the shared library loaded

05:20:41  Loading Module
05:20:41  pid 3217: ELF .eh_frame section missing in /opt/IDS.12.10.FC5/gls/dll/64-libicudata.so.48
05:20:41  The C Language Module loaded


Informix Client SDK support position

Informix Client SDK support position

http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&appname=iSource&supplier=877&letternum=ENUSZP15-0265


Informix 12.10.xC5 is out!

Informix 12.10.xC5 is out

https://www-01.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.po.doc/new_features_ce.htm?lang=en-us#newxc5_toc

– AUTO_REPREPARE changes,

– Rolling upgrades for high-availability clusters

– Support for Java 7

– Improved installation logging and debugging

– Easier silent installations

– Tenant databases session_limit_memory,session_limit_logspace,session_limit_txn_time,tenant_limit_space

– Limit access to tenant databases in OAT

– Limit session resources SESSION_LIMIT_MEMORY,SESSION_LIMIT_TEMPSPACE,SESSION_LIMIT_LOGSPACE,

SESSION_LIMIT_TXN_TIME

– Larger maximum tape size for backups TAPEDEV/LTAPEDEV 9 ZB

– Informix JDBC Driver now supports the Estonian and Lithuanian locale, et_ee

– Correlated aggregate expressions

– Control repreparation IFX_AUTO_REPREPARE new values

– Manipulate JSON and BSON data with SQL statements

– High availability for MongoDB and REST clients

– Wire listener configuration enhancements

– Wire listener query support, Join/Array queries on JSON data

– Enhanced account management through the wire listener,JSON lockAccount and unlockAccounts commands

– Load pure JSON documents into time series, TSL_PutJson

– Faster loading of time series data files
TSL_Put function can now contain JSON or BSON documents as values
for columns other than the primary key and time stamp columns
– Improved logging for the time series loader
You can choose to retrieve loader messages from a queue instead of logging the
messages in a message log file. Retrieving messages from a queue results in less
locking contention than logging messages in a file.
TSL_GetFmtMessage/TSL_GetLogMessage/TSL_MessageSet

– Create new time series while loading data,TSL_SetNewTS/TSCreateVirtualTab

– Display time series storage space usage,TSInfo

– View active time series loader sessions,TSL_ActiveHandles

– Analyze time series data for matches to patterns,TSPatternMatch/TSCreatePatternIndex

– Clip selected columns of time series data,ProjectedClip

– Track moving objects
The spatiotemporal search extension depends on the TimeSeries and spatial extensions.
You store the spatiotemporal data in a TimeSeries data type with columns for longitude and latitude.
You index and query the spatiotemporal data with the new spatiotemporal search functions.
You can also query spatiotemporal data with time series and spatial routines.

IBM Informix Spatiotemporal Search for Moving Objects User’s Guide.
https://www-01.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.sts.doc/sts.htm?lang=en-us
– Enhancements to Informix Warehouse Accelerator
– accelerate queries that include these scalar functions: CURRENT, SQRT, and SYSDATE.
– ondwa listmarts command
– load data marts faster by adding a second DWAVP virtual processor
The DWAVP virtual processor runs Informix Warehouse Accelerator administrative
functions and procedures.


Database product installation FAQ

Database product installation FAQ http://www.smooth1.co.uk/installs.html

Currently SQL Server,DB2 10.5,Oracle 12.1.0.2,SAP ASE 16.0,Informix 12.10.FC4


Informix Request for Enhancement

 

IBM Informix Request For Enhancement site.

https://www.ibm.com/developerworks/rfe