UNCAL Data Mapper

1
 UNCAL Data Mapper

Table of Contents
1. Introduction .................................................................................................................................. 2
1.1 UNCAL Data Mapper Overview ............................................................................................... 2
1.2 Contact .................................................................................................................................... 2
1.3 Release Notes ......................................................................................................................... 2
2. UNCAL Data Mapping ................................................................................................................... 2
2.1 Workspace .............................................................................................................................. 2
2.1.1 Create Project .................................................................................................................. 2

1
 UNCAL Data Mapper

1. Introduction
Welcome to the UNCAL Data Mapping help file! The help file is always available to
provide useful information about UNCAL Data Mapping and the features.

• Read the UNCAL Data Mapper overview ( UDM ) to know more about UDM
• Contact
• Release Notes

1.1 UNCAL Data Mapper Overview

UNCAL Data Mapping (UDM)
Is a Web-based Application for Creating Message Structures and Mappings. It provides a
functionality which enables a conversion of almost any structure data formats. It's easy to
use ( drag and drop ) yet powerful and high performance.
Data mapping is the process of mapping data fields from a source file to their related
target fields. Data mapping tools help bridge the differences in the schemas of data
source and destination, allowing businesses to consolidate information from different
data points easily.

1.2 Contact
Website : www.cic-integration.co
Email : contact@cic-integration.co

1.3 Release Notes

Version 1.1
Release : June 2020

2. UNCAL Data Mapping

Workspace

2.1 Workspace
Is a place that allows you to create and manage projects in UNCAL ESB .

• Create Project

2.1.1 Create Project

Click right on the Workspace for create New Project

• Choose New Project

 UNCAL Data Mapper

• Fill the Name project and description from project

2.1.1.1 Structures
There are 3 (three) ways to create a structure in UDM:

1. By creating New Structures

2. By import existing structures (Import XSD, SAP IDoc, API Structure)
3. By import from SAP (RFC/BAPI Structure)

New Structure

• Fill the name, title, (Namespace is only for XML) and choose Message Type that will be
used.
 UNCAL Data Mapper

2.1.1.1.1 Message Type

• ANSI
• CSV
• EDIFACT
• FIXED
• IDoc / SAP
• ISO
• SOAP
• SQL
• VDA
• XML

2.1.1.1.1.1 ANSI
ANSI EDI is the US standard for development and maintenance of any electronic
interchange of business documents (EDI communication), formerly known as ANSI ASC
X12).
ANSI EDI created in 1979 and developed under the American National Standards Institute
(ANSI)s sponsored committee, the Accredited Standards Committee (ASC) X12. ASC X12 is
a non-profit organization that is made up of business and technical professionals across a
wide range of industries that work with the ANSI EDI standards to ultimately improve
business process, lower costs, and encourage horizontal and vertical growth in business
market
Example :
ISA*01*0000000000*01*0000000000*ZZ*ABCDEFGHIJKLMNO*ZZ*123456789012345*10
1127*1719*U*00400*000003438*0*P*>
GS*PO*4405197800*999999999*20101127*1719*1421*X*004010VICS
ST*850*000000010
 UNCAL Data Mapper

BEG*00*SA*08292233294**20101127*610385385
REF*DP*038
REF*PS*R
ITD*14*3*2**45**46
DTM*002*20101214
PKG*F*68***PALLETIZE SHIPMENT
PKG*F*66***REGULAR
TD5*A*92*P3**SEE XYZ RETAIL ROUTING GUIDE
N1*ST*XYZ RETAIL*9*0003947268292
N3*31875 SOLON RD
N4*SOLON*OH*44139
PO1*1*120*EA*9.25*TE*CB*065322-117*PR*RO*VN*AB3542
PID*F****SMALL WIDGET

PO4*4*4*EA*PLT94**3*LR*15*CT
PO1*2*220*EA*13.79*TE*CB*066850-116*PR*RO*VN*RD5322
PID*F****MEDIUM WIDGET
PO4*2*2*EA
PO1*3*126*EA*10.99*TE*CB*060733-110*PR*RO*VN*XY5266
PID*F****LARGE WIDGET
PO4*6*1*EA*PLT94**3*LR*12*CT
PO1*4*76*EA*4.35*TE*CB*065308-116*PR*RO*VN*VX2332
PID*F****NANO WIDGET
PO4*4*4*EA*PLT94**6*LR*19*CT
PO1*5*72*EA*7.5*TE*CB*065374-118*PR*RO*VN*RV0524
PID*F****BLUE WIDGET
PO4*4*4*EA
PO1*6*696*EA*9.55*TE*CB*067504-118*PR*RO*VN*DX1875
PID*F****ORANGE WIDGET
PO4*6*6*EA*PLT94**3*LR*10*CT
CTT*6
AMT*1*13045.94
SE*33*000000010
GE*1*1421
IEA*1*000003438

2.1.1.1.1.2 CSV
CSV stands for Comma-Separated Values or Character-Separated Values. With Character-
Separated Value files any character, not just a comma, can be a delimiter for the data segments.
 UNCAL Data Mapper

2.1.1.1.1.3 EDIFACT
EDIFACT stands for Electronic Data Interchange For Administration Commerce and
Transport. EDIFACT is accepted as the international EDI standard that has been adopt by
organizations wishing to trade in a global context. A standard set of syntax rules have
been ratify by the United Nations. The EDIFACT standards cover transaction sets (the
business documents that you wish to transmit), data element directories and syntax rules
which cover delimiter characters etc.
Example :
UNB+UNOA:1+US::US+50138::THEM+140531:0305+001934++ORDERS'
UNH+1+ORDERS:91:2:UN'
BGM+220+A761902+4:20140530:102+9'
RFF+CT:EUA01349'
RFF+AAV::C'
TXT+THIS IS WHAT AN EDI MESSAGE WOULD LOOK LIKE... '
NAD+BY++OUR NAME PLC::::+++++EW4 34J'
CTA+PD'
COM+01752 253939:TE+01752 253939:FX+0:TL'
CTA+OC+:A.SURNAME'
COM+2407:EX'
CTA+TI+:B.BROWN'
COM+0:EX'
CTA+SU'
COM+0161 4297476:TE+01752 670633:FX'
UNT+15+1'
UNZ+1+001934'

2.1.1.1.1.4 FIXED
Fixed length means having a set length that never varies. In database systems , a field can
have a fixed or a variable length . A variable-length field is one whose length can be
different in each record, depending on what data is stored in the field.
HDR10020020712Mustermann GmbH Musterstrasse
12 Stadt

POS001EAN1001 Bananenkartons 100PCE00100.25

POS002EAN1002 Milchkartons 60PCE03000.00
TXTBeschreibungstext1 Beschreibungstext2

POS003EAN1003 Eierkartons 400PCE00400.00

TXTBeschreibungstext1 Beschreibung3

POS004EAN1004 Waschmittelkartons 150PCE00200.00

POS005EAN1005 Melonenkartons 300PCE00170.00
SUM4000.25

2.1.1.1.1.5 IDoc/SAP
IDoc is an SAP object that carries data of a business transaction from one system to the
other one in the form of electronic message. IDoc is an acronym for Intermediate
Document. The purpose of an IDoc is to transfer data or information from SAP to other
systems and vice versa.
Example :
 UNCAL Data Mapper

2.1.1.1.1.6 ISO
ISO8583 is an international standard for financial transaction card originated interchange
messaging. It is the International Organization for Standardization standard for systems
that exchange electronic transactions initiated by cardholders using payment cards.
ISO8583 defines a message format and a communication flow so that different systems
can exchange these transaction requests and responses. The vast majority of transactions
made when a customer uses a card to make a payment in a store (EFTPOS) use ISO 8583
at some point in the communication chain, as do transactions made at ATMs. In
particular, both the MasterCard and Visa networks base their authorization
communications on the ISO 8583 standard, as do many other institutions and networks.
 UNCAL Data Mapper

The user can choose from a total of 128 indexes of ISO element data by extracting them
from the uncal template. Element data is the core of ISO 8583 which in the data element,
all transaction information will be available.

2.1.1.1.1.7 SOAP
SOAP (Simple Object Access Protocol) is a messaging protocol specification for
exchanging structured information in the implementation of web services in computer
networks. Its purpose is to provide extensibility, neutrality and independence. It
uses XML Information Set for its message format, and relies on application
layer protocols, most often Hypertext Transfer Protocol (HTTP) or Simple Mail Transfer
Protocol (SMTP), for message negotiation and transmission.
SOAP allows processes running on disparate operating systems (such
as Windows and Linux) to communicate using Extensible Markup Language (XML). Since
Web protocols like HTTP are installed and running on all operating systems, SOAP allows
clients to invoke web services and receive responses independent of language and
platforms

2.1.1.1.1.8 SQL
SQL (Structured Query Language) is a domain-specific language used in programming
and designed for managing data held in a relational database management system
(RDBMS), or for stream processing in a relational data stream management system
(RDSMS). It is particularly useful in handling structure data where there are relations
between different entities/variables of the data.
 UNCAL Data Mapper

2.1.1.1.1.9 VDA
VDA is the German automotive standard. VDA develops standards and best practices to
serve the needs of companies within the German automotive industry.
Example :

2.1.1.1.1.10 XML
Extensible Markup Language (XML) is a markup language that defines a set of rules for
encoding documents in a format that is both human-readable and machine-readable.
Example :
<?xmlversion="1.0"encoding="UTF-8"?>

<shiporderorderid="889923"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:noNamespaceSchemaLocation="shiporder.xsd">
<orderperson>John Smith</orderperson>
<shipto>
<name>Ola Nordmann</name>
<address>Langgt 23</address>
<city>4000 Stavanger</city>
<country>Norway</country>
</shipto>
<item>
<title>Empire Burlesque</title>
<note>Special Edition</note>
<quantity>1</quantity>
<price>10.90</price>
</item>
<item>
<title>Hide your heart</title>
<quantity>1</quantity>
<price>9.90</price>
</item>
</shiporder >

2.1.1.1.1.11 SWIFT
SWIFT message types are the format or schema used to send messages to financial
institutions on the SWIFT (Society for Worldwide Interbank Financial Telecommunication)
network.
UNCAL Data Mapper
 UNCAL Data Mapper

2.1.1.1.2 Mapping
Mapping is a function to convert data structures into other data structures,
for example IDoc to XML

• Create Mapping
• Test Mapping
• Function

2.1.1.1.2.1 Create Mapping

Right click button on node mapping, choose New Mapping

• Fill the Mapping Name, Message Source, Message Destination, and Description ( Optional
)

• Until node mapping is formed like in the picture :

 UNCAL Data Mapper

Create a structure mapping

In UNCAL ESB create mapping is easy with only drag and drop

Or use the availabe functions

2.1.1.1.2.2 Test Mapping

Test the mapping by click Go to Testing and entering a variable into the Destination Field
or by importing the Test File

Click Convert to testing

 UNCAL Data Mapper

We can save either input or output files

2.1.1.1.2.3 Function
• Standard Function

• User Defined Function

2.1.1.1.2.3.1 Standard Function

• Arithmetic
• Boolean
• Constants
• Date
• Statistics
• Text
• Node Function

2.1.1.1.2.3.1.1 Arithmetic

• Add
• Substract
• Multiply
• Divide
• Round

2.1.1.1.2.3.1.1.1 Add
To add 2 numbers from 2 nodes.
Example :
Total Price = $ 10,000< /FONT >
Tax (10%) = $ 1,000< /FONT >
Price with tax = 10000 +1000< /FONT >
= $ 11000
 UNCAL Data Mapper

2.1.1.1.2.3.1.1.2 Substract
To subtract 2 numbers from 2 nodes.
Example :

Price = $ 10,000
Discount (10%) = $ 1,000< /FONT >
Price After Discount = 10,000 - 1,000< /FONT >
= $ 9,000

2.1.1.1.2.3.1.1.3 Multiply
To subtract 2 numbers from 2 nodes.
Example :

Unit Price = $ 1,000< /FONT >

Quantity = 10
Total Price = 1,000 x 100< /FONT >
= $ 10,000

2.1.1.1.2.3.1.1.4 Divide
Example :

Total Price = $ 10,000< /FONT >

Quantity = 10
Unit Price = 10,000 / 10< /FONT >
= $ 1,000

2.1.1.1.2.3.1.1.5 Round
Example :
 UNCAL Data Mapper

Total Price = $ 19032,94< /FONT >

Round = $ 19033

2.1.1.1.2.3.1.2 Boolean
And

• Or
• Not
• If
• Equals
• Switch

2.1.1.1.2.3.1.2.1 And
Z is true if X and Y have the value true. Otherwise, Z is false.
Example :
X = 123
Y = 678
Z = True

X = 123
Y=
Z = false

2.1.1.1.2.3.1.2.2 Or
Z is true if X or Y have the value true. Otherwise, Z is false.
Example :
X = 123
Y = 678
Z = True

X = 123
Y=
Z = True
 UNCAL Data Mapper

X=
Y=
Z = False

2.1.1.1.2.3.1.2.3 Not
Z is false if X has the value true

Z is true if X has the value false

Example :
X = 123
Z = false
X=
Z = True

2.1.1.1.2.3.1.2.4 If
If With Else
If condition X is fulfilled (returns true): Z = X
If condition X is not fulfilled (returns false): Z = Y

Example :
parameter
 UNCAL Data Mapper

If
W=a
Result
Z = true
W=c
Result
Z = false

If Without Else
If condition X is satisfied (returns true): X = Z.
Example:
parameter

W=a
Result
Z = true
 UNCAL Data Mapper

2.1.1.1.2.3.1.2.5 Equals
Compares both Boolean values X and Y and returns true if both are equal, otherwise false.
Non-Boolean values are interpreted as false

Example :
X = 123
Y = 123
Result
Z = true

X = 123
Y = 456
Result
Z = false

2.1.1.1.2.3.1.2.6 Switch
Compares one value against a list of values, and returns a result corresponding to the first
match. SWITCH takes an optional default value which is used when no match is found. Match
multiple values, return first match

Example :

X = A, then the output is 1

If X = B, the output is 2

Besides the values of A and B, the output requires "Others"

 UNCAL Data Mapper

2.1.1.1.2.3.1.2.7 NotEquals
Checks if the values of two operands are equal or not, if values are not equal then condition
becomes true.

(A != B) is true.

2.1.1.1.2.3.1.2.8 Less Than

Berfungsi untuk mengecek apakah x lebih kecil dari y. Jika lebih kecil maka hasilnya true.

Contoh: x < y = true

2.1.1.1.2.3.1.2.9 Greater Than

To check whether the value of X is bigger than Y

2.1.1.1.2.3.1.3 Constants
• Constant

• SQLAction

• SQLCompare
 UNCAL Data Mapper

2.1.1.1.2.3.1.3.1 Constant
Z gets any string constant that you can enter in the dialog for the function parameters.
Example :

X=Z

2.1.1.1.2.3.1.3.2 SQLAction
SQL Action is a function which node Action structure type SQL be able to choose the available
Action by UDM.

2.1.1.1.2.3.1.3.3 SQL Compare

SQL Compare Function. SQL Compare is a function for comparison in SQL query. The available SQL
Compare are LT (Less Than), EQ ( Equal ), LTEQ (Less Than Equal ), GT ( Greater Than ) , GTEQ
(Greater Than Equal), Like, and NEQ ( Not Equal ).
 UNCAL Data Mapper

2.1.1.1.2.3.1.4 Date
Current Date

• Date Trans
• Date Before
• Date After
• Compare Dates

2.1.1.1.2.3.1.4.1 Current Date

2.1.1.1.2.3.1.4.2 Date Trans

Converts date format X to another date format Z.
Example :

2.1.1.1.2.3.1.4.3 Date Before

Example :
X = 01/02/2019
Y = 02/02/2019
Result
Z = true
X = 02/02/2019
Y = 01/02/2019
Result
Z = false
 UNCAL Data Mapper

2.1.1.1.2.3.1.4.4 Date After

Example :
X = 01/02/2019
Y = 02/02/2019
Result
Z = false
X = 02/02/2019
Y = 01/02/2019
Result
Z = true

2.1.1.1.2.3.1.4.5 Compare Dates

Z = 1, when date X is after date Y

Z = 0, when date X is the same as date Y

Z = -1, when date X is before date Y

Example :

X = 01/02/2019

Y = 02/02/2019

Result

Z = -1

X = 02/02/2019

Y = 01/02/2019

Result

Z=1

X = 02/02/2019

Y = 02/02/2019

Result
 UNCAL Data Mapper

Z=0

2.1.1.1.2.3.1.4.6 Format Date

It functions to change the date format to the other new date format
Example : "dd/MM/yyyy HH:mm:ss" To "yyyMMddHHmm"

2.1.1.1.2.3.1.5 Statistics
Sum

• Average

2.1.1.1.2.3.1.5.1 Sum
Z = Sum of values X1 to Xn of a context.

Example :

X1 = 4

X2 = 5

X3 = 6

Result

Z = 15

2.1.1.1.2.3.1.5.2 Average
Example :

X1 = 4

X2 = 5

X3 = 6

Result

Z=5

2.1.1.1.2.3.1.5.3 Min
The function gives the smaller of the two arguments.
Example :
 UNCAL Data Mapper

X1 = 4
X2 = 5
X3 = 6
Result
Z=4

2.1.1.1.2.3.1.5.4 Max
This function gives the maximum of the two arguments.
Example :

X1 = 4
X2 = 5
X3 = 6
Result
Z=6

2.1.1.1.2.3.1.5.5 Count
Function to count the number of loops on elements in the structure source.
Example: count the number of loops in element x

This is an example of looping on element x. Element x in the structure source repeats 3 times,
then the output result in element z in the structure destination contains 3.

2.1.1.1.2.3.1.5.6 Rank
Function to sort the rank of the loop on the element x.
 UNCAL Data Mapper

When the properties are set, the rank can be set with 2 options, ascending (smallest to
largest) and descending (largest to smallest)

2.1.1.1.2.3.1.6 Text

• Substring
• Concat
• Replace String
• Length
• endsWith
• startsWith
• toUpperCase
• toLowerCase
• Trim

2.1.1.1.2.3.1.6.1 Substring
Returns a substring O for a string I. Use the dialog for the function properties to specify
the position of the substring.
Example :
X = Hello

Parameter :
Start Position = 2< /FONT >
Character Count = 3< /FONT >
Result
Z = llo
 UNCAL Data Mapper

2.1.1.1.2.3.1.6.2 Replace String

Result
Z = Hallo

2.1.1.1.2.3.1.6.3 Length
Example :
X = hello
Result
Z=5

2.1.1.1.2.3.1.6.4 endsWith
Z = true when Y is the last string in X; otherwise false.
Example :
X = hello
Y=o
Result
Z = true
X = hello
Y=l
Result
Z = false
 UNCAL Data Mapper

2.1.1.1.2.3.1.6.5 startsWith
Z = true when Y is the first string in X; otherwise false.

Example :
X = hello
Y=h
Result
Z = true
X = hello
Y=o
Result
Z = false

2.1.1.1.2.3.1.6.6 toUpperCase
Example :
X = hello
Result
Z = HELLO

2.1.1.1.2.3.1.6.7 toLowerCse
Converts all upper case letters in X to lower case letters .
Example :
X = HELLO
Result
Z = hello
 UNCAL Data Mapper

2.1.1.1.2.3.1.6.8 Trim
Remove all white space characters (spaces, tabs, returns) at the start and end of a string.
Example :

X = Hello
Result
Z = Hello

2.1.1.1.2.3.1.6.9 Concat
Z = Linking of strings X and Y (without blanks).
Example :
X = Hello

Y = World
Parameter
Number of Slot = 2< /FONT >< /FONT >
Delimiter = /
Result
Z = Hello/World

2.1.1.1.2.3.1.6.10 Start With

StartsWith method is used to check the prefix of string. It verifies if given string
starts with argument string or not
startsWith (2 input parameters)

R = true when

Y is the first string in

X ; otherwise false

startWith (3 input parameters)

R = true when

Y matches

X from position
 UNCAL Data Mapper

Z ; otherwise false .

2.1.1.1.2.3.1.7 Node Function

2.1.1.1.2.3.1.7.1 GroupBy
groupingBy() method of Collectors class in Java are used for grouping objects by
some property and storing results in a Map instance

2.1.1.1.2.3.1.7.2 Index Of
method returns the position of the first occurrence of specified character(s)
in a string.

2.1.1.1.2.3.1.7.3 Join
The join() method which allows one thread to wait until another thread completes its
execution.

Method ini digunakan untuk menggabungkan beberapa nilai yang bertipe data String ,
berdasarkan delimiter atau pembatas yang menggunakan beberapa simbol., Kita dapat
mengakses method tersebut secara langsung, tanpa harus menginstansi Objek dari fungsi
tersebut, karena secara defautl method ini mempunyai modifier static.

2.1.1.1.2.3.1.7.4 Index
Serves to provide an index to the repetition in the mapping. The index is sorted from 1 to n
(according to the number of repetitions). For example, if there are 3 repetitions, then the result at
the destination is 1, 2, 3.
 UNCAL Data Mapper

2.1.1.1.2.3.1.8 LookUp
2.1.1.1.2.3.1.8.1 LookUp
LookUpDb Function to retrieve data directly from the database. In sql query the same as the
SELECT command to select data retrieved from the database.

If you open the properties, the following screen will appear. The user enters the DB Type, host,
port, username, and password to access a connection. After click "set connection" the user selects
the database, table, SELECT column, along with the slot which functions like WHERE in sql.
 UNCAL Data Mapper

2.1.1.1.2.3.2 User Defined Function

Not all mapping functions can be provided by standard functions so we need the User
Define Functions (UDF).
User can create their own functions that are not on the standard functions.
Example :
UNCAL Data Mapper