@@@@calling All Datastage Developers@@@@

[qwerty1204]

hi have a doubt abt parallesim

i have an incoming 100 rows in to a transformer

with in the transformer I have three o/p links having some constraints

my o/p1 will be getting all the 100 rows
my o/p2 will be getting 60 rows based on a constraint
my o/p3 will be getting 20 rows based on a constraint

now I use a funnel stage to combine them all

after that I have a transformer in which I need to generate sequence number for the incoming rows (here the number of incoming rows frm the funnel is 100+60+20=180) my trnasformer o/p should generate a sequnece of numbers frm 1 to 180

I have used this formula (@PARTITIONNUM+(@INROWNUM-1)*@NUMPARTITIONS)+1 in several jobs to get a sequence of numbers while running on parallel nodes

[b]If I use the same formula in the above mentioned case..do I get the same result (i.e. getting a sequence of numbers frm 1 to 180?)[/b]


paian explain chesindi anta..kinda question ardam avvdaniki ani

[dalapathi]

[quote name='arey ooo samba' timestamp='1338928559' post='1301915753']
hi have a doubt abt parallesim

i have an incoming 100 rows in to a transformer

with in the transformer I have three o/p links having some constraints

my o/p1 will be getting all the 100 rows
my o/p2 will be getting 60 rows based on a constraint
my o/p3 will be getting 20 rows based on a constraint

now I use a funnel stage to combine them all

after that I have a transformer in which I need to generate sequence number for the incoming rows (here the number of incoming rows frm the funnel is 100+60+20=180) my trnasformer o/p should generate a sequnece of numbers frm 1 to 180

I have used this formula (@PARTITIONNUM+(@INROWNUM-1)*@NUMPARTITIONS)+1 in several jobs to get a sequence of numbers while running on parallel nodes

[b]If I use the same formula in the above mentioned case..do I get the same result (i.e. getting a sequence of numbers frm 1 to 180?)[/b]


paian explain chesindi anta..kinda question ardam avvdaniki ani
[/quote]
vastadhi anukuntaaa...try chesi chuusinavaa.........???

[dalapathi]

[quote name='arey ooo samba' timestamp='1338928559' post='1301915753']
hi have a doubt abt parallesim

i have an incoming 100 rows in to a transformer

with in the transformer I have three o/p links having some constraints

my o/p1 will be getting all the 100 rows
my o/p2 will be getting 60 rows based on a constraint
my o/p3 will be getting 20 rows based on a constraint

now I use a funnel stage to combine them all

after that I have a transformer in which I need to generate sequence number for the incoming rows (here the number of incoming rows frm the funnel is 100+60+20=180) my trnasformer o/p should generate a sequnece of numbers frm 1 to 180

I have used this formula (@PARTITIONNUM+(@INROWNUM-1)*@NUMPARTITIONS)+1 in several jobs to get a sequence of numbers while running on parallel nodes

[b]If I use the same formula in the above mentioned case..do I get the same result (i.e. getting a sequence of numbers frm 1 to 180?)[/b]


paian explain chesindi anta..kinda question ardam avvdaniki ani
[/quote]
atlaaney transformer lo stage properties lo surrogate key aney option vuntadhi chuudu.........adhi okasaari try chesi chuudu.........parallel lo kuudaa work avvudhie anukuntaa.........ee logic emie avasarma lekundaa

[qwerty1204]

[quote name='dalapathi' timestamp='1338929696' post='1301915916']
vastadhi anukuntaaa...try chesi chuusinavaa.........???
[/quote]

try chesanuu baa...the numbers are cmng in sequence only..but I tried like several times and once in a while I am getting numbers more than 180 (like 12..and so on 170 then 172, 175, 177, 181, 183 ala exceed avthundi)

In order to avod tht I made the transformer to run in sequential mode in the past..but asalu logic enti aa anii telusundamu ani

[qwerty1204]

[quote name='dalapathi' timestamp='1338929902' post='1301915935']
atlaaney transformer lo stage properties lo surrogate key aney option vuntadhi chuudu.........adhi okasaari try chesi chuudu.........parallel lo kuudaa work avvudhie anukuntaa.........ee logic emie avasarma lekundaa
[/quote]

asalu ee surrogate key intavaraku use ee cheyaledu baa..neeku emmana manchi online link unte post cheyi..how to use it anedi..like step by step procedure laga

[pandemkodi]

[quote name='arey ooo samba' timestamp='1338930514' post='1301915999']

asalu ee surrogate key intavaraku use ee cheyaledu baa..neeku emmana manchi online link unte post cheyi..how to use it anedi..like step by step procedure laga
[/quote]
tx lo ki poyyi surrogate key section cliek cheyy
flat file aa database aa select chesko

flatfile ihtey give the source file(shoulc be empty)

and give the initial value and also choose weather you want system picked values or default

and goto tx link output and give your desired field name
this is the input to skey
function -->utility --->NextSurrogateKey()

anthey

[pandemkodi]

kaani tx lo surrogatekey konchem verity gaa vundi
for ex 10 record tho first time run chestey 1 to 10 vstadi
next malli run chestey ekkado strt avutondi

[pandemkodi]

tranformer lo 3 time s run chesaka o/p ila tgaladutondi


"100 " "Tiger " "1" " I am " "16"
"100 " "Tiger " "3" " ETL " "17"
"100 " "Tiger " "5" " working fr " "18"
"100 " "Tiger " "7" " home " "19"
"100 " "Tiger " "9" " from 10 am " "20"
"100 " "Tiger " "2" " en " "1006"
"100 " "Tiger " "4" " developer " "1007"
"100 " "Tiger " "6" " om " "1008"
"100 " "Tiger " "8" " everyday " "1009"
"100 " "Tiger " "10" " to 10 pm. " "1010"

16,17,18,19,20 1006,1007 1008 1009 1010 are sks ran in parallel

[qwerty1204]

[quote name='pandemkodi' timestamp='1338934526' post='1301916802']
tx lo ki poyyi surrogate key section cliek cheyy
flat file aa database aa select chesko

flatfile ihtey give the source file(shoulc be empty)

and give the initial value and also choose weather you want system picked values or default

[b]and goto tx link output and give your desired field name
this is the input to skey
function -->utility --->NextSurrogateKey()[/b]

anthey
[/quote]


adhi entoo ardam kaledu baa.. transformer loo surrogate key use chesthe..seperate ga surrogate key stage use cheyalisna avasaram undadu kada?

nuvvu mention chesina function-->utility-->NextSurrogateKey() enti adhi

[pandemkodi]

[quote name='arey ooo samba' timestamp='1338937259' post='1301917128']
adhi entoo ardam kaledu baa.. transformer loo surrogate key use chesthe..seperate ga surrogate key stage use cheyalisna avasaram undadu kada?

nuvvu mention chesina function-->utility-->NextSurrogateKey() enti adhi
[/quote]
emley bayya

nuvvu file input ichinaaka

tx lo o/p side and i/p side okati vuntai kada o/p side skey ani neeku kaavalsina field name ichuko
daaniki i/p side NextSurrogateKey() ichuko

anthey
for example


[b]tx left side [/b] [b] tx rightside[/b]
link.input.empno empno
nextsurrogatekey() skey

[pandemkodi]

[quote name='arey ooo samba' timestamp='1338937259' post='1301917128']


adhi entoo ardam kaledu baa.. transformer loo surrogate key use chesthe..seperate ga surrogate key stage use cheyalisna avasaram undadu kada?

nuvvu mention chesina function-->utility-->NextSurrogateKey() enti adhi
[/quote]
antey adi path bayya tx lo function lo utility lo aa nextsurrogatekey() anedi vundi ani ala cheppa (naaku sarigga cheppadam raadu bayyo emankoku)

[qwerty1204]

[quote name='pandemkodi' timestamp='1338939612' post='1301917519']
antey adi path bayya tx lo function lo utility lo aa nextsurrogatekey() anedi vundi ani ala cheppa (naaku sarigga cheppadam raadu bayyo emankoku)
[/quote]

oh kk baa..got it thanks

[Peep]

datastage call thesukovali okka celebrity , herooo , atleast jr artist yena help cheyandi ... ....

[email protected]

pls urgent.

[D.V.S.KARNA]

ltt

[irritation]

[quote name='Peep' timestamp='1340308464' post='1302005700']
datastage call thesukovali okka celebrity , herooo , atleast jr artist yena help cheyandi ... ....

[email protected]

pls urgent.
[/quote]

PM to dalapathi mama....
ikkada andarilo ki senior... and DS lo strong athane.....