SQL help........SSIS staging tables usage method

[Ranga_The_Donga]

e staging table ela use cheyali...ekkada define cheyali.....

database lo ayithe temp table ledhu.......

my prob is....oka table vunna data vere access DB ki load cheyali......each time truncate chesi load chesthunte.....it takes lot of time and effecting performance.

so ikkada staging table use chesi look-up cheyali...so adhi ela cheyalo konchem cheppandi.... CITI#H@ CITI#H@ CITI#H@ CITI#H@

[manoghna]

CITI#H@ CITI#H@


sql db lo vunna table ni Acees db ki trasnfer cheyala... ithe truncate endhuku cheyatam  sCo_^Y

[dkchinnari]

pm to bezawada rowdy..he is working on ssis  cry@fl

[Ranga_The_Donga]

[quote author=meghana9 link=topic=220351.msg2716462#msg2716462 date=1312479939]
CITI#H@ CITI#H@


sql db lo vunna table ni Acees db ki trasnfer cheyala... ithe truncate endhuku cheyatam  sCo_^Y
[/quote]

Its every day...job...roju run avuthundhi......

inorder to avoid entry of duplicate values into Access DB....

prathi sari truncate chesi malli load chesthuna.....

[Ranga_The_Donga]

[quote author=meghana9 link=topic=220351.msg2716462#msg2716462 date=1312479939]
CITI#H@ CITI#H@


sql db lo vunna table ni Acees db ki trasnfer cheyala... ithe truncate endhuku cheyatam  sCo_^Y
[/quote]

everyone is welcome ba.... S#d^ S#d^ S#d^

[chowdary10]

[quote author=vishwamithra link=topic=220351.msg2716465#msg2716465 date=1312479981]
pm to bezawada rowdy..he is working on ssis  cry@fl
[/quote] y crying

[Ranga_The_Donga]

[quote author=vishwamithra link=topic=220351.msg2716465#msg2716465 date=1312479981]
pm to bezawada rowdy..he is working on ssis  cry@fl
[/quote] +_([quote author=Jeedeelu link=topic=220351.msg2716484#msg2716484 date=1312480154]
everyone is welcome ba.... S#d^ S#d^ S#d^
[/quote]

[dkchinnari]

[quote author=KINDAL link=topic=220351.msg2716487#msg2716487 date=1312480184]
y crying
[/quote]jeedulu badha lo unnadu gaaa..badha share chesukuntunaaa  cry@fl

[nenuinthe]

req clear ga cheppu bhayya....Staging table unda nuvvu create cheyyala.....asalu mottam Flow naku clear ga cheppu

[Ranga_The_Donga]

[quote author=BEZAWADA ROWDY link=topic=220351.msg2716521#msg2716521 date=1312480771]
req clear ga cheppu bhayya....Staging table unda nuvvu create cheyyala.....asalu mottam Flow naku clear ga cheppu
[/quote]

staging table ledhu........create cheyali.....

sql table lo vunna data access db ki pampali.....kani data millions of rows.....ekkuva time paduthundhii transfering ki....

idhi daily job......roju ganta ganta ki run avuthundhii...

so staging table use chesthe......sql lo vunna table and staging table compare chesi....newly added rows ne transfer chesthe performance perguthundhi kadha......

kani staging concept ela use cheyalo theliyadhu......ardham ayindha ah? sCo_^Y sCo_^Y sCo_^Y sCo_^Y

[chowdary10]

[quote author=vishwamithra link=topic=220351.msg2716496#msg2716496 date=1312480369]
jeedulu badha lo unnadu gaaa..badha share chesukuntunaaa  cry@fl
[/quote]

jeedulu shit ki povali ani poleka pothe jedlu badulu nuvvu pothava [img]http://desmond.imageshack.us/Himg841/scaled.php?server=841&filename=venkybrahmi.gif&res=medium[/img]

evadi shit ade povali, evadi baadha vade padali

[nenuinthe]

[quote author=Jeedeelu link=topic=220351.msg2716550#msg2716550 date=1312481148]
staging table ledhu........create cheyali.....

sql table lo vunna data access db ki pampali.....kani data millions of rows.....ekkuva time paduthundhii transfering ki....

idhi daily job......roju ganta ganta ki run avuthundhii...

so staging table use chesthe......sql lo vunna table and staging table compare chesi....newly added rows ne transfer chesthe performance perguthundhi kadha......

kani staging concept ela use cheyalo theliyadhu......ardham ayindha ah? sCo_^Y sCo_^Y sCo_^Y sCo_^Y
[/quote]nuvvu compare chese tappudu asalu staging table endu direct source ni destination tho match cheyyi....asalu staging table enduku ante manam kotta data vachinapudu pata data delete cheyyalsi vachindi anuko....delete cheyyakunda data ekkadina save cheyyali ante staging table use chestaru...ledante emana modifications destination ki velle lopala cheyyali ante oka table petti modification chesi appudu stage nundi end ki move chestaru....

ne case lo asalu staging table akkarledu......source ni desti ni match cheyyi...lookup petti....No match output e insert cheyyi

[C Nation]

Add a execute sql task before transferring data.
The select statement should be like SELECT present_synch_dt  from syn
Store this present_synch_dt in variable Present_SynchTime
And then add dataflow job. In the select statement use where last_update_dt >= Present_SynchTime
After dataflow job update the present_synch_dt

[Ranga_The_Donga]

[quote author=BEZAWADA ROWDY link=topic=220351.msg2716661#msg2716661 date=1312482368]
nuvvu compare chese tappudu asalu staging table endu direct source ni destination tho match cheyyi....asalu staging table enduku ante manam kotta data vachinapudu pata data delete cheyyalsi vachindi anuko....delete cheyyakunda data ekkadina save cheyyali ante staging table use chestaru...ledante emana modifications destination ki velle lopala cheyyali ante oka table petti modification chesi appudu stage nundi end ki move chestaru....

ne case lo asalu staging table akkarledu......source ni desti ni match cheyyi...lookup petti....No match output e insert cheyyi
[/quote]

source lo updates vunnayi.........

look-up pedithe....each row look up chesukovatam vall time tesukuntundhii.......paina nunchi orders vachayi....

staging tables use chesi....insert and update cheyamannaru..... cry@fl cry@fl cry@fl cry@fl

[JUJUBI_JULABI]

question antha ga ardam kaledu baa, will just tell some points , they may be used, Look at lookup transformation , sql query tho take one unique column and use left outer join , SP rayi , define ur own temp table with #, and do all ur processing , T sql lo handle chestey performance ekuva, rather using SSIS , Pkg lo just exec sp rayi , migatha pani antha SP la chesko