pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='arey ooo samba' timestamp='1364439360' post='1303499565'] asalu ee CDC stage ante first nunchi enthe baa [img]http://lh6.ggpht.com/-LkjiY7VR-0w/UUeyLvnASwI/AAAAAAAAKpM/uIOktpTCzJM/s150/Brahmi-25.gif[/img]...concept wise vinadaniki ardam chesukovadaniki bagane untadi kani..stages ni configure cheyali ante...[img]http://lh6.ggpht.com/-LkjiY7VR-0w/UUeyLvnASwI/AAAAAAAAKpM/uIOktpTCzJM/s150/Brahmi-25.gif[/img] [/quote] Mee daggara incremental ela chestaru mama Nenu kotta job ki vacha so ikkada emi Levu so naa Pranam teestunnaru.....naa chavukochindi
dalapathi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364440891' post='1303499753'] Ippudu adendo Chestey Sql lo ney oracle access cheyyochantav anthey na mama ...nenu already odbc stage ee vaadutunna source [/quote] yeah, edho lync setup cheyyalai ... ama daantlo evado chesindu ... so, memu annie sqlserver nunde read chestaam. kaanie meedhi pedda company ayite mee DBAs atlaa chestaaroo ledhoo telvadu ... oka post ayite vesi chuudu sqlserver emeda panichesetollaki idea vunduntadhi
pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='dalapathi' timestamp='1364441226' post='1303499815'] yeah, edho lync setup cheyyalai ... ama daantlo evado chesindu ... so, memu annie sqlserver nunde read chestaam. kaanie meedhi pedda company ayite mee DBAs atlaa chestaaroo ledhoo telvadu ... oka post ayite vesi chuudu sqlserver emeda panichesetollaki idea vunduntadhi [/quote] so ee work sql dbas cheyyala leka mana datastage admin hcyylana..maadi pedda comp em kaadu mama edo ok kind of
qwerty1204 Posted March 28, 2013 Author Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364441018' post='1303499772'] Mee daggara incremental ela chestaru mama Nenu kotta job ki vacha so ikkada emi Levu so naa Pranam teestunnaru.....naa chavukochindi [/quote] maa team is responsible only until ODS baa..ee datamart/datawarehouse build chese team veredhi undi [img]http://lh6.ggpht.com/-LkjiY7VR-0w/UUeyLvnASwI/AAAAAAAAKpM/uIOktpTCzJM/s150/Brahmi-25.gif[/img]
dalapathi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364442220' post='1303499978'] so ee work sql dbas cheyyala leka mana datastage admin hcyylana..maadi pedda comp em kaadu mama edo ok kind of [/quote] SQL DBAs aey cheyyali ... datastage admins ki sambandinchindhi kaadhu
pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='dalapathi' timestamp='1364478535' post='1303501351'] SQL DBAs aey cheyyali ... datastage admins ki sambandinchindhi kaadhu [/quote] bayya inko doubt initial load tarvta 10 records load inai next day 5 records vasunnai source nunchi for example avi update records anukundam .. appudu output lo chnage capture stage 5updates 5deletes choospistadi kada i mean alrady manam reference data set(target ee kada idi kuda) lo 10 records vuntai next day 5 records vastey avi update records ithey migilina 5 delete kinda choopistondi kada chnage capture stage deenni ela handle cheyyali ex target lo 100 records vundi source nunchi emi changed data rakkapotey adi deletes kinda teeskuni 100 targets ni delete chestadi kada
pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='arey ooo samba' timestamp='1364452232' post='1303500804'] maa team is responsible only until ODS baa..ee datamart/datawarehouse build chese team veredhi undi [img]http://lh6.ggpht.com/-LkjiY7VR-0w/UUeyLvnASwI/AAAAAAAAKpM/uIOktpTCzJM/s150/Brahmi-25.gif[/img] [/quote] cool kada antey only staging aa
dalapathi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364486790' post='1303502367'] bayya inko doubt initial load tarvta 10 records load inai next day 5 records vasunnai source nunchi for example avi update records anukundam .. appudu output lo chnage capture stage 5updates 5deletes choospistadi kada i mean alrady manam reference data set(target ee kada idi kuda) lo 10 records vuntai next day 5 records vastey avi update records ithey migilina 5 delete kinda choopistondi kada chnage capture stage deenni ela handle cheyyali ex target lo 100 records vundi source nunchi emi changed data rakkapotey adi deletes kinda teeskuni 100 targets ni delete chestadi kada [/quote] yeah, andhuke source lo vunna mottham data ni target lo vunan mottham data tho compare cheyyi ... appudu 5 copy ani chebutadhi ... 5 edits ani chebutadhi ledaaa input only 5 aey teesukuntaa ante ... adhi avannie deletes ane anukuntadhi ... so, nuvvu target table lo deletes cheyyakundaa only insert, updates chesetattu ayite atlaa cheste chaalu chala varkau data ware house nundi records delete cheyyaru ,,, maa daantlo memu delete cheyyam ... only inserts & updates ... inko project lo deletes chestaam ... kaanie andulo dialy source nundi annie read chestaam asalu mee source lo enni records vunany ... ??? processing ki pedda time pattadhu kadaa ... mottham cheste emi problem avutadhi ... ??? enni millions vunnay records?
pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='dalapathi' timestamp='1364490232' post='1303502959'] yeah, andhuke source lo vunna mottham data ni target lo vunan mottham data tho compare cheyyi ... appudu 5 copy ani chebutadhi ... 5 edits ani chebutadhi ledaaa input only 5 aey teesukuntaa ante ... adhi avannie deletes ane anukuntadhi ... so, nuvvu target table lo deletes cheyyakundaa only insert, updates chesetattu ayite atlaa cheste chaalu chala varkau data ware house nundi records delete cheyyaru ,,, maa daantlo memu delete cheyyam ... only inserts & updates ... inko project lo deletes chestaam ... kaanie andulo dialy source nundi annie read chestaam asalu mee source lo enni records vunany ... ??? processing ki pedda time pattadhu kadaa ... mottham cheste emi problem avutadhi ... ??? enni millions vunnay records? [/quote] yeah we are just doing soft delete ..means chnage the update type to 'D' we have around 1 million records i think so ila latest records ni fetch chesta deletes ni handle chese chance ee ledantava bayya
dalapathi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364490585' post='1303503026'] yeah we are just doing soft delete ..means chnage the update type to 'D' we have around 1 million records i think so ila latest records ni fetch chesta deletes ni handle chese chance ee ledantava bayya [/quote] emo mari ... naaku teliyadu atlaanti scenario lo emi chestaaroo ... 1 million marie ekkvua emie kaadhu kadaa ... job normal gaa buid chesi chuudu entha time padtundoo run avvatanaiki ... naaku tlesi pedda time emie pattadhu ...
pandemkodi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='dalapathi' timestamp='1364496464' post='1303504077'] emo mari ... naaku teliyadu atlaanti scenario lo emi chestaaroo ... 1 million marie ekkvua emie kaadhu kadaa ... job normal gaa buid chesi chuudu entha time padtundoo run avvatanaiki ... naaku tlesi pedda time emie pattadhu ... [/quote] Ippudu prob kaadu mama future lo data 10 times vastey problem Ippudu just 10 mins lo ipotundi
Silver_mani Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364497582' post='1303504256'] Ippudu prob kaadu mama future lo data 10 times vastey problem Ippudu just 10 mins lo ipotundi [/quote] mee vadu cheppindi correcte mama .... you cant scan the entire table every time if such huge records are there .....nenu cheppindi follow aipoyi script raasey [img]http://lh6.ggpht.com/-LkjiY7VR-0w/UUeyLvnASwI/AAAAAAAAKpM/uIOktpTCzJM/s150/Brahmi-25.gif[/img]
dalapathi Posted March 28, 2013 Report Posted March 28, 2013 [quote name='pandemkodi' timestamp='1364497582' post='1303504256'] Ippudu prob kaadu mama future lo data 10 times vastey problem Ippudu just 10 mins lo ipotundi [/quote]
fullmeals Posted March 28, 2013 Report Posted March 28, 2013 Hi all, meelo yevaraina datastage admin backup ichevallu vunnara? Help me
Recommended Posts