Sql Server / Rdbms Experts - Need Your Inputs

[mettastar]

Brothers

 

I have a requirement to get delta records from source system (SQL Server), this table doesn't have any Date field or any other field by which I can Identify latest transactions on that table.

 

Can we get these delta records by reading the transaction log of this database?

I know that transaction log maintains the information whenever there is any transaction happens on the table like insert update delete.. but never used this to get delta recs or read the latest recs from table. 

 

if any of you used this approach to read the delta data, can you please post it here. Thanks in advance

[cherlapalli_jailer]

i think u can use row id to get data accordingly 

 

google for row ID in SQL Server 

[mettastar]

i think u can use row id to get data accordingly 

 

google for row ID in SQL Server 

table lo record ni update chesthe ROWID Kuda update avudha?

[mettastar]

i think u can use row id to get data accordingly 

 

google for row ID in SQL Server 

Oracle aithe ROWID update avvadhu when you update a record.. SQL server not sure..

 

LTT

[cherlapalli_jailer]

Oracle aithe ROWID update avvadhu when you update a record.. SQL server not sure..

 

LTT

not sure

 

i only used row id once ..so antha grip ledu kaani we can work around row id to get latest data 

 

but going to logs is not an idea at all ..performance will be down by 75% 

[mettastar]

not sure

 

i only used row id once ..so antha grip ledu kaani we can work around row id to get latest data 

 

but going to logs is not an idea at all ..performance will be down by 75% 

if an existing record gets updated and rowid doesnt change then how can we identify that record? 

 

last one month lo aa table meda aina transaction IDs theesukoni.. andulo nunchi ROWID lani identify chesi atla pull chedham anukuntunnaa

[cherlapalli_jailer]

if an existing record gets updated and rowid doesnt change then how can we identify that record? 

 

last one month lo aa table meda aina transaction IDs theesukoni.. andulo nunchi ROWID lani identify chesi atla pull chedham anukuntunnaa

can you do this ?

 

just now i ggot an idea

 

Write a trigger on this table (Will be bit slow)

Add update wtc ..store it in another table ..some data or complete date 

 

Either use that table or join these table to retrieve the records 

if you need more info i will explain in details

 

TRIGGER  will work 

[mettastar]

can you do this ?

 

just now i ggot an idea

 

Write a trigger on this table (Will be bit slow)

Add update wtc ..store it in another table ..some data or complete date 

 

Either use that table or join these table to retrieve the records 

if you need more info i will explain in details

 

TRIGGER  will work 

Trigger idea already undhi bhayya.. daani valla performance debba thintundhi kadha chaalaa.. anduke transaction logs anukuntunnaa..

ma Solution Architect trigger idea ne ichadu.. but 300 million+ records table adhi... definite ga triggers pedithe chaala performance issue untundhi kada.. anduke table performance hit avvakunda (while other ETL process loading that table) i want to read the data.. 

 

So transaction log ni read chesthe best emo anipinchindhi

[cherlapalli_jailer]

Trigger idea already undhi bhayya.. daani valla performance debba thintundhi kadha chaalaa.. anduke transaction logs anukuntunnaa..

ma Solution Architect trigger idea ne ichadu.. but 300 million+ records table adhi... definite ga triggers pedithe chaala performance issue untundhi kada.. anduke table performance hit avvakunda (while other ETL process loading that table) i want to read the data.. 

 

So transaction log ni read chesthe best emo anipinchindhi

file reading take more time and that is not feasible 

 

Insexing proper ga vundi if there are no other triggers then no issue if there r already triggers on that particular data then will be slow

 

 

Indexing correct cheyyamanu DBA ni u will not see much performance issue

[mettastar]

file reading take more time and that is not feasible 

 

Insexing proper ga vundi if there are no other triggers then no issue if there r already triggers on that particular data then will be slow

 

 

Indexing correct cheyyamanu DBA ni u will not see much performance issue

transaction log ki edo system table undhi SQL Server lo.. 

 

ikkada triggers ROW level lo cheyali kada.. and vere ETL tool aa table loki data load chesetapudu chala slow avuthundhi kada?

 

transcation log dhi cheyalekapothe inka adhe approach theesukovali

[cherlapalli_jailer]

transaction log ki edo system table undhi SQL Server lo.. 

 

ikkada triggers ROW level lo cheyali kada.. and vere ETL tool aa table loki data load chesetapudu chala slow avuthundhi kada?

 

transcation log dhi cheyalekapothe inka adhe approach theesukovali

ante neenu eppudu live lo transaction data access cheyyaledu

 

so i am not sure

 

does that table contains details of all the tables ?

[mettastar]

ante neenu eppudu live lo transaction data access cheyyaledu

 

so i am not sure

 

does that table contains details of all the tables ?

nenu kuda cheyaledu bro kaani idea undhi... yeah aa database lo unna tables-transaction info untadhi anukunta..

[cherlapalli_jailer]

nenu kuda cheyaledu bro kaani idea undhi... yeah aa database lo unna tables-transaction info untadhi anukunta..

then imagine the volume i doubt there will be Any idexes

 

Even deleted rec ki kooda entry vuntundi 

[mettastar]

then imagine the volume i doubt there will be nay triggers

 

Even deleted rec ki kooda entry vuntundi 

hmm.. yeah table matram huge untundhi

[cherlapalli_jailer]

hmm.. yeah table matram huge untundhi

typo error in above stmt

 

Transaction log will not have any indexes as per my guess

 

So read any table which doesn't have indexes with huge data