Evaraina AWS or Azure using in SQL Platforms

[kum5758]

em em tools using oh infomation kavali koncham.

 

[tables]

nee question endi reverse ga undi? AWS or Azure platform lo SQL vadtunnara ani adagali kaani SQL Platform lo Azure/AWS vaadaam endi?

[kum5758]

Microsoft shop anuko bhayya ETL --SSIS vadutharu to push the data intp Red Shift , Reporting to Power Bi Vadutharu free kabatti

Oracle world anuko ETL ku Informatica vadutharu red shift lo push cheyadaniki, power bi oh leka tableau oh reporting ku

na question ETL tools em em vaduthunnaru other than SSIS (microsoft shop) or informatica (oracle world) to push the data to red shift or S3?

Azure- no idea about this

[tables]

1 minute ago, kum5758 said:

Microsoft shop anuko bhayya ETL --SSIS vadutharu to push the data intp Red Shift , Reporting to Power Bi Vadutharu free kabatti

Oracle world anuko ETL ku Informatica vadutharu red shift lo push cheyadaniki, power bi oh leka tableau oh reporting ku

na question ETL tools em em vaduthunnaru other than SSIS (microsoft shop) or informatica (oracle world) to push the data to red shift or S3?

Azure- no idea about this

enta amount of data move chestunnav? 

azure offers azure data factory to push data to ADW (using polybase).

AWS aithe data pipe line use cheyochu (you can use Spark for any transformations). 

you will face bottlenecks when pushing onprem data to s3/blob based on data size.

[DaleSteyn1]

Python vaaduthunnam to move data to s3

[tables]

1 hour ago, DaleSteyn1 said:

Python vaaduthunnam to move data to s3

python ekkada nundi run chestunnaru? EC2 or from on prem server? any particular frameworks you are using?

[k2s]

Edaina vadochu man

[nrikittu]

[ARYA]

em matladutunnavo naku ite samaj kavat ley man...butta lo puvvulu untai kani puvvu lo butta undadu...

[kum5758]

21 hours ago, DaleSteyn1 said:

Python vaaduthunnam to move data to s3

Thanks bhayya.

any specific reason opting for python than etl tool.

which is the best source to learn python which will be helpful for the above mentioned

[kum5758]

23 hours ago, tables said:

enta amount of data move chestunnav? 

azure offers azure data factory to push data to ADW (using polybase).

AWS aithe data pipe line use cheyochu (you can use Spark for any transformations). 

you will face bottlenecks when pushing onprem data to s3/blob based on data size.

just limited bhayya, around 40 million expecting. planning to do CDC process.

 

[DaleSteyn1]

25 minutes ago, kum5758 said:

Thanks bhayya.

any specific reason opting for python than etl tool.

which is the best source to learn python which will be helpful for the above mentioned

table nunchi export chesi file ki daanni aws ki move chesi malli redshift loki load chestham everything one single python script e process chala fast ga avtundhi maadhi huge data untundhi kabatti