Timeline for Best way to synchronize data between two different databases
Current License: CC BY-SA 3.0
7 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Jul 1, 2015 at 10:49 | comment | added | Karan | Alright this is good, since you can perform the queries using the tool called PyODBC into the remote DB. You can do one more thing. You can pull the product data straight in the same format as it is into the new "Staging table" in your target DB without any checks or validations. This way you will get the live data in a single shot in your target db under the stage tables. Then later in the second step, you can perform the checksum operations and update the target transactional table data. This would prevent the hash or the checksum evaluation with the source db data at the real time. | |
| Jul 1, 2015 at 9:59 | comment | added | Neow | A dsn has been set up using an odbc driver. I can connect and do queries using pyodbc for Python. | |
| Jul 1, 2015 at 9:48 | comment | added | Karan | Since your source is db2. How do you intent to pull the data from it ? via some webservice or API.. | |
| Jul 1, 2015 at 9:45 | comment | added | Karan | Since there are no updated time fields in the source database, then we are left to pull the qualified data rows based on the checksum or the hash. | |
| Jul 1, 2015 at 9:29 | comment | added | Neow | Thanks but I'm not sure your solution could work - see my edits in the "issues" part. | |
| Jul 1, 2015 at 9:04 | history | edited | Karan | CC BY-SA 3.0 | added 234 characters in body |
| Jul 1, 2015 at 8:46 | history | answered | Karan | CC BY-SA 3.0 |