Brent Ozar Unlimited
Region: US
Monday 23 September 2024 20:49:08 GMT
6763
178
17
10
Music
Download
Comments
Peter Mulholland :
identifying only the parts that have changed is easier said than done though. we tried it by adding lastModified and lastSynced dates but that wrecked performance. went back to full sync nightly
2024-09-23 21:40:22
4
giant147 :
Instructions unclear. I tried not doing the thing the customer and management insisted I do, now I'm unemployed.
2024-09-24 03:47:11
5
Xanax66 :
Explaining this to analysts hurts my heart
2024-10-24 09:26:59
0
Sean :
I'd suggest a hashbytes function to convert the process to identify changes by id; but I also think this is an XY problem where the issue isn't full table refresh, but keeping 2 tables in sync
2024-09-23 21:00:26
0
Boz :
full table refreshes are most often the symptom of larger data issues which are often ignored by other teams and you are left with full refresh.
2024-09-23 22:49:36
1
Mr.Zeusie :
delta extraction is not easy. if you need full table refresh consider using tools like fivetran which can handle database table mirroring.
2024-09-23 22:34:53
1
earlGray161 :
Trunk, Drop indexes, load from csv file. is the fastest way.
2024-09-23 23:07:39
0
user3018621572163 :
Full table refresh is so common 🤦♂️
2024-09-23 21:44:34
0
Vern :
but it works 😇
2024-09-24 02:56:15
0
Tyler Sleepy Domer :
CDC saves lives (jobs), event driven > data driven
2024-09-25 16:10:49
1
Abacus.exe :
Bad take. Example, I have a legacy DB that has no awareness of changed data (no logs, history, updated date, staging tables, etc). Finding delta would have to be post export, which loads it all anyway
2024-09-23 23:03:34
2
To see more videos from user @brentozarultd, please go to the Tikwm
homepage.
