We run this crazy Visual manufacturing ERP system @ work and its flawed from the get go. Yet, we have a super custom Aerospace & Defense installation due to what we do and how we have to do it, which makes things oh so ridiculously complicated. Still running on an Oracle 8i platform on one side of the building, the sister division in house runs Oracle 10g - awesome. Last couple days the ERP has been shitting the sheets when accounting/finance goes and runs their costing reports. They somehow keep dead locking the database and when another process tries to run everything comes crumbling down.

Last night we leave thinking everythings good. Turns out Microsoft pushed a non-optional critical update which required the Visual server to reboot even though it was flagged not to do updates in WSUS. It was running costing right when it rebooted. I get a phone call at 1AM and enjoy VPN technology for a couple hours and realize that the one database that costing was running in is now corrupt, it took out a play database, and I have to restore from a hot backup from 5AM weds + archive logs from the day.

Terrible, terrible night, and I come in today and accounting went and decided to run their costing report (closing month here) against the play database... ... so all the data they're using is fake. They basically just slowed the server down and used 10 hrs of resources to generate reports we can't use.

Really looking forward to friday this week!

Sorry had to rant