i'm in training for a certain piece of software. i put out a prod app for a final test that almost took out the production server. lots of calls, heat and shade from fellow coworkers. the aspect that i fucked up wasn't covered in the training. i was told don't blame it on the trainer as they have an incendiary temper. vague because more details would remove anonymity. I'm feeling pretty shitty right now, and getting more paranoid about the damned technology screwing me over. let's commiserate! What have you fucked up?
Hey man. The only thing I took from ur comment - bad devops processes. If u were the new guy, it was their fault for having a crappy deployment pipeline!!! No biggie, happens to us all.
Worked at a web host. Deleted a client's VPS because it looked like it was inactive / hadn't been paid for in a while. Some 20 minutes later he opens support tickets raging that his site is down. My boss blamed the deletion on bad backup scripts and then told the team to never delete anything again.
I've never taken down prod but I have on test. I took the blame and no one looked twice. If you're team is throwing you shade that's a clear indication that the team isn't a good one.
it simply wasn't possible in any of my jobs. there were checks in place before the code can make it into prod. then there was good monitoring that warned us pretty early in case there is a bad trend
that's the dream
my biggest mistakes involved office politics. i sucked at it and said the wrong thing to the wrong person, not knowing what he'd do with it. lesson learned, dont buy drinks for your testers, no matter how much you want to thank them. anything you say to them will be used by them to cozy up to management
Got separate team of testers? That's your first problem. Second, you are likely blaming testers for both culture or them just being honest. Grow up. Thank them profusely.
Grow up? You are guessing and I was being vague. Suffice to say I made a mistake. One was offering an opinion when asked, and the second was having my candid response flow up 5 levels to someone who was offended to hear it. This being my thanks for buying him drinks.
Let me tell you the tale of little Billy drop table
o______O
I once took out telephone service for 10k+ customers for 30 min. I was certain I would be fired but I lived and learned and so will you.
Greg Powell survived after he lost the prototype iPhone 4.
applied wrong fix to whole cluster of about 200 nodes... tore all the vms and rebuild and applied fix
did a wrong code drop merge that cost two days downtime and the vendor found it instead of me, almost got me fired but my performance was reduced for the year and took off important assignments, big mistakes that I never recovered from and eventually left on my own.
I've done that before... Pushed code that broke major functionality for most of our clients. I think it's somewhat of a right of passage... Also you're not going to make that same mistake twice. Plus it shines a light on the weak links in the development process, in my case a combination of lazy code reviews and incomplete test coverage