zOld Summary of Feb. 4 discussion

Marco, Justas, Diego C. and Stefano discussed a post-mortem of today's incident. We summarized on the blackboard what we could do now. I'll look into adding a photo taken by Marco. But here's in text:

1. Define operational cost of running 4 instances of ASO (1 is marginal, Stefano says he'd feel better with 3 active and one draining at any time). So we start with 2 next week and see
2. tell management of our troubles and ask for help (done by stefano after the meeting)
3. That is a hand-made BigCouch, what's happened/happening to BigCouch in production ?
4. View Splitting and Erlang (Justas says it is all ready, Marco needs to merge and then Diego to deploy)
5. Speed up transition from ASO to direct and back in times of troubles, use e.g. a file on CVMFS to change behavior of running jobs, rather then current way which only affects new tasks
6. Justas says Couch is wrong technology for documents which are modified
7. have a review and look into possible major changes

blackboard picture: https://www.dropbox.com/s/bizlc2w1rzcmtml/20160204_124236.jpg?dl=0