Humans are always the hardest part: The one thing in optimization you can't debug