Machine translation has long been a grand challenge for Artificial Intelligence, and a challenging testing ground for machine learning of natural language. Recently, deep neural networks have led to dramatic increases in translation quality. I will briefly explain how neural network architectures are used to model translation, and discuss some of the open research questions in the field that my students and I are working on.