Learning When and Where You Need It