In the nuclear industry it is still common to rely on tele-operated robots. Tele-operation however can be strenuous and demanding on operating personnel and productivity can be low without advanced HRI interfaces. Today, the world is moving towards Industry 4.0. With that vision, this paper introduces the concept of Remotely Instructed Robots (RIRs), which are reliable yet rely on human intelligence. RIRs can accept high and low level instructions from the operator and execute tasks based on operators’ descriptions and at a variety of complexity levels. The paper outlines an agent model of RIRs and furthermore, presents how it could be implemented inside nuclear gloveboxes to achieve novel human robot interaction.