The case of a computer with an interpreter is more analogous to having a Japanese interpreter in your head. The software is part of a computer's internal abilities as much as a person's acquired language skills.
What I don't understand is what makes source code different from an "mathematical algorithm" but then how then is a series of instructions for building a machine different from a "mathematical algorithm"?