The keyword here is translated as "therefore," but it also means "really." The idea is that a person "really swearing" on the altar is swearing on more than the altar. The feeling is that in taking swore statements, the religious officials charged for each thing sworn upon.