If you're in BC, child support payments can be handled through a government agency called BCFMEP:
http://www.fmep.gov.bc.ca/
"British Columbia Family Maintenance Enforcement Program".
The supporting person makes payments to an BCFMEP account number: BCFMEP actually handles the money, and they deal with late payments, and so on.
About interest:
"We will also charge you daily interest on any late payments, and add it to our records at the end of every month. All interest goes to the recipient."
http://www.fmep.gov.bc.ca/resources/information/information-for-the-payor-who-is-enrolled.php
However, I am not sure whether BCFMEP enforces any outstanding debts which occurred before enrollment in the program. That's a good question for someone from that program.