Continuing default rule limits retrospective application of penalty provisions; old penal provision governs defaults completed before legislative change. Where a failure to furnish a prescribed return or statement was committed before the statutory amendment, the pre-amendment penal provision governs that default; the post-amendment penalty provision does not apply to the same completed default even if its effects continue after the amendment.