It is not a sin not to say your weekly Rosaries. You will only miss out on the graces and blessings that would have come through your prayers.