I also workout almost daily (at least five times a week, sometimes six) - not to mention chasing after a three year old and a baby! In my opinion, even though nutrition is typically 80% of the equation in weight loss/management/maintenance - it is SO important to MOVE YOUR BODY! Take the weekend to do your longer cardio sessions (since hopefully you'll have at least a day off during the weekend!). Do you higher intensity intervals and toning during the week in 30-45 minute bouts.
And don't get down on yourself! Everything helps in fitness. Working out is like depositing money in a bank - every additional minute adds to your overall well-being.