Try taking a day off of any type of activity and see how you feel the following day. I'm on week 3 also, and I sometimes walk on my non-running days, but I have at least one day a week when I don't do anything. You're putting stress on your muscles and joints that you aren't accustomed to. Give yourself a day or so every week to bounce back and get your body conditioned.