Suggestions for 5 days in Peru

I am visiting Lima, Peru to go see a concert - but I will have several days before then to have some time to spend in Peru. We fly in October 13th, and leave the morning of the 18th. The concert is on the 17th, so we really have 3 full days to work with, the 14th, 15th and 16th. A friend mentioned doing Machu Picchu, but it seems like we would really have to cram it in, also being quite expensive and tourist heavy, I just don't know that its worth the huge effort for me.

So for those who have visited Peru, what would you suggest? I see so many varying reviews of Lima, some loving it, some not so much. I do love food culture so am interested in that for sure. If I didn't go to Machu Picchu, would it be silly to visit Cusco anyways?

Also curious about the safety in the neighborhood near Estadio Nacional. I am still planning accommodations and with the traffic in Lima it seems like a massive pain to get an uber after the show to get back to the southern areas reccomended to stay in, and didnt know if staying nearby the stadium would be smart. It is near the water park.

Thanks for any advice!!