Moyes said: "We did a lot of good things but didn't defend well enough. We scored some good goals and we were a threat but in the end we conceded one more goal than they did.
"We scored a minute into the second half but I don't think you can say we were in control at 3-1. As you know, Newcastle shooting down the way it is always tough. It's small margins. I think a couple of decisions the referee made on penalty kicks. I think the second one, Gordon restricts Kalvin Phillips from kicking the ball. I actually think it's the wrong decision. We had so many things that didn't go in our favour today but there were a lot of good things the players did."
On bouncing back, he said: "It's not easy. We have lost a game when we should have won a game. In the Premier League. This is a tough place to come and for a long period we looked as though we were going to be the side who finished on top. We didn't see the job through and weren't tough enough. We had to be harder to play against and we didn't do that.
"We all learn. Football always gives you another chance to try and win and hopefully we will try and do that in the next game."