The former Manchester United serial title winner has been one of the club's biggest critics, but defended them after Matthijs de Ligt was penalised in the 90th minute for fouling Danny Ings.
Hammers captain Jarrod Bowen scored from the resulting spot-kick to send the London Stadium into raptures and pile even greater pressure on Erik ten Hag.
The under-fire United boss and his players were left furious when referee David Coote awarded the hosts a penalty following the lengthy VAR review.
Experienced referee Michael Oliver was the VAR assistant and prompted Coote to review the incident on the pitchside monitor with a penalty eventually given that condemned United to a fourth Premier League defeat of the season.
Neville (right) was critical after referee David Coote (left) was advised to review the foul on the pitchside monitor
Neville fumed over the penalty and revealed the decision left him 'screaming at the tv' with United dealt a Hammer blow on their trip to the capital.
Speaking on his Gary Neville podcast, the celebrated pundit stated: 'It's (penalty) not right that one. Every team gets a bad decision but that wasn't right.
'The interesting thing was he must have watched it eight times when he went to the monitor. I'm screaming at the TV 'he doesn't think it's a penalty' but then he overturns his original decision,' he added.
'I think the pressure maybe of being sent over to the screen by Michael Oliver, a dominant referee, no-one likes to upset their superiors.
'I'm not sure David Coote was anywhere near thinking it was a penalty, and it was a big shock,' said Neville.