The Portuguese playmaker has been United's first-choice skipper since Ten Hag chose him to replace England centre back Harry Maguire in July last year.
Fernandes led United on Sunday in a dismal 3-0 home defeat by Liverpool at Old Trafford.
Pardew suggested that Fernandes was not the right type of player to captain a team because of his role as a 'technical' creator.
Fernandes pictured looking frustrated during Sunday's game, in which he had 58 touches
'You've got your skipper out there, you've got a technical skipper. When you've got a technician as a skipper, I think it's always dangerous because they're going to have off games,' Pardew explained.
'Even [Christian] Eriksen in his prime, [Michel] Platini in his prime, they'd have an off day. They were technical players.'
Pardew went on to suggest that Fernandes is less effective as an attacking force when he is captaining United because he might get distracted by his leadership duties.
'Today, it was never Fernandes because they (United) never had the ball enough,' Pardew added.
'Defensively, he's not been called upon. How can he lead the team? It's a very difficult one for him.
'I actually think it would be better for him as a footballer to take it off him. I think it might free him up a bit, let him be a bit more free-minded.
'He's probably worrying about the back four, worrying about the wingers. You don't really know how to deal with it.