It's more than that; holy scripture says that people are to be judged by what they did in relation to "these these least" and some reject what scripture says in an effort to lend support to their theology.
Matthew 25:31-46 31 But when the Son of man will have arrived in his majesty, and all the Angels with him, then he will sit upon the seat of his majesty. 32 And all the nations shall be gathered together before him. And he shall separate them from one another, just as a shepherd separates the sheep from the goats. 33 And he shall station the sheep, indeed, on his right, but the goats on his left. 34 Then the King shall say to those who will be on his right: ‘Come, you blessed of my Father. Possess the kingdom prepared for you from the foundation of the world. 35 For I was hungry, and you gave me to eat; I was thirsty, and you gave me to drink; I was a stranger, and you took me in; 36 naked, and you covered me; sick, and you visited me; I was in prison, and you came to me.’ 37 Then the just will answer him, saying: ‘Lord, when have we see you hungry, and fed you; thirsty, and given you drink? 38 And when have we seen you a stranger, and taken you in? Or naked, and covered you? 39 Or when did we see you sick, or in prison, and visit to you?’ 40 And in response, the King shall say to them, ‘Amen I say to you, whenever you did this for one of these, the least of my brothers, you did it for me.’ 41 Then he shall also say, to those who will be on his left: ‘Depart from me, you accursed ones, into the eternal fire, which was prepared for the devil and his angels. 42 For I was hungry, and you did not give me to eat; I was thirsty, and you did not give me to drink; 43 I was a stranger and you did not take me in; naked, and you did not cover me; sick and in prison, and you did not visit me.’ 44 Then they will also answer him, saying: ‘Lord, when did we see you hungry, or thirsty, or a stranger, or naked, or sick, or in prison, and did not minister to you?’ 45 Then he shall respond to them by saying: ‘Amen I say to you, whenever you did not do it to one of these least, neither did you do it to me.’ 46 And these shall go into eternal punishment, but the just shall go into eternal life.”
Judgement is according to what a person does in regard to Jesus present in "one of these least"; who can deny it without denying what Christ teaches?