Just because a person is responding to you, acting like they're enjoying the conversation and/or remaining silent, doesn't mean they aren't uncomfy.
I acted like that in a similar situation before, and I can assure you, that does not mean consent.
Ask. First. Before anything