I certainly wouldn't say that a traditional LLM is conscious. Once an input falls off of a LLM's input buffer it ceases to have any effect on its output, the exact same way that a subliminal stimuli's effects are limited in a human brain. The size, in bytes, of a LLM's input buffer isn't all that far off from a human brain's input activations either. So strictly feed-forward neural networks aren't conscious in this sense but its easy to image that architectural changes might provide an analogue to what a humans' consciousness provides.
