Ask HN: Basic Question About Neural Network?

Are neural networks called Markov Chains now? If so, can someone explain the co-relation to state diagrams.